Skip to main content

Test Management

Tutorials

TB Testers in Value-Driven Product Development
J.B. Rainsberger, JBRAINS.CA
Tue, 06/23/2015 - 8:30am

Even in many agile projects, testers stand aside while others set product and project goals and requirements (stories). These other people aren’t doing poor work but rather are often developing artifacts that are too easily misinterpreted. J.B. Rainsberger presents two value-driven development techniques that testers—who by their very nature are critical thinkers—can use to help the team figure out what to build, which parts to build first, and most importantly, what not to build at all. Learn a powerful modeling technique to reduce a long laundry list of stories down to a clear, high-level path toward a great product. Join J.B. to practice the art of “talking in examples,” which will help you work with product owners, analysts, and programmers to develop a clear picture of what to build. Don’t remain relegated to after-the-fact acceptance testing. Learn how to play a vital role in building the right thing the first time.

Read more
TC Essential Test Management and Planning
Rick Craig, Software Quality Engineering
Tue, 06/23/2015 - 8:30am

The key to successful testing is effective and timely planning. Rick Craig introduces proven test planning methods and techniques, including the Master Test Plan and level-specific test plans for acceptance, system, integration, and unit testing. Rick explains how to customize an IEEE-829-style test plan and test summary report to fit your organization’s needs. Learn how to manage test activities, estimate test efforts, and achieve buy-in. Discover a practical risk analysis technique to prioritize your testing and become more effective with limited resources. Rick offers test measurement and reporting recommendations for monitoring the testing process. Discover new methods and develop renewed energy for taking your organization’s test management to the next level.

Read more
TF Tips for Expanding Your Testing Toolbox
Alan Page, Microsoft
Tue, 06/23/2015 - 1:00pm

Regardless of how long you’ve been testing and learning—only a month or many years—there is always something new to help improve your testing and software development efforts. Although many testers, for better or worse, see test automation as their next—and sometimes only—step to grow their skill set and improve as a tester, there is much more to do. Alan Page discusses, demonstrates, and details concepts and tools that can help everyone test better and provide noticeable technical value to their organization. Alan explores a potpourri of suggestions to help you grow your testing toolbox: techniques for security and performance testing, tools to help you find better bugs, scripting that aids (rather than replaces) your testing, tester tips for code review that can be done with minimal (or zero) knowledge of coding, and more. Finally, you’ll learn simple approaches that will enable you to continue to grow your knowledge and skills throughout your career.

Read more
TG Getting Things Done: What Testers Do in Agile Sprints
Rob Sabourin, AmiBug.com
Tue, 06/23/2015 - 1:00pm

Avoiding siloed development and test is a tricky business—even with agile practices in place. It is easy for agile teams to fall into the rut in which testers only do testing and programmers only do coding. Rob Sabourin explores many ways to apply your testing knowledge and experience inside a Scrum sprint or iteration and throughout an agile project. He finds that testers are among the most skilled team members in story grooming, elicitation, and exploration. Rob describes a host of ways testers add value to an agile sprint—using their analysis skills to help clear the way to make tough technical trade-offs; pairing with programmers to help design and review unit tests; studying static analysis reports to find unexpected code complexity or security; and much more. Join Rob to see how testers can start working hand-in-hand with developers, business analysts, and product owners to get more things done in agile sprints and projects.

Read more

Keynotes

K1 How We NOW Test Software at Microsoft
Alan Page, Microsoft
Wed, 06/24/2015 - 8:30am

In December 2008 when How We Test Software at Microsoft was first published, the software community appreciated the insight into many testing activities and processes popular at Microsoft. Six and a half years later, many companies—including Microsoft—have evolved and changed in a variety of ways, and now much of the book is outdated or obsolete. New products, new ideas, and new strategies for releasing software have emerged. Alan Page explores Microsoft’s current approaches to software testing and quality. He digs into new practices, describes changing roles, rants about long-lived ideas kicked to the curb in the past seven years―and might even share a few tidbits not fit for print and wide-scale distribution. To give organizations food for thought and ideas for growth, Alan reveals what’s new in quality approaches, developer to tester ratios, agile practices, tools, tester responsibilities—and lessons he’s learned along the way.

Read more
K3 Build the Right Product Right: Transitioning Test from Critiquing to Defining
Gerard Meszaros, FeedXL.com
Thu, 06/25/2015 - 8:30am

Do you find yourself with limited influence over what gets shipped on products you test? Is your report card on product quality often ignored? Do you think you can contribute more? Join Gerard Meszaros as he describes ways to transition from approaching quality with brute force testing to an enlightened and strategic perspective that will have real impact on product quality. Instead of criticizing the product, become an integral part of the development process and learn how you can help define what should be built. Gerard explores design for testability concepts and describes key testability requirements that will afford better, more efficient testing. He explains test design techniques that describe software functionality in layers of plain language tests. Gerard shows how a collaborative approach for building the right product results in much better outcomes from both quality and schedule perspectives. Stop rushing through multiple test-and-fix cycles that result in a less than quality product. Be part of the solution!

Read more
K4 The Next Decade of Agile Software Development and Test
J.B. Rainsberger, JBRAINS.CA
Thu, 06/25/2015 - 2:45pm

After almost fifteen years of history with agile practices, J.B. Rainsberger sees some alarming trends in our attitudes, practices, and even what we teach about agile. At the same time, he sees some progress in approaches and technologies—e.g., behavior-driven development, naked planning, and continuous delivery. Sadly, we still have maturity models, complicated process checklists, and unnecessary certification schemes. In the coming decade, unless we begin to focus on fundamental ingredients absent from many agile teams, J.B. fears we are doomed to miss many opportunities for getting better. It's not good enough anymore just to be a great agile tester. J.B. says testers, programmers, product analysts, and managers must encourage workplace transformations so we can take full advantage of new tools and techniques. He shares a vision of these transformations and calls on testers and test managers, who work with all stakeholder groups, to stand up and lead us into the next decade of agile.

Read more

Concurrent Sessions

W1 Leadership for Test Managers and Testers
Rick Craig, Software Quality Engineering
Wed, 06/24/2015 - 10:15am

Many organizations spend a great deal of time and effort acquiring and learning to use the latest techniques and technology, but they make little or no attempt to train or mentor their staff to be better leaders. While it is true that technology is important, test teams without able leaders will struggle to be successful. Rick Craig shares some of the lessons he has learned in his roles as test manager, military leader, and entrepreneur. Initially, Rick discusses some classic leadership topics―leadership traits and styles, the cornerstones of leadership, and principles of leadership. Explore the importance of influence leaders and how to identify and encourage them. Discover the positive and negative indicators of morale and how to maintain high morale within a team. Learn how to give direction without being a micromanager. Discuss what motivates and what de-motivates testers. Rick encourages you to bring your leadership challenges to serve as points of discussion.

Read more
W2 Testing the Internet of Things
Regg Struyk, Polarion Software
Wed, 06/24/2015 - 10:15am

Embedded software—now being referred to as the Internet of Things (IoT)—continues to permeate almost every industry—from household appliances to heart monitors. It is estimated that there are at least a million lines of code in the average car. As IoT explodes from millions of devices to tens of billions in the next few years, new challenges will emerge for software testing. Security, privacy, complexity, and competing standards will fuel the need for innovative testing. Customers don't care why your software failed in the connected chain—only that it did fail. Companies that focus on quality will ultimately be the successful brands. Learn what new approaches are required for testing the “zoo” of interconnected devices. As products increasingly connect physical hardware with applications, we must revisit old testing approaches. IoT is about analyzing data in real time, allowing testers to make quicker and more informed decisions. If IoT testing is in your future, this session is for you.

Read more
W3 From Formal Test Cases to Session-Based Exploratory Testing
Ron Smith, Intuit
Wed, 06/24/2015 - 10:15am

Agile software development is exciting, but what happens when your team is entrenched in older methodologies? Even with support from the organization, it is challenging to lead an organization through the transformation. As you start making smaller, more frequent releases, your manual test cases may not keep up, and your automated tests may not yet be robust enough to fill the gap. Add in the reality of shrinking testing resources, and it is obvious that change is required. But how and what should you change? Learn how Ron Smith and his team tackled these challenges by moving from a test case-driven approach to predominantly session-based exploratory testing, supported by “just enough” documentation. Discover how this resulted in testers who are more engaged, developers who increased their ability and willingness to test, and managers who increased their understanding and insight into the product. Use what you learn from Ron to begin the transformation in your organization.

Read more
W5 Building a World-Class Quality Team at eBay
Steve Hares, eBay
Wed, 06/24/2015 - 11:30am

Today, many test methodologies can be used to achieve high quality and productivity ―Agile/Scrum, TDD, data modeling, risk analysis, and personas, just to name a few. So how do you pick the best approaches and techniques for your team and projects? Learn how Steve Hares helped build a world-class team from the ground up at eBay through iterative best-fit analysis of processes and methods. Discover why and how they adopted agile processes in some areas, waterfall in others, risk-based testing where appropriate, data model-driven testing, ad-hoc testing, and work-flow testing. At the same time, they incorporated test automation and integrated load/performance testing into the development process to achieve world class quality. Steve’s team now tests everything from enterprise wide products to IVRs, from batch files to voice biometrics. If your methodology isn't working just right, chances are you need to find the best fit methods through a continuous improvement process.

Read more
W6 Virtualize APIs for Better Application Testing
Lorinda Brandon, SmartBear Software
Wed, 06/24/2015 - 11:30am

In today’s interconnected world, APIs are the glue that allows software components, devices, and applications to work together. Unfortunately, many testers don’t have direct access to manipulate the APIs during testing and must rely on either testing the API separately from the application or testing the API passively through functional application testing. Lorinda Brandon maintains that these approaches miss the most important kind of API testing―uncovering how your application deals with API constraints and failures. Lorinda describes common API failures—overloaded APIs, bad requests, unavailabilities, and API timeouts—that negatively impact applications, and how application testers miss these scenarios, especially in third-party APIs. She explores how and when virtualization can and cannot help, including creating a virtual API that can fail. Lorinda discusses the importance of simulating API failures in web and mobile application testing, and identifies tools and technologies that help virtualize your APIs.

Read more
W9 The Tester’s Role in Agile Planning
Rob Sabourin, AmiBug.com
Wed, 06/24/2015 - 1:30pm

All too often testers passively participate in agile planning. And the results? Important testing activities are missed, late testing becomes a bottleneck, and the benefits of agile development quickly diminish. However, testers can actively advocate customer concerns while helping to implement robust solutions. Rob Sabourin shows how testers contribute to estimation, task definition, and scoping work required to implement user stories. Testers apply their elicitation skills to understand what users need, exploring typical, alternate, and error scenarios. Testers can anticipate cross story interference and the impact of new stories on legacy functionality. Rob discusses examples of how to break agile stories into test-related tasks. He shares experiences of transforming agile testers from passive planning participants into dynamic advocates of effective trade-offs, addressing the product owners’ critical business concerns, the teams’ limited resources, and the software projects’ technical risks. Join Rob to explore test infrastructure, test data, non-functional attributes, privacy, security, robustness, exploration, regression, business rules, and more.

Read more
W10 Inside the Mind of the 21st Century Customer
Alan Page, Microsoft
Wed, 06/24/2015 - 1:30pm

Testers frequently say that they are the voice of the customer or the customer advocate for their organization’s products. In some situations this can be a helpful mindset, but no matter how hard he tries, a software tester is not the customer. In fact, there is no one better suited to evaluate customer experience than the actual customer of your software. However, getting actionable feedback from customers can be time-consuming, difficult, and often too late to have any meaningful impact on the product. Alan Page shares his thoughts and a number of examples of how to get customer feedback quickly, how to make that feedback actionable, and how to use customer data to drive better software development and testing on any team—and for any product. In this fast-paced session of information and fun, Alan discusses product instrumentation, analysis techniques, reporting, A/B testing, and many other facets of customer feedback.

Read more

Implementing test automation requires more than selecting the best tool and starting to write automated tests. Because test automation tools must integrate with your development lifecycle and its various project management, build, integration, and release tools, you need an automation comprehensive architecture implementation plan. Drawing on his experiences at a large financial institution, Mike Sowers discusses the steps for a test automation architecture, identifying tool dependencies, establishing deployment plans, and selecting and reporting metrics. Challenges Mike’s organization faced included ensuring that the selected tools worked well with other application lifecycle tools, driving the adoption of automation across multiple project teams or departments, and communicating the quantitative and qualitative benefits to key stakeholders in management. Mike discusses things that went right (such as including the corporate architectural review board) and things that went wrong (allowing too much organizational separation between testers and automation engineers). Take back a To Do list of opportunities and issues to improve your test automation implementation or start a new one.

Read more
W13 Testing for Talent: Leveraging Testing Principles in Building Teams
Joy Toney, ALSAC/St Jude Children's Research Hospital
Wed, 06/24/2015 - 3:00pm

Application development teams today are asked to deliver more with fewer resources. They work together tirelessly under pressure to deliver quality solutions to their stakeholders. Now imagine—just as the delivery team is about to begin its testing cycle, your lead tester suddenly quits. How do you replace a talented contributor within tight time constraints? Just as testing principles enable delivery of better systems, Joy Toney demonstrates how using those same testing principles enables the test manager to select and hire outstanding team members. First, define your testing team’s acceptance criteria for the position. Rethink the application of the validation and verification processes to hiring, while using a combination of static and dynamic testing techniques. Consider using stress, volume, and performance testing to surface your ideal candidate from the pool of possibilities. Discover new ideas and proven techniques for use in your hiring decisions, so you hire the right person for your test team the first time.

Read more
T1 Managing Technical Debt
Philippe Kruchten, Kruchten Engineering Services, Ltd.
Thu, 06/25/2015 - 10:15am

Technical debt is slowing your software development projects. Any developer who has gone beyond version 1 has encountered it. Technical debt takes different forms, has many different origins, and does not always equate to bad code quality. Much of it is incurred due to the passage of time and a rapidly evolving business environment. Some is in the form of hundreds of little cuts; some is massive and overwhelming, the result of a single poor design choice. Philippe Kruchten explains how to distinguish different types of technical debt, identify their root causes, objectively assess their impact, and develop strategies suitable in your context to limit or selectively reduce the technical debt you incur. Discover what debt you can happily live with. See when to declare bankruptcy. And learn that not all technical debt is bad. Just like in the real world, some technical debt can be a valuable investment for the future.

Read more
T3 Create Disposable Test Environments with Vagrant and Puppet
Gene Gotimer, Coveros, Inc.
Thu, 06/25/2015 - 10:15am

As the pace of development increases, testing has more to do and less time in which to do it. Software testing must evolve to meet delivery goals while continuing to meet quality objectives. Gene Gotimer explores how tools like Vagrant and Puppet work together to provide on-demand, disposable test environments that are delivered quickly, in a known state, with pre-populated test data and automated test fixture provisioning. With a single command, Vagrant provisions one or more virtual machines on a local box, in a private or public cloud. Puppet then takes over to install and configure software, setup test data, and get the system or systems ready for testing. Since the process is automated, anyone on the team can use the same Vagrant and Puppet scripts to get his own virtual environment for testing. When you are finished with it, Vagrant tears it back down and restores it to the same original state.

Read more
T4 Root Cause Analysis for Testers
Jan van Moll, Philips Healthcare
Thu, 06/25/2015 - 10:15am

Bad product quality can haunt companies long after the product’s release. And root cause analysis (RCA) of product failures is an indispensable step in preventing its recurrence. Unfortunately, the testing industry struggles with doing proper RCA. Moreover, companies often fail to unlock the full potential of RCA by not including testers in the process. Failing to recognize the real value testers bring to RCA is a process failure. Another failure is not recognizing how extremely valuable RCA results are for devising enhanced test strategies. Using real-life—and often embarrassing—examples, Jan van Moll illustrates the added value that testers bring and discusses the pitfalls of RCA. Jan challenges testers and managers to analyze and rethink their own RCA practices. Learn how to increase your value as a professional tester to your business by performing powerful RCA—and avoiding its pitfalls.

Read more
T5 The Adventures of a First-Time Test Lead: An Unexpected Journey
Ioan Todoran, Expedia Affiliate Network
Thu, 06/25/2015 - 11:30am

When moving to a new position in your organization, you might not always feel confident—and that’s fine. If you have ever wondered how to change your mindset from “I need to learn from someone more experienced than I” to “I need to train and lead a team,” Ioan Todoran shares what he learned during his time as a first-time test team lead. Ioan shares lessons about recruitment (where and how to look for people), interviewing (forget the boring, interrogatory-style interviews; move toward a more conversational approach), training (how to prepare the new testers for work on a commercial project), and navigating through the daily management duties while keeping the automation work going on your project (stop micromanaging; help, but don't suffocate; learn to offer quick solutions.) Learn how to establish better connections and communication channels with upper management while strengthening the relationships with your clients through an honest and direct approach.

Read more
T6 Write Your Test Cases in a Domain-Specific Language
Beaumont Brush, Dematic, Inc.
Thu, 06/25/2015 - 11:30am

Manual test cases are difficult to write and costly to maintain. Beaumont Brush suggests that one of the more important but infrequently-discussed reasons is that manual tests are usually written in natural language, which is ineffective for describing test cases clearly. Employing a domain-specific language (DSL), Beaumont and his team approach their manual test cases exactly like programming code and gain the benefits of good development and design practices. He shares their coding standards, reusability approach, and object models that integrate transparently into the version control and code review workflow. Beaumont demonstrates two DSL approaches―a highly specified DSL written in Python and a more functional DSL that leverages Gherkin syntax and does not require a computer language to implement. By making your test cases easier to write and maintain, your team will improve its test suite and have time for automating more tests.

Read more
T7 Transform a Manual Testing Process to Incorporate Automation
Jim Trentadue, Ranorex
Thu, 06/25/2015 - 11:30am

Although most testing organizations have automation, it’s usually a subset of their overall efforts. Typically the processes for the department have been previously defined, and the automation team must adapt accordingly. The major issue is that test automation work and deliverables do not always fit into a defined manual testing process. Jim Trentadue explores what test automation professionals must do to be successful. These include understanding development standards for objects, structuring tests for modularity, and eliminating manual efforts. Jim reviews the revisions required to a V-model testing process to fuse in the test automation work. This requires changes to the manual testing process, specifically at the test plan and test case level. Learn the differences between automated and manual testing process needs, how to start a test automation process that ties into your overall testing process, and how to do a gap analysis for those actively doing automation, connecting better with the functional testing team.

Read more
T9 Giving and Receiving Feedback: A New Imperative
Omar Bermudez, agilecafe.org
Thu, 06/25/2015 - 1:30pm

Giving and receiving feedback are tough for everyone. Who wants to criticize others or be criticized? Although managers have a duty to give honest feedback to staff and peers, many people resist change or differ on how to change—leading to interpersonal conflicts and impacting deliverables. Omar Bermudez explains several techniques—Giving Positive Feedback, Acid Reflux (when you get that sick feeling), and SARA (Surprise, Anger, Rationalization, Acceptance)—that allow people to give and receive honest feedback to promote incremental improvements. Omar explains how to give accurate feedback to and receive the same from senior team members or direct superiors, a skill critical to career advancement. To increase self-esteem, happiness index, and your power to influence, Omar teaches you how to present feedback to your peers, your boss, or other colleagues in a diplomatic and efficient way. Take away key insights into how to create a healthy organizational culture with clear and constructive feedback.

Read more
T10 The Power of Pair Testing
Kirk Lee, Infusionsoft
Thu, 06/25/2015 - 1:30pm

Perhaps you have heard of pair testing but are unaware of its tremendous benefits. Maybe you have tried pair testing in the past but were dissatisfied with the result. When done correctly, pair testing significantly increases quality, decreases overhead, and improves the relationship between testers and developers. Join Kirk Lee as he shares the essential points of this powerful technique that moves testing upstream and prevents defects from being committed to the codebase. Kirk explores how pair testing facilitates discussion, increases test effectiveness, promotes partnership, and provides cross training. Learn why testers and developers say they love pair testing. Kirk describes key tips to ensure success, including the amount of time required for the pair-testing session, the best way to run the session, and how to know when the session is complete. He provides specific steps to take before, during, and after the pair-testing session to make it even more effective.

Read more
T12 If You Could Turn Back Time: Coaching New Testers
Christin Wiedemann, Professional Quality Assurance, Ltd.
Richard Lu, Professional Quality Assurance, Ltd.
Thu, 06/25/2015 - 1:30pm

If you could turn back time, what do you wish you had known when you started working as a tester? When you are new to testing, you are faced with daunting challenges. Recent college graduates may find it difficult to apply academic knowledge in practice. It is easy to get discouraged and start questioning whether testing is really for you. Richard Lu and Christin Wiedemann relate their experiences of starting careers as software testers—with no prior testing experience. They share ideas for how senior testers can keep junior testers engaged, and encourage them to learn and step up in their roles. Easy-to-implement suggestions include explaining the company culture, encouraging relationship building, emphasizing communication, discussing the objective and value of testing, and talking about the different meanings of quality. Instead of leaving your team’s new hires to struggle, join this session and learn how to coach new testers to become their best.

Read more