Measurement and Metrics

Tutorials

MG Measurement and Metrics for Test Managers

Rick Craig, Software Quality Engineering

Mon, 06/08/2015 - 8:30am

To be most effective, test managers must develop and use metrics to help direct the testing effort and make informed recommendations about the software’s release readiness and associated risks. Because one important testing activity is to “measure” the quality of the software, test managers must measure the results of both the development and testing processes. Collecting, analyzing, and using metrics are complicated because many developers and testers are concerned that the metrics will be used against them. Join Rick Craig as he addresses common metrics—measures of product quality, defect removal efficiency, defect density, defect arrival rate, and testing status. Learn the guidelines for developing a test measurement program, rules of thumb for collecting data, and ways to avoid “metrics dysfunction.” Rick identifies several metrics paradigms and discusses the pros and cons of each.

MP Avoid Number Numbness: Think Clearly about Measurement Claims

Michael Bolton, DevelopSense

Laurent Bossavit, Institut Agile

Mon, 06/08/2015 - 1:00pm

Numbers, models, and measurements are often used to describe. Just as often, they are used to persuade. Sometimes, they are used to intimidate. In order to avoid being fooled or bullied, testers must be able to examine information, claims, and evidence critically. They must apply critical thinking to their own observations, interpretations, and reports in order to avoid fooling themselves—or worse, their clients. Michael Bolton and Laurent Bossavit help you look thoughtfully and skillfully at reports, research, and common claims about testing and software development. Learn methods for analyzing those claims and a framework for evaluating them. Apply this approach to real-world cases and exercises, and refine your approach to collecting, assessing, and presenting data. Throughout, remain engaged as you look at the original data, assess the relationship between numbers and their representations, evaluate the methods of measurement and, in a nutshell, refine your current skills and build new ones. Caution: This workshop may interfere with your enjoyment of your daily newspaper.

TH Risk Management: Project Management for Grown-Ups

Tim Lister, Atlantic Systems Guild, Inc.

Tue, 06/09/2015 - 8:30am

Many organizations are childlike. They blithely plan the project as if nothing will go wrong. And then, when something does go wrong, they are shocked and dismayed. Risk management is not just worrying about your project, and it is not about running away from risk. Risk management for software projects is all about when you make decisions and when you take action. How do you deal with uncertainty? When do you decide to deal with a risk while it is still just a risk, and when do you decide to wait to see if the risk does turn into a problem and manage it then? When done with utmost skill and to its greatest advantage, risk management starts before a project is even born. Tim Lister presents the advantages—and the dangers—of practicing risk management like a grown-up. Tim offers a process for you to consider tailoring for your organization and discusses how your organization can grow up.

Concurrent Sessions

BT10 Making Numbers Count: Metrics That Matter

Mike Trites, PQA Testing

Thu, 06/11/2015 - 1:30pm

As testers and test managers, we are frequently asked to report to stakeholders on the progress and results of our testing. Questions like How is testing going? may seem simple enough, but the answer is ultimately based on our ability to extract useful metrics from our work and present them in a meaningful way. This is particularly important in agile environments where clear, concise, and up-to-date metrics may be needed multiple times each day. Mike Trites identifies a number of ways we can use metrics to measure progress during a test cycle and, ultimately, to determine when testing should be considered complete. Learn the common pitfalls of metrics misuse and how you can avoid them by giving proper context when communicating metrics to your stakeholders. Discover key metrics for measuring the effectiveness of your testing and how to use what you learn on one project to improve your testing process on future projects.