STARCANADA 2017 - Test Management

Anyone who has ever attempted to estimate software testing effort realizes just how difficult the task can be. The number of factors that can affect the estimate is virtually unlimited. Rob Sabourin says that the keys to good estimates are understanding the primary variables, comparing them to known standards, and normalizing the estimates based on the differences. This is easy to say but difficult to accomplish because estimates are frequently required even when we know very little about the project—and what we do know is constantly changing. Throw in a healthy dose of politics, add a bit...

To be most effective, test managers must develop and use metrics to help direct the testing effort and make informed recommendations about the software’s release readiness and associated risks. Because one important testing activity is to “measure” the quality of the software, test managers must measure the results of both the development and testing processes. Collecting, analyzing, and using metrics are complicated because many developers and testers are concerned that the metrics will be used against them. Join Mike Sowers as he addresses common metrics—measures of product quality,...

In many organizations, agile development processes are driving the pursuit of faster software releases, which has spawned a set of new practices called DevOps. DevOps stresses communications and integration between development and operations, including rapid deployment, continuous integration, and continuous delivery. Because DevOps practices require confidence that changes made to the code base will function as expected, automated testing is essential. Join Jeffery Payne as he discusses the unique challenges associated with integrating automated testing into continuous integration/...

Agile teams deliver “potentially” shippable software at the end of every iteration (one to four weeks) or possibly every day. Janet Gregory says that this goal can't be achieved without automated tests, and many teams struggle with test automation. The challenge of automating functional regression tests frightens many testers, who feel their skills aren’t up to the job. So, how can you deliver good quality when you have to release so often? By combining a collaborative team approach with appropriate tools and design approaches, you can not only automate your regression tests but also use...

Selenium has an industry reputation of being a flaky tool where individual tests pass, then fail—sometimes with no production changes at all. Such flakiness in your test suites can be extremely difficult, time-consuming, and frustrating to debug. The vast majority of these issues come from using either bad locators or bad wait conditions. Both of these root causes can be addressed by implementing the right framework for your Selenium tests. Craig Schwarzwald shares the most important concepts in creating a more reliable Selenium framework, such as using a base page object that wraps core...

Even the simplest application depends on a vast, rich, and complex set of variables interacting and collaborating to drive behavior. Each variable has many options, and the number of ways these variables can be combined can be astronomical, making it next to impossible to test them all. Combination testing—combining individual test values to form complete test cases—can help. Rob Sabourin shares three real-world case studies that show how combination test design helped testers focus on a manageable subset of combinations to find critical bugs, quickly. Rob will share examples of some...

The data tsunami is coming—or maybe it’s already here. Data science, big data, and machine learning are the buzzwords of the day. Data is changing our products and the way we build them, so we should also change the way we verify our products. In a world of increasing connectivity and accelerated deadlines, data can provide an edge. But what role should data play in assessing the quality of software? Where does it make sense to use data, and where is it inappropriate? Steve Rowe covers the history of how data fits into testing, explains why data is an important tool to have in your quality...

Are there any great scripted tests? Rob Sabourin shares dozens of examples of test scripts from software development projects. In this talk you will be exposed to the good, the bad, and the ugly side of test scripting. You will see some test scripts which have helped to drive profitable businesses, and other test scripts which have almost brought about corporate ruin. Rob explores the many context drivers behind testing, highlighting when and how they can help you focus on what matters. You will see many types of test scripts: smoke tests, FAST tests, business facing regression tests,...