STAREAST 2018 - Test Strategy, Planning, Metrics

We’ve all been there. We work incredibly hard to develop a feature and design tests based on written requirements. We build a detailed test plan that aligns the tests with the software and the documented business needs. And when we put the tests to the software, it all falls apart because the requirements were changed without informing everyone. Mary Thorn says help is at hand. Enter behavior-driven development (BDD), and Cucumber and SpecFlow, tools for running automated acceptance tests and facilitating BDD. Mary explores the nuances of Cucumber and SpecFlow, and shows you how to...

Many organizations invest a lot of effort in test automation at the system level but then have serious problems later on. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing value? This tutorial covers both “theory” and “practice”. Dot Graham explains the critical issues for getting a good start, and Chris Loder describes his experiences in getting good automation started at a number of companies. The tutorial covers the most important management issues you must address for...

Knowledge of Selenium, the industry-standard tool for testing web applications, is a much sought after skill in today’s world of test automation. If you want to learn Selenium, then this full-day tutorial provides a great start. Titus Fortner shows you how to build test automation using Selenium. But he doesn’t stop there. He uses his years of experience to show you how to build automation that is clean and easy to maintain. Titus introduces other tools that work with Selenium to help manage the data used to drive your tests, evaluate JavaScript-heavy applications, manage your test...

No longer just a futuristic concept, the Internet of Things (IoT) has a strong presence in today’s world. If your business is not prepared for it, you’re already behind. With the proliferation of connected “things”—devices, appliances, cars, and even clothing—Jennifer Bonine says that the stage is set. IoT apps are here to stay. Testing, product management, and development teams must address developing and testing in this paradigm. Testers, accustomed to traditional platforms, are now asked to test on more complex devices and more advanced platforms. Testers must keep up with the demand...

Do you have access to lots and lots of test, development, app, and service data—really big data—from client and cloud service log files, test execution results, and more? Then, you have a great opportunity to begin using data analytics and machine learning (ML) to gain new product quality insights. Bring your laptops and your sense of discovery as Ken Johnston and Eun Change introduce analysis techniques and ML tools to help you develop new and potentially groundbreaking insights. First, they present a fast-paced statistics primer for those with no prior data exploration experience and...

What Sue Uyetake calls IT Poetry—or distilled learning—is a great communications approach. A way of distilling “What Is” statements as a troubleshooting tool and a way to lighten the moment, IT Poetry has resonated with Sue and her teams. See how you can use IT Poetry to diffuse charged situations with no blame attached, get to the root cause of issues in a retrospective, or help resolve many of the little problems that crop up and can ruin your day. Join Sue as she sheds a new light on some highly charged and negative workplace situations. With examples from her own experience and those...

Advances in artificial intelligence (AI) and machine learning (ML) are leading to a new generation of software, which is becoming self-adaptive, autonomous, and smart. Academic researchers and industry practitioners are investigating how these new AI and ML technologies can be leveraged to improve software testing and testing services. A handful of testing-as-a-service (TaaS) vendors already offer services that use AI bots to perform some functional and performance testing. How well do they live up to their claims? Can they be used as an effective substitute or supplement for human testers...

The key to creating high-performing teams is psychological safety—the ability to be vulnerable in front of others even when they hold diverse viewpoints, and the opportunity to take risks and trust that everything will be OK. However, creating this safety is easier said than done. Maaret Pyhäjärvi shares her story of working with software development and test teams to enable them to be awesome. She explains how to reinforce the positive while enabling great software product development by empowering others in your team. Maaret explores how to be brave when others are not, and how to care...

Mary Thorn has had the opportunity in the past twenty years to work at many startups, creating several QA/test departments from scratch. For the past ten years, she has done this in agile software companies. Recently Mary moved from leading small agile test organizations to leading a large agile test organization where she has learned how to lead agile testers and agile testing in large contexts. Mary takes you through what she has learned, identifies the keys to transitioning your test organization as it grows, and discusses the techniques required to lead it through the changes. Agile...

It is important to know that written requirements are good, but few employ a practical, repeatable approach for “testing” their requirements. Evgeny Tkachenko says his company has introduced a requirements analysis step which is done before coding of functionality begins. Checking for requirements completeness, clearness, correctness, consistency, and testability helps ensure that developers create the right features the first time. To demonstrate this process, Evgeny presents examples of buggy requirements and plays games with participants who solve logic puzzles to practice...

As more applications are hosted on servers, they produce immense quantities of logging data. Quality engineers should verify that apps are producing log data that is existent, correct, consumable, and complete. Otherwise, apps in production are not easily monitored, have issues that are difficult to detect, and cannot be corrected quickly. Tom Chavez presents the four steps that quality engineers should include in every test plan for apps that produce log output or other machine data. First, test that the data is being created. Second, ensure that the entries are correctly formatted and...

The combination of microservice architectures and continuous delivery (CD) create a difficult scenario for integration and release testing. Even though microservices often introduce a huge number of integrations and transitive dependencies, testing still must be completed quickly to keep the pipeline flowing smoothly. Robert Williams surveys the techniques and tools available today for testing one or more microservices against a mix of real and virtualized dependencies in various stages of the CD pipeline. He explores structured testing around multiple versions of those services...

It seems almost everyday we see a product announced with a clever, new digital interface—and the rush has only just begun. From chatbots and motion sensors to facial recognition and voice integrations, these digital interfaces have a complex software side. Amir Rozenberg discusses the challenges we face now and explores a more challenging future to come for testers and testing. With concrete examples from the market, he offers new approaches for you to embed quality and test activities into the development cycle to tame the digital interface beast. With Amir, you’ll look at ways to...

In the shift toward “continuous everything” in software development and delivery, we know that testing and testers must foster and support innovation within technology. Many of us just don’t know how to gauge that shift or, more importantly, know what needs to happen within our role to make it happen. Melissa Tondi explores the future of testing, what skills we should have/develop to ensure we are prepared for that future, and the traits of a quality engineer (QE)—where she believes many tester roles are shifting. Melissa walks you through what an innovation-oriented QE organization looks...