STAREAST 2018 - Test Techniques

The skill to self-manage our testing work and our learning—making learning and discovery a habit—is what differentiates skilled exploratory testing from simply putting random testing activities together. Maaret Pyhäjärvi says that exploratory testing treats test design, test execution, and learning as parallel, mutually supportive activities—with the goal of discovering things that we don’t realize we don’t know. Exploratory testing frames our thinking about the system and engulfs the idea of creating artifacts to support testing. Join Maaret to experience exploratory testing hands-on and...

Just getting started on your application programming interface (API) testing journey? Need to better understand APIs and how to effectively test them? Join Lianne Klaver for this introductory tutorial as he discusses API concepts, examples, test strategies, and techniques. Lianne describes the message architecture of REST APIs and discusses elements such as API resources, verbs, states, headers, and tokens. She shares examples and demonstrations of REST APIs in operation to give you a better understanding of how they work. Then learn by doing with exercises that enable you to recognize...

Influence diagrams provide a simple-to-create and easy-to-understand approach to address the complexities of real-life problems. As testers, we may want to find more bugs, but this may have an unintended consequence for developers. Developers now have more defects to debug, which affects their capacity to deliver new functionality. Isabel Evans has found that influence diagrams provide a way to understand and manage the complexities of key interactions among testers, developers, and business stakeholders. In the past few years, Isabel has used influence diagrams as a tool to analyze the...

Web applications are often security critical or serve as front-ends for security critical applications, making web testing for vulnerabilities an essential part of software testing. Unfortunately, most software testers have not been taught how to identify web security issues while testing applications. Join Jeffery Payne as he shares what you need to know to security test web-based applications as part of your overall testing process. Learn about the most common web security vulnerabilities and how they are introduced into web code and exploited by hackers. Explore test techniques for...

Do you have access to lots and lots of test, development, app, and service data—really big data—from client and cloud service log files, test execution results, and more? Then, you have a great opportunity to begin using data analytics and machine learning (ML) to gain new product quality insights. Bring your laptops and your sense of discovery as Ken Johnston and Eun Change introduce analysis techniques and ML tools to help you develop new and potentially groundbreaking insights. First, they present a fast-paced statistics primer for those with no prior data exploration experience and...

Have you ever worked on a project where you felt testing was thorough and complete—all features were covered and all tests passed—yet in the first week in production the software had serious issues and problems? Join Dawn Haynes to learn how to inject robustness testing into your projects to uncover those issues before release. Robustness—an important and often overlooked area of testing—is the degree to which a system operates correctly in the presence of exceptional inputs or stressful environmental conditions. Dawn shows you how—by expanding basic tests and incorporating specific...

Advances in artificial intelligence (AI) and machine learning (ML) are leading to a new generation of software, which is becoming self-adaptive, autonomous, and smart. Academic researchers and industry practitioners are investigating how these new AI and ML technologies can be leveraged to improve software testing and testing services. A handful of testing-as-a-service (TaaS) vendors already offer services that use AI bots to perform some functional and performance testing. How well do they live up to their claims? Can they be used as an effective substitute or supplement for human testers...

Selenium has been the cure for free and low-cost browser testing for years, and—in the world of agile, mobile, DevOps, and browserless interfaces—it is showing its age. Comparing Selenium to what’s coming, Jason Arbon says that machine learning and data analytics will become the new standard for test automation. With Selenium, test engineers suffer from the pains of broken element identification; broken, buggy, and partially implemented mobiletest capabilities; exploding costs of building abstraction layers on their apps; brittle test code when the application under test changes;...

Managing the quality and performance of complex systems requires more than simply executing test cases and running load tests. You need to perform careful analysis of test results and production metrics. The sheer amount of data generated in production and testing makes analysis a huge challenge that is often left wanting. With the magic of machine learning (ML) and the application of data science techniques, you have the opportunity to derive valuable and actionable information from big data. Gopal Brugalette shares the basic concepts behind ML, covering clustering, classification...

As more applications are hosted on servers, they produce immense quantities of logging data. Quality engineers should verify that apps are producing log data that is existent, correct, consumable, and complete. Otherwise, apps in production are not easily monitored, have issues that are difficult to detect, and cannot be corrected quickly. Tom Chavez presents the four steps that quality engineers should include in every test plan for apps that produce log output or other machine data. First, test that the data is being created. Second, ensure that the entries are correctly formatted and...

No question about it … software is highly complex maze, and it could take many lifetimes to manually test all the paths in a typical business app. Automation doesn’t help much because it’s not smart enough (yet) to design tests. Rob Sabourin shares his experiences testing complex application—some with more possible paths than particles of matter in the visible universe. Although programmers have applied path analysis to structural unit tests for years, path analysis has been mostly neglected in areas of end-to-end testing, workflow, process flow, usage scenarios, data flow, and system...

Since co-founding Testlio four years ago, Kristel Kruustük and her team of testers worldwide have worked with QA leaders and engineers at some of the world’s most innovative companies, including Lyft, Salesforce, Hotels.com, and Microsoft. During that time testers working with her testing-as-a-service company have identified 100,000 bugs and counting. Along the way, Kristel has learned there are five key traits and skills that make testers and test leaders great. In this eye-opening session, she talks about the tester’s mindset—curious, open, tenacious, and more—and how you can...

As technology organizations seek to automate more testing, manual software testers may feel that they have little or no role in test automation. And QA managers struggle with how to engage their manual testers on automation projects. Jeanne Schmidt provides tips on how manual testers can become the testing guides for the whole team. They can assess tests are appropriate to automate, create comprehensive and safe test data, report automated test results, and lead the automation test process strategy. Jeanne offers practical guidelines on how testers can learn test automation...

API-based applications have become ubiquitous in the past few years. Yet many of us still really don't know what an API is from the inside out. Moreover, many of us don't know much about how to comprehensively test them! Join Paul Merrill to learn what everyone is doing and talking about related to APIs: microservices, REST, endpoints, requests, request methods, and responses. Paul demonstrates four free tools you can use to directly interact with a simple API: curl, the browser, Postman, and Java (with Rest Assured). Learn techniques for testing APIs at the service level and how to test...