STARWEST 2023 - Software Tester

Many organizations invest a lot of effort in test automation at the system level but then have serious problems as their product matures and changes over time. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing added value? Chris Loder will explain the critical issues you need to know to get a good start, and he will share his extensive experience in building great automation. He covers the most important management issues you should address for test automation success,...

Automation is critical in today’s software delivery lifecycle, and yet many organizations struggle to keep their automation running. How can we mitigate difficulties and get consistent automation runs and results we can trust? The secret is implementing a solid automation framework, but that isn’t as easy as it seems. Chris Loder has built several automation frameworks over his career and has learned what works—and, more importantly, what doesn’t. This tutorial will cover what an automation framework is, the benefits of having one, and the keys to a successful framework, including...

To be most effective, leaders—including development and testing managers, ScrumMasters, product owners, and IT managers—need metrics to help direct their efforts and make informed recommendations about the software’s release readiness and associated risks. Because one important evaluation activity is to “measure” the quality of the software, the progress and results of both development and testing must be measured. Collecting, analyzing, and using metrics are complicated because developers and testers often are concerned that the metrics will be used against them. Join Jeff Pierce as he...

In many organizations, agile development processes are driving the pursuit of faster software releases, which has spawned a set of new practices—DevOps. DevOps stresses communications and integration between development and operations, including rapid deployment, continuous integration, and continuous delivery. Because DevOps practices require confidence that changes made to the code base will function as expected, automated testing is essential. Join Jeffery Payne as he discusses the unique challenges associated with integrating automated testing into continuous integration/continuous...

This talk will provide a glimpse into how continuous test pipelines co-exist and integrate with strategic low code test automation tools. Multiple testing teams, each owning distinct applications, are faced with the task of testing their own product as well as the interactions and behaviors with each other. Tight schedules and the challenge of finding the right skill set can be solved with the use of low code SAAS test automation tools. In this talk, Shai Srinivasan will share some of the challenges she and her team faced—how do these tools integrate with the enterprise's testing process...

Maintaining API test cases across multiple environments, for different load levels, and types of tests (eg. smoke, functional, regression) traditionally required separate tests be written and maintained. Test maintenance is expensive. If you have three lower environments that tests are run for, then you usually have at least three different tests you are trying to keep in sync. If you have a new API added for a microservice, then you have to modify and validate across all three tests at a minimum. If you are running different load levels for build tests verses load tests, for example, that...

JavaScript code requires effective testing strategies to avoid bugs in production. Code coverage metrics alone can be misleading and don't necessarily indicate that the code is actually working as intended. It can be easy to get high code coverage metrics, but not actually test anything meaningfully. To address this problem, this session will explore the concept of JavaScript mutation testing. Mutation testing introduces small changes or "mutations" to the code and then expects tests to fail. This technique helps identify areas of the code that may need improvement and strengthens...

If you can't measure your software quality, you can't manage it. Cox Automotive implemented service virtualization for their Dealertrack product development to more effectively diagnose and address issues in the application. This addition to their test automation has improved the overall quality of their product lines by significantly reducing the escaped defects. Visibility into key metrics, like escaped defects, can provide insights into potential risk areas so teams can make smart choices about what tests to run to achieve the desired code and test coverage. Join this session as Roya...

Software Development Engineers in Test know that page objects have long been used to make test automation more resilient. This talk evolves the page object pattern in ways that provide some really strong advantages over the traditional approach. Timothy Heck will demonstrate how to make page objects isolated from the browser automation technology, making it possible to switch from Selenium to Playwright (or the next big thing) without changing the page objects. This talk will also look at how to make self-narrating automation scripts where the simple act of interacting with a page object...

In many cases, it takes multiple metrics to get a complete picture of the status of a process, product, or service. A metrics dashboard accumulates a set of metrics associated with a decision. A dashboard allows the metric's customer to see, in a single collection, the relevant information. In this session, Linda Westfall will use the question, "are we done testing?" to illustrate an example of a metrics dashboard. She will also discuss each individual metric that makes up the dashboard and how they contribute information to help answer this question. These metrics will include testing...

The success enabler tools supporting business organizations within an enterprise are primarily driven by the underlying AI/ML powered solutions, data & analytics platforms, and enterprise applications suite. In modern data driven economy, the dependability (quality and timeliness) of data powering these business enablers, directly influences the success or failure of the business offering and adoption. The major factors for constrained data dependability can be attributed to limiting capabilities for validation of data availability, usability, reliability, relevance, and presentability...