STARWEST 2023 - Test Management

When it comes to software quality, data and metrics are essential for making informed decisions. However, not all KPI metrics are created equal. In fact, many common KPI metrics can become myths that do more harm than good. In this tutorial, Lisette draws on her experience to debunk the QA KPI myths and share practical strategies for making KPI metrics great again. She will discuss how to determine the purpose of QA KPIs for your organization's needs and how to adapt KPI metrics to your organization's culture—exploring practical QA KPI metrics that bring value to everyone in the...

Automation is critical in today’s software delivery lifecycle, and yet many organizations struggle to keep their automation running. How can we mitigate difficulties and get consistent automation runs and results we can trust? The secret is implementing a solid automation framework, but that isn’t as easy as it seems. Chris Loder has built several automation frameworks over his career and has learned what works—and, more importantly, what doesn’t. This tutorial will cover what an automation framework is, the benefits of having one, and the keys to a successful framework, including...

Web applications are often security critical or serve as front-ends for security critical applications, making web testing for vulnerabilities an essential part of software testing. Unfortunately, most software testers have not been taught how to identify web security issues while testing applications. Join Tom Stiehm as he shares what you need to know to security test web-based applications as part of your overall testing process. Learn about the most common web security vulnerabilities and how they are introduced into web code and exploited by hackers. Explore test techniques for...

With the advent of frameworks like Angular, React, and Vue, the landscape of application performance has changed significantly in terms of testing and measurement. Gone are the days of measuring response time as a single value based on back-end performance. In modern web and mobile applications, additional layers need to be peeled apart at the front end to truly understand its performance characteristics. Traditional approaches to performance testing are no longer sufficient to provide a delightfully responsive user experience. Join Kaushal Dalvi as he details new developments in the...

API First Platforms adopt rapid application development lifecycle and high velocity deployments. Quality assurance teams are stressed to reduce the automation backlog and have a limited window to catch up with speed of deployments. This session will discuss how Venkatesh's team at Oracle adopted a creative approach to accelerate test automation by adopting an innovative “Automate First” model. The core pillar of this test architecture is creation of acceptance driven component tests leveraging virtualized services by developers. This laid a solid foundation which assured validation of...

This talk will provide a glimpse into how continuous test pipelines co-exist and integrate with strategic low code test automation tools. Multiple testing teams, each owning distinct applications, are faced with the task of testing their own product as well as the interactions and behaviors with each other. Tight schedules and the challenge of finding the right skill set can be solved with the use of low code SAAS test automation tools. In this talk, Shai Srinivasan will share some of the challenges she and her team faced—how do these tools integrate with the enterprise's testing process...

Ask a handful of testers to define exploratory testing. Some will respond that it’s simply poking around—try something, see what breaks, and then try something else. Many will identify it as an iterative process of learning and experimentation. But ask about what makes exploratory testing hard, and you find that practitioners are challenged in knowing where to start, what to test, when to stop, and how to know if they’ve found a bug. What makes for good exploratory testing? Join Philip as he examines the techniques of the actors of the Commedia dell'Arte, the 16th century approach...

According to a recent study, only about 40% of new tech leaders receive formal training when they become a boss for the first time. The rest are forced to get scrappy to quickly equip themselves with new skills, techniques, and mindsets to effectively transition into their new roles. About seven years ago, Neeta Sonnakul elected to start at CAQH and was the only QA automation staff member, and eventually built a vast QA team and currently heads the department. The organization had taken delivery of several poor-quality software releases of our flagship product from our development partner...

In this exhaustive testing world, it can be daunting to measure multiple metrics to achieve the end goal of higher product quality. Measuring metrics can quickly become a daunting task that can pose several challenges on the time and efficiency front. What are these two simple metrics that can get you to your finish line? How can teams use these metrics to bring about a process change to set high quality standards? In this session, attendees will take away simple, but effective, ideas that can help their teams to clearly define their product quality goals, and attach a quantifiable...

Technical implementations often span across multiple companies. How can a test architect drive better results in quality and continuous integration in their own organization while working through challenging, complex, multi-company implementations? By creating a holistic test strategy, including evaluating major areas of testing early in the process, a test architect can enable not only their own organization, but all of the organizations involved in the program. Learn specific techniques at every stage including identifying commonalities in test environments, understanding implications of...

#A11y, aka Accessibility is a hot topic nowadays. It is not only an important business priority for each digitally transformed company to increase user retention and sales revenue, but it also ensures that people with disabilities can use any digital product without any barriers. Many organizations started to focus on digital accessibility by investing tremendous amounts of budget in vendor or user testing post product deployment. However, quite a portion of this budget can be eliminated by educating their product teams, especially engineers to adopt accessibility automated test in their...

New approaches in robotics are changing the way companies build and test software as it becomes increasingly device dependent. Companies like Apple, Google, and T-Mobile already rely on in-house robotics fleets to automate manual testing of mobile apps on devices. And that is just the beginning. Robots can perform all of the expected actions that a human would make on a device, including finger swiping, switching between various apps, toggling the notification center, and more. Using computer vision, a field of AI that teaches computers how to parse digital images and videos, robots can...