STARWEST 2023 - Quality Assurance

When it comes to software quality, data and metrics are essential for making informed decisions. However, not all KPI metrics are created equal. In fact, many common KPI metrics can become myths that do more harm than good. In this tutorial, Lisette draws on her experience to debunk the QA KPI myths and share practical strategies for making KPI metrics great again. She will discuss how to determine the purpose of QA KPIs for your organization's needs and how to adapt KPI metrics to your organization's culture—exploring practical QA KPI metrics that bring value to everyone in the...

Web applications are often security critical or serve as front-ends for security critical applications, making web testing for vulnerabilities an essential part of software testing. Unfortunately, most software testers have not been taught how to identify web security issues while testing applications. Join Tom Stiehm as he shares what you need to know to security test web-based applications as part of your overall testing process. Learn about the most common web security vulnerabilities and how they are introduced into web code and exploited by hackers. Explore test techniques for...

API First Platforms adopt rapid application development lifecycle and high velocity deployments. Quality assurance teams are stressed to reduce the automation backlog and have a limited window to catch up with speed of deployments. This session will discuss how Venkatesh's team at Oracle adopted a creative approach to accelerate test automation by adopting an innovative “Automate First” model. The core pillar of this test architecture is creation of acceptance driven component tests leveraging virtualized services by developers. This laid a solid foundation which assured validation of...

This talk will provide a glimpse into how continuous test pipelines co-exist and integrate with strategic low code test automation tools. Multiple testing teams, each owning distinct applications, are faced with the task of testing their own product as well as the interactions and behaviors with each other. Tight schedules and the challenge of finding the right skill set can be solved with the use of low code SAAS test automation tools. In this talk, Shai Srinivasan will share some of the challenges she and her team faced—how do these tools integrate with the enterprise's testing process...

Maintaining API test cases across multiple environments, for different load levels, and types of tests (eg. smoke, functional, regression) traditionally required separate tests be written and maintained. Test maintenance is expensive. If you have three lower environments that tests are run for, then you usually have at least three different tests you are trying to keep in sync. If you have a new API added for a microservice, then you have to modify and validate across all three tests at a minimum. If you are running different load levels for build tests verses load tests, for example, that...

JavaScript code requires effective testing strategies to avoid bugs in production. Code coverage metrics alone can be misleading and don't necessarily indicate that the code is actually working as intended. It can be easy to get high code coverage metrics, but not actually test anything meaningfully. To address this problem, this session will explore the concept of JavaScript mutation testing. Mutation testing introduces small changes or "mutations" to the code and then expects tests to fail. This technique helps identify areas of the code that may need improvement and strengthens...

Does your agile team overestimate its velocity and capacity? Is the team consistently in agreement with little discussion during daily standups, iteration planning, or review meetings? Is silence perceived as acceptance? If so, collaboration may have become groupthink. Advocating for quality can be challenging for testers in this situation. Aspects of the agile team that are meant to foster collaboration including self-organization and physical insulation may also set the stage for groupthink. Groupthink is the tendency of groups to minimize conflict and reach consensus without...

Let’s face it. Building tests tends to take more time than developing new features themselves. It is tedious to build sufficient coverage and cumbersome to maintain long-term. However, on an enterprise systems-level, tests are crucial in ensuring bugs or defects are caught before they reach clients. As engineers, we pour our hearts and souls into trying to identify defects before we release our code to clients. But when rolling out big features, it is rare to successfully complete a software deployment process without some errors popping up along the way. This challenge becomes...

In many cases, it takes multiple metrics to get a complete picture of the status of a process, product, or service. A metrics dashboard accumulates a set of metrics associated with a decision. A dashboard allows the metric's customer to see, in a single collection, the relevant information. In this session, Linda Westfall will use the question, "are we done testing?" to illustrate an example of a metrics dashboard. She will also discuss each individual metric that makes up the dashboard and how they contribute information to help answer this question. These metrics will include testing...

Many times accessibility activities occur late in a project’s release when it takes longer to figure out problems and costs more to fix them. Typically all you can do at this point is patch the problems rather than fix them properly. CGI Federal approaches accessibility with an agile mindset, integrating it throughout the iterative design, user story creation, development, and testing efforts. During this session, Pavani Gonuguntla and Stephen Omojuyigbe will focus on case studies and recommended best practices from where they worked with management and cross-functional teams to get...

When Sathish Rajamani asked clients what were the top challenges in managing their ERP and CRM programs, regression and automation testing was one of the top three concerns. Performing automated testing for ERP applications like Oracle Cloud or SAP S/4 HANA or Salesforce had always been a challenge across the lifecycle. This session is a demonstration of how SmartBOTS helps clients to configure and test the business process leveraging the RPA (Robotic Process Automation) based technology. UI, API Driven, unattended testing leveraging BOTS has helped in assuring the quality of the ERP and...