STARWEST 2023 - Agile Testing
Monday, October 2
Debunking the QA KPI Myths and Make KPI Great Again
When it comes to software quality, data and metrics are essential for making informed decisions. However, not all KPI metrics are created equal. In fact, many common KPI metrics can become myths that do more harm than good. In this tutorial, Lisette draws on her experience to debunk the QA KPI myths and share practical strategies for making KPI metrics great again. She will discuss how to determine the purpose of QA KPIs for your organization's needs and how to adapt KPI metrics to your organization's culture—exploring practical QA KPI metrics that bring value to everyone in the...
Automation Framework Essentials
Automation is critical in today’s software delivery lifecycle, and yet many organizations struggle to keep their automation running. How can we mitigate difficulties and get consistent automation runs and results we can trust? The secret is implementing a solid automation framework, but that isn’t as easy as it seems. Chris Loder has built several automation frameworks over his career and has learned what works—and, more importantly, what doesn’t. This tutorial will cover what an automation framework is, the benefits of having one, and the keys to a successful framework, including...
Tuesday, October 3
Quality and Testing Measures and Metrics
To be most effective, leaders—including development and testing managers, ScrumMasters, product owners, and IT managers—need metrics to help direct their efforts and make informed recommendations about the software’s release readiness and associated risks. Because one important evaluation activity is to “measure” the quality of the software, the progress and results of both development and testing must be measured. Collecting, analyzing, and using metrics are complicated because developers and testers often are concerned that the metrics will be used against them. Join Jeff Pierce as he...
.jpg%3Fitok=PIWiwpDq&sc=8bd2262f52177530ca62ad8be334afca "Chris Blain")
Exploratory Testing in the Heat of the Sprint
Agile teams are burdened with the challenge of delivering working product increments after short iterations of development. Getting software from an ambiguous terse, incomplete requirement–to a done, working, solid, valuable, high-quality code requires testers to continuously adapt to change in a turbulent context and deliver actionable results. Chris Blain will illustrate how charter-driven session-based exploratory testing techniques can empower agile teams and help them learn quickly and adapt based on what really matters. Testers can design and execute tests on the fly as they explore...
Wednesday, October 4
Test Architecture for API First Platforms
API First Platforms adopt rapid application development lifecycle and high velocity deployments. Quality assurance teams are stressed to reduce the automation backlog and have a limited window to catch up with speed of deployments. This session will discuss how Venkatesh's team at Oracle adopted a creative approach to accelerate test automation by adopting an innovative “Automate First” model. The core pillar of this test architecture is creation of acceptance driven component tests leveraging virtualized services by developers. This laid a solid foundation which assured validation of...
Exploratory Testing As Code
What if testing followed the lead of revolutions in infrastructure and configuration management. What if testers treated exploratory testing like developers do code? Exploratory testing is a powerful and effective technique. However, its acceptance is inhibited because there isn’t a common structured process that enables the traceability and transparency to make it a standard across the software industry. In this session, Brendan Connolly will introduce the tooling and process needed to implement a light-weight, scalable, transparent, and traceable approach to managing exploratory testing...
Riding the Hybrid Car—Our Continuous Test Automation Journey
This talk will provide a glimpse into how continuous test pipelines co-exist and integrate with strategic low code test automation tools. Multiple testing teams, each owning distinct applications, are faced with the task of testing their own product as well as the interactions and behaviors with each other. Tight schedules and the challenge of finding the right skill set can be solved with the use of low code SAAS test automation tools. In this talk, Shai Srinivasan will share some of the challenges she and her team faced—how do these tools integrate with the enterprise's testing process...
Leave It Better Than You Found It: The Key to Foster and Mature Culture of Quality in Your Organization and Win Customers' Trust
Quality engineering and assurance is not merely testing and test automation. The ultimate goal is to enable product engineering teams to continuously deliver high-quality, reliable, and secure products and services to win customers' trust and bring them joy. Successful organizations have a strong quality culture where everyone, from new hires to senior executives, collectively work to build in quality. Building and maintaining a culture of quality requires explicit intent, incentives, and enablement throughout the organization. How do we create a culture of quality and mature it year after...
How AI Like ChatGPT & Bard Will Change Testing & DevOps
AI can now generate an automation script as good as humans in seconds. It can teach you about an API or write documentation for your code. What is really going on at the forefront of building AI systems for test automation? Working at companies like test.ai and Google, Chris Navrides has explored the intricacies of building a robot to assist a manual QA team. Through large data systems, he has dealt with training machines to determine a bug versus a feature. Chris will show how to best leverage this new wave of AI to be competitive in the work force, and increase your efficiency. As well...
Advocating Quality When Collaboration Becomes Groupthink
PreviewDoes your agile team overestimate its velocity and capacity? Is the team consistently in agreement with little discussion during daily standups, iteration planning, or review meetings? Is silence perceived as acceptance? If so, collaboration may have become groupthink. Advocating for quality can be challenging for testers in this situation. Aspects of the agile team that are meant to foster collaboration including self-organization and physical insulation may also set the stage for groupthink. Groupthink is the tendency of groups to minimize conflict and reach consensus without...
Thursday, October 5
How My Testing Skills Served My Personal Life
Kristoffer Nordström faced one of the most challenging and emotional times of his life when his daughter was diagnosed with a rare and life-threatening disease. As a caregiver, father, and primary project manager, he had to learn everything he could about her illness, treatment options, and potential outcomes. The skills he acquired as a tester helped him manage this overwhelming amount of information, make sense of it, and develop a plan of action while still being a loving and ever-present parent. He asked questions, researched, and analyzed data to make informed decisions about his...
AI in Testing: A Moderated Panel Discussion
Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Tariq King will moderate this panel discussion to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.
Simplify Agile Testing Using SPOCK
PreviewThis session will share how to simplify agile testing using SPOCK. If your team is being impacted by complexity in your testing, improve your design with self-contained, repeatable, and independent tests with consistent and expressive reports. Reduce cycle time and test more often. SPOCK also easily integrates with DevOps pipelines for a frictionless testing transformation. By applying these techniques, Pradynya Adwankar saw significant improvement in her development teams’ confidence in testing more often, an improved level of efficiency, and faster deployments. See how your non-...
How Building Accessibility Automated Testing in DevOps Helps Reduce Post-Deployment Overheads
#A11y, aka Accessibility is a hot topic nowadays. It is not only an important business priority for each digitally transformed company to increase user retention and sales revenue, but it also ensures that people with disabilities can use any digital product without any barriers. Many organizations started to focus on digital accessibility by investing tremendous amounts of budget in vendor or user testing post product deployment. However, quite a portion of this budget can be eliminated by educating their product teams, especially engineers to adopt accessibility automated test in their...
Software Test Case Selection Based on Comparative Cost and Risk-Based Value
PreviewThe testing challenge is being able to select an efficient and effective set of test cases within the limited resources available for testing. The term “efficient” refers to the realization that the number of test cases is inherently limited by the testing resources available. The term “effective” refers to the ability of the selected test cases to find code defects that exist. Mark Gillenson addressed this problem by interviewing a set of testing professionals in a corporate partner and applying qualitative research techniques to reach their conclusions. This work was conducted in...
Pipelines and Deployments and QA! Oh My!
PreviewAs software delivery has evolved from monolithic, periodically released applications to microservices that are continuously deployed, our testing and validation practices need to evolve to support the new delivery models. An essential piece in this puzzle is the build and deployment pipelines that deliver the software to be tested and beyond. In this session, Kathleen Naughton and attendees will journey down the (yellow brick?) road to learn enough about build pipelines and deployments to ask the right questions. The questions that guide the consistent delivery of high-quality...
.jpg%3Fitok=9eHfoyqL&sc=6bd7bfcc70d52e9c342e7bc3c859554b)
Integrating Accessibility into Agile
PreviewMany times accessibility activities occur late in a project’s release when it takes longer to figure out problems and costs more to fix them. Typically all you can do at this point is patch the problems rather than fix them properly. CGI Federal approaches accessibility with an agile mindset, integrating it throughout the iterative design, user story creation, development, and testing efforts. During this session, Pavani Gonuguntla and Stephen Omojuyigbe will focus on case studies and recommended best practices from where they worked with management and cross-functional teams to get...
Inconceivable! How the Princess Bride Teaches Planning
PreviewOne of the most fantastic cult classics ever, the Princess Bride has many wonderful lessons to teach such as ‘never get involved in a land war in Asia’ and never lie to someone about the danger you know exists, or it might come and bite you on the shoulder. It also teaches a great lesson about planning by showing us a bad example and then a good example. The only difference in personnel is the leader. Planning is more of an art than a science. “Woo, hoo-hoo! Look who knows so much!” Mark Minson will contrast Vencini’s and Wesley’s plans, explaining why one failed and one succeeded...
How I Spend More on Coffee Than DevOps
PreviewJacob Orshalick and focus.dev solutions are a development shop that provides Continuous Delivery for every client product they build. Even so, with the cloud solutions available today, they just don’t need a DevOps team. Maybe after this session you won’t need one either. Automating your infrastructure—you need an environment where your software product can be deployed for testing. Attendees will learn how to use AWS CloudFormation with AWS Serverless Access Model (SAM) to automate the creation of their deployment environment stack. They will see how they can then make changes to...