STARWEST 2023 - Test Automation Engineer
Customize your STARWEST 2023 experience with sessions covering test automation for engineers.
Monday, October 2
Test Automation: How to Start and Succeed
Many organizations invest a lot of effort in test automation at the system level but then have serious problems as their product matures and changes over time. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing added value? Chris Loder will explain the critical issues you need to know to get a good start, and he will share his extensive experience in building great automation. He covers the most important management issues you should address for test automation success,...
Debunking the QA KPI Myths and Make KPI Great Again
When it comes to software quality, data and metrics are essential for making informed decisions. However, not all KPI metrics are created equal. In fact, many common KPI metrics can become myths that do more harm than good. In this tutorial, Lisette draws on her experience to debunk the QA KPI myths and share practical strategies for making KPI metrics great again. She will discuss how to determine the purpose of QA KPIs for your organization's needs and how to adapt KPI metrics to your organization's culture—exploring practical QA KPI metrics that bring value to everyone in the...
Instill a DevOps Testing Culture in Your Team and Organization
The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...
Test Design for Fully Automated Build Architecture
Imagine this…as soon as any developed functionality is submitted into the code repository, it is automatically subjected to the appropriate battery of tests and then released straight into production. Setting up the pipeline capable of doing just that is becoming more and more common and something you need to know about. But most organizations hit the same stumbling block—just what IS the appropriate battery of tests? Automated build architectures don't always lend themselves well to the traditional stages of testing. In this hands-on tutorial, Melissa Benua introduces you to key test...
Tuesday, October 3
A Quality Engineering Introduction to AI and Machine Learning
Although there are several controversies and misunderstandings surrounding AI and machine learning, one thing is apparent — people have quality concerns about the safety, reliability, and trustworthiness of these types of systems. Not only are ML-based systems shrouded in mystery due to their largely black-box nature, they also tend to be unpredictable since they can adapt and learn new things at runtime. Validating ML systems is challenging and requires a cross-section of knowledge, skills, and experience from areas such as mathematics, data science, software engineering, cyber-security,...
Web Security Testing: The Basics and More
Web applications are often security critical or serve as front-ends for security critical applications, making web testing for vulnerabilities an essential part of software testing. Unfortunately, most software testers have not been taught how to identify web security issues while testing applications. Join Tom Stiehm as he shares what you need to know to security test web-based applications as part of your overall testing process. Learn about the most common web security vulnerabilities and how they are introduced into web code and exploited by hackers. Explore test techniques for...
Integrating Automated Testing into DevOps
In many organizations, agile development processes are driving the pursuit of faster software releases, which has spawned a set of new practices—DevOps. DevOps stresses communications and integration between development and operations, including rapid deployment, continuous integration, and continuous delivery. Because DevOps practices require confidence that changes made to the code base will function as expected, automated testing is essential. Join Jeffery Payne as he discusses the unique challenges associated with integrating automated testing into continuous integration/continuous...
.jpg%3Fitok=PIWiwpDq&sc=8bd2262f52177530ca62ad8be334afca "Chris Blain")
Test Estimation in the Face of Uncertainty
Anyone who has ever attempted to estimate software testing effort realizes just how difficult the task can be. The number of factors that can affect the estimate is virtually unlimited. The keys to good estimates are understanding the primary variables, comparing them to known standards, and normalizing the estimates based on their differences. This is easy to say but difficult to accomplish because estimates are frequently required even when we know very little about the project—and what we do know is constantly changing. Throw in a healthy dose of politics and a bit of wishful thinking,...
Wednesday, October 4
Creating a Comprehensive API Testing Ecosystem
Maintaining API test cases across multiple environments, for different load levels, and types of tests (eg. smoke, functional, regression) traditionally required separate tests be written and maintained. Test maintenance is expensive. If you have three lower environments that tests are run for, then you usually have at least three different tests you are trying to keep in sync. If you have a new API added for a microservice, then you have to modify and validate across all three tests at a minimum. If you are running different load levels for build tests verses load tests, for example, that...
The Theatre of Exploratory Testing: Going Off Script
PreviewAsk a handful of testers to define exploratory testing. Some will respond that it’s simply poking around—try something, see what breaks, and then try something else. Many will identify it as an iterative process of learning and experimentation. But ask about what makes exploratory testing hard, and you find that practitioners are challenged in knowing where to start, what to test, when to stop, and how to know if they’ve found a bug. What makes for good exploratory testing? Join Philip as he examines the techniques of the actors of the Commedia dell'Arte, the 16th century approach...
Drive Down Defects With Service Virtualization & Metrics That Matter
If you can't measure your software quality, you can't manage it. Cox Automotive implemented service virtualization for their Dealertrack product development to more effectively diagnose and address issues in the application. This addition to their test automation has improved the overall quality of their product lines by significantly reducing the escaped defects. Visibility into key metrics, like escaped defects, can provide insights into potential risk areas so teams can make smart choices about what tests to run to achieve the desired code and test coverage. Join this session as Roya...
Thursday, October 5
The QA Unicorn
PreviewAs a QA Manager, Stephanie McSwain has been on the lookout several times for automation engineers with a strong background in manual testing. But as it turns out, finding someone who fits that description is pretty difficult. There are plenty of people with coding skills, and that is awesome! However, manual software testing is like an art, and someone who is great at it is an incredibly valuable asset to any team. Even though manual testing requires a very different state of mind and skillset than writing automation code, manual testers are incredibly smart—and most of them are...
A Realistic Approach to Scalable Testing for Cross-Team Distributed Systems
Let’s face it. Building tests tends to take more time than developing new features themselves. It is tedious to build sufficient coverage and cumbersome to maintain long-term. However, on an enterprise systems-level, tests are crucial in ensuring bugs or defects are caught before they reach clients. As engineers, we pour our hearts and souls into trying to identify defects before we release our code to clients. But when rolling out big features, it is rare to successfully complete a software deployment process without some errors popping up along the way. This challenge becomes...
Coded Automation Isn't Dead—A Deep Dive on the Page Object Pattern with Some Super Cool New Twists
Software Development Engineers in Test know that page objects have long been used to make test automation more resilient. This talk evolves the page object pattern in ways that provide some really strong advantages over the traditional approach. Timothy Heck will demonstrate how to make page objects isolated from the browser automation technology, making it possible to switch from Selenium to Playwright (or the next big thing) without changing the page objects. This talk will also look at how to make self-narrating automation scripts where the simple act of interacting with a page object...
Harnessing the Power of Ephemeral Environments
Integration testing in the staging environment is a pain. One bad commit from a dependency, and all your automated integration tests start failing. Consequently, developers rightly don't want to gate their code pushes on successful integration tests, and integration test results are quickly dismissed as unreliable, and ignored completely. Ephemeral environments change all of that. By using ephemeral environments as a key part of test strategies, not only has John Jenkins succeeded in moving staging dependent integration tests into the build pipeline, but he has also caught and prevented...
How Mechanical Robots Are Transforming Mobile QA Testing
New approaches in robotics are changing the way companies build and test software as it becomes increasingly device dependent. Companies like Apple, Google, and T-Mobile already rely on in-house robotics fleets to automate manual testing of mobile apps on devices. And that is just the beginning. Robots can perform all of the expected actions that a human would make on a device, including finger swiping, switching between various apps, toggling the notification center, and more. Using computer vision, a field of AI that teaches computers how to parse digital images and videos, robots can...
Pipelines and Deployments and QA! Oh My!
PreviewAs software delivery has evolved from monolithic, periodically released applications to microservices that are continuously deployed, our testing and validation practices need to evolve to support the new delivery models. An essential piece in this puzzle is the build and deployment pipelines that deliver the software to be tested and beyond. In this session, Kathleen Naughton and attendees will journey down the (yellow brick?) road to learn enough about build pipelines and deployments to ask the right questions. The questions that guide the consistent delivery of high-quality...
Data Quality Engineering: Enabling Success of Data Driven Solutions
The success enabler tools supporting business organizations within an enterprise are primarily driven by the underlying AI/ML powered solutions, data & analytics platforms, and enterprise applications suite. In modern data driven economy, the dependability (quality and timeliness) of data powering these business enablers, directly influences the success or failure of the business offering and adoption. The major factors for constrained data dependability can be attributed to limiting capabilities for validation of data availability, usability, reliability, relevance, and presentability...
How I Spend More on Coffee Than DevOps
PreviewJacob Orshalick and focus.dev solutions are a development shop that provides Continuous Delivery for every client product they build. Even so, with the cloud solutions available today, they just don’t need a DevOps team. Maybe after this session you won’t need one either. Automating your infrastructure—you need an environment where your software product can be deployed for testing. Attendees will learn how to use AWS CloudFormation with AWS Serverless Access Model (SAM) to automate the creation of their deployment environment stack. They will see how they can then make changes to...
Distributed Load Testing in Kubernetes
In an increasingly interconnected digital world, consumers of online services have become more savvy with ever-increasing expectations. The performance and scalability of these online services are critical to their success, and load testing is an important tool to evaluate these capabilities. Traditional centralized load testing needs to catch up in replicating real-world scenarios. Organizations should replicate actual user behavior by distributing simulated user traffic across multiple geographically diverse locations, enabling a more realistic evaluation of system performance and...