STAREAST 2023 - Test Automation
Monday, May 1
Test Automation: How to Start and Succeed
Many organizations invest a lot of effort in test automation at the system level but then have serious problems as their product matures and changes over time. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing added value? Chris Loder will explain the critical issues you need to know to get a good start, and he will share his extensive experience in building great automation. He covers the most important management issues you should address for test automation success,...
Test Design for Fully Automated Build Architecture
Imagine this…as soon as any developed functionality is submitted into the code repository, it is automatically subjected to the appropriate battery of tests and then released straight into production. Setting up the pipeline capable of doing just that is becoming more and more common and something you need to know about. But most organizations hit the same stumbling block—just what IS the appropriate battery of tests? Automated build architectures don't always lend themselves well to the traditional stages of testing. In this hands-on tutorial, Melissa Benua introduces you to key test...
Instill a DevOps Testing Culture in Your Team and Organization
The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...
Tuesday, May 2
Web Security Testing: The Basics and More
Web applications are often security critical or serve as front-ends for security critical applications, making web testing for vulnerabilities an essential part of software testing. Unfortunately, most software testers have not been taught how to identify web security issues while testing applications. Join Tom Stiehm as he shares what you need to know to security test web-based applications as part of your overall testing process. Learn about the most common web security vulnerabilities and how they are introduced into web code and exploited by hackers. Explore test techniques for...
Integrating Automated Testing into DevOps
In many organizations, agile development processes are driving the pursuit of faster software releases, which has spawned a set of new practices—DevOps. DevOps stresses communications and integration between development and operations, including rapid deployment, continuous integration, and continuous delivery. Because DevOps practices require confidence that changes made to the code base will function as expected, automated testing is essential. Join Jeffery Payne as he discusses the unique challenges associated with integrating automated testing into continuous integration/continuous...
Wednesday, May 3
RIP UI Test Automation. You Failed. CX Observability Will Lead Us to Software Quality
Despite the massive efforts around testing phases, pyramids, vegetables, periodic table, etc., users keep finding bugs, which leads to poor CX. Testing is an activity; quality is the goal. We’ve been focused on making the activity better, but that didn’t improve quality. In this session, Alex Martins will discuss his best efforts and experiences around testing and never being able to achieve the dream of software quality. Alex has been on projects that spent more money on testing than on development, and still didn’t catch all bugs. He's thrown AI/ML into my testing lifecycle and still...
Introduction to Test Orchestration
PreviewThis session will be an introduction to test orchestration: the process, execution, and monitoring of automated tests to drive the quality of your product. It's easy to fall into the trap of thinking that will save us, but being successful at test automation often requires making changes to more than just how the tests are executed. We also need to consider our process/workflow around software testing. What's our branching strategy? When and where do we deploy? Who reviews the failed tests? And in addition to evaluating our process/workflow around testing, we also need to consider...
Data Science and System Testing: Lessons Learned from a Four-Part Workshop Series
During fall 2022, Big Data Florida ran a series of four workshops on the intersection of data science and system testing. The first was on “Testing Big Data Systems,” which provided the basis for subsequent meetings. The second event was on “Testing Machine Learning (ML) Models,” the third was on “Testing Artificial Intelligence (AI) Applications,” and the fourth was on “Leveraging AI and ML in Testing.” Participants were an interdisciplinary group drawn from data science, testing (hardware, software, and integrated systems), and interested researchers and professionals. This session...
Integration of A11y Audits into Test Automation
A11y audits have been one of the essential disciplines of software quality assurance for years. For some time now, these accessibility audits can be performed easily by any end user in the browser (e.g., Google Lighthouse, axe add-on for Firefox, etc.). These checks can be integrated easily into an existing selenium test automation. This session will speak to the pitfalls when doing automatic audits and why they happen. This session will also showcase how these audits can be integrated into an existing test framework using Selenium. Attendees will discover a concrete solution with code...
Testing & Release Strategy for Native Android & iOS Apps
Experimentation and quick feedback are the keys to success of any product, while also ensuring a good quality product with new and better features is being shipped out at a decent/regular frequency to the users. In this session, we will discuss how to enable experimentation, get quick feedback, and reduce risk. We will also discuss testing strategy and the release process on Android & iOS Native apps that will help enable CI/CD. Finally, this session will focus on the below techniques/practices related to testing & releases: * Functional automation approach - identify and automate...
Tactics for Testing DevOps Infrastructure Code
With the cloud, infrastructure such as networking, security, virtual machines, and much more is entirely software code. Instead of manually creating cloud environments for applications and making changes, administrators write code to do that work. When changes are needed, that code is enhanced and re-run. Just like application code, infrastructure code needs to be tested. After all, code that introduces defects into existing environments can put developers, testers, and even end-users out of service. That said, most organizations do not adequately test infrastructure code. Anybody in this...
Thursday, May 4
Feature Flags - The Good, The Bad, and How to Prevent The Ugly
PreviewMore and more companies are using feature flags to get all types of changes – new features, configuration changes, bug fixes, and experiments – into production in a safer, faster, and most importantly, a sustainable way. Software companies that shift to deploying with feature flags benefit from low risk releases, faster time to market, higher quality, and in general happier teams. Sounds great, right? But what happens when your system isn’t implemented correctly, or worse, tested properly? This session will take attendees on a journey of why teams use Progressive Delivery, and the...
Testing Hard-to-Test Devices Using Docker Containers
Back in the day, live testing was the only way to test systems, especially software and hardware, and the advanced methodologies that we have today did not exist. Today, docker containers have made even the most difficult systems very easy to test. In this session, we will take a look at an example of testing a disk monitoring service using software techniques without actually using any disks. The service reports NVMe SSD drives’ state and classifies drives as “good” or “bad” based on the data. Key takeaways from this session include understanding the basics of NVMe and docker, creating a...
AI in Testing: A Moderated Panel Discussion
Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Tariq King will moderate this panel discussion to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.
Comprehensive API Testing Ecosystem
Maintaining API test cases across multiple environments, for different load levels, and types of tests (eg. smoke, functional, regression) traditionally required separate tests be written and maintained. Test maintenance is expensive. If you have three lower environments that tests are run for, then you usually have at least three different tests you are trying to keep in sync. If you have a new API added for a microservice, then you have to modify and validate across all three tests at a minimum. If you are running different load levels for build tests verses load tests, for example, that...
Successfully Converting Manual Test Teams into Test Automation Engineers
The need to convert manual test teams into test automation engineers is in large demand in many companies. This request is most prevalent in organizations using Agile Scrum that have short sprint cycles. In implementing solutions to this demand, Andy Sidney has found two effective strategies that have worked at two different companies in the past five years. In both situations the strategies were challenged by the Scrum teams and the QA teams because it would slightly modify the Scrum process, and initially increase the workload for the QA testers until the learning curve diminished. Once...
Building an API Automation Framework Using Cypress
In this session, Greg Patterson will share his experience starting on a new team that was directed to use Cypress for automation, and API automation was also a requirement. Cypress has the ability to support both of these needs, but it is something that takes a little work. After some short training sessions, Greg was able to help all of his team to contribute to the automation efforts by creating a simple framework that could be used for both UI and API automation. Greg will share his experience with integrating the frameworks into Azure DevOps to run tests in the cloud. Key features to...
Meet GitHub Advanced Security
PreviewFind and fix security vulnerabilities before code hits the main branch in your repo. GitHub Advanced Security (GHAS) helps teams secure their software supply chain and proprietary code with the only community-driven, native application security testing solution. GHAS is built to optimize the developer experience through automation. Identify and fix reported security issues quickly and efficiently by integrating security testing into every step of the developer workflow. GHAS components: - Code scanning: Find and fix security issues in your code before they reach production with...
Automated CSV Data Comparison & Advanced Field-Level Validation Utility
PreviewTo satisfy the validation requirements and ensure processed data accuracy, QA Test Engineers within an organization often face the challenge of completing major regression tasks that require detailed comparison of multiple pairs of CSV files. These files can be very large at times (thousands of rows & hundreds of columns per file). Testers also need to detect the presence of any duplicate records within those files along with the deltas (extra or missing records on both sides of the CSV pairs). Beyond those challenges the automation utility needed has to be reusable &...