STARWEST 2023 - Test Automation

The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...

Let’s face it, building an automation framework is hard. That’s why there are so many commercial ones available on the market. But what if you wanted to build your own? One that you could customize to suit your needs, as opposed to you having to work within the confines of a tool or other framework. Where do you start? What does it need to have to be successful? Chris Loder will walk you through building your own automation framework based on his successful framework architecture. You will start with a basic test case runner and then build on it by adding new modules, such as UI...

Agile teams are burdened with the challenge of delivering working product increments after short iterations of development. Getting software from an ambiguous terse, incomplete requirement–to a done, working, solid, valuable, high-quality code requires testers to continuously adapt to change in a turbulent context and deliver actionable results. Chris Blain will illustrate how charter-driven session-based exploratory testing techniques can empower agile teams and help them learn quickly and adapt based on what really matters. Testers can design and execute tests on the fly as they explore...

This talk will provide a glimpse into how continuous test pipelines co-exist and integrate with strategic low code test automation tools. Multiple testing teams, each owning distinct applications, are faced with the task of testing their own product as well as the interactions and behaviors with each other. Tight schedules and the challenge of finding the right skill set can be solved with the use of low code SAAS test automation tools. In this talk, Shai Srinivasan will share some of the challenges she and her team faced—how do these tools integrate with the enterprise's testing process...

Ask a handful of testers to define exploratory testing. Some will respond that it’s simply poking around—try something, see what breaks, and then try something else. Many will identify it as an iterative process of learning and experimentation. But ask about what makes exploratory testing hard, and you find that practitioners are challenged in knowing where to start, what to test, when to stop, and how to know if they’ve found a bug. What makes for good exploratory testing? Join Philip as he examines the techniques of the actors of the Commedia dell'Arte, the 16th century approach...

AI can now generate an automation script as good as humans in seconds. It can teach you about an API or write documentation for your code. What is really going on at the forefront of building AI systems for test automation? Working at companies like test.ai and Google, Chris Navrides has explored the intricacies of building a robot to assist a manual QA team. Through large data systems, he has dealt with training machines to determine a bug versus a feature. Chris will show how to best leverage this new wave of AI to be competitive in the work force, and increase your efficiency. As well...

In today's rapidly evolving digital landscape, companies must keep pace with the speed of development and delivery. Agile, CI, and CD practices have revolutionized the way teams approach software development, but testing must also be done at a faster and continuous rate. With thousands of tests being conducted across hundreds of runs, tracking test results can be overwhelming. That's where the power of Machine Learning comes in. This session will showcase ReportPortal.io, an open-source AI-powered test automation dashboard. Discover how Machine Learning is being used to extract valuable...

Let’s face it. Building tests tends to take more time than developing new features themselves. It is tedious to build sufficient coverage and cumbersome to maintain long-term. However, on an enterprise systems-level, tests are crucial in ensuring bugs or defects are caught before they reach clients. As engineers, we pour our hearts and souls into trying to identify defects before we release our code to clients. But when rolling out big features, it is rare to successfully complete a software deployment process without some errors popping up along the way. This challenge becomes...

Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Tariq King will moderate this panel discussion to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.

Technical implementations often span across multiple companies. How can a test architect drive better results in quality and continuous integration in their own organization while working through challenging, complex, multi-company implementations? By creating a holistic test strategy, including evaluating major areas of testing early in the process, a test architect can enable not only their own organization, but all of the organizations involved in the program. Learn specific techniques at every stage including identifying commonalities in test environments, understanding implications of...

Because, bigger isn't always better. Especially nowadays. Do your teams need help accommodating those humongous load tests in your agile & continuous projects? Do you need frozen environments? Or, stop (freeze) all new changes until you can execute your colossal test? Everything to find the limits of your cloud, elastic, and distributed application? All of that struggle to repeat it because the metrics you've got became invalid with the next release? You should reframe the perspective and stop focusing on generating a few massive load tests. Why not have Chihuahua-sized load tests? You...

The success enabler tools supporting business organizations within an enterprise are primarily driven by the underlying AI/ML powered solutions, data & analytics platforms, and enterprise applications suite. In modern data driven economy, the dependability (quality and timeliness) of data powering these business enablers, directly influences the success or failure of the business offering and adoption. The major factors for constrained data dependability can be attributed to limiting capabilities for validation of data availability, usability, reliability, relevance, and presentability...

Jacob Orshalick and focus.dev solutions are a development shop that provides Continuous Delivery for every client product they build. Even so, with the cloud solutions available today, they just don’t need a DevOps team. Maybe after this session you won’t need one either. Automating your infrastructure—you need an environment where your software product can be deployed for testing. Attendees will learn how to use AWS CloudFormation with AWS Serverless Access Model (SAM) to automate the creation of their deployment environment stack. They will see how they can then make changes to...