STARWEST 2023 - Testing in DevOps
Monday, October 2
Instill a DevOps Testing Culture in Your Team and Organization
The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...
Tuesday, October 3
Getting Smart on API Testing & Automation
API testing has become more and more popular as service-oriented architectures have become common. In addition, testing at the API level can be effectively automated to provide maintainable regression tests that work well in a DevOps process. In this tutorial, Jeffery Payne discusses what API testing is all about and how it is effectively done. Techniques and tools are discussed that highlight where in the testing process API testing makes the most sense to perform. Various open source and commercial tools will be demonstrated and the pros and cons of various solutions discussed. Effective...
Integrating Automated Testing into DevOps
In many organizations, agile development processes are driving the pursuit of faster software releases, which has spawned a set of new practices—DevOps. DevOps stresses communications and integration between development and operations, including rapid deployment, continuous integration, and continuous delivery. Because DevOps practices require confidence that changes made to the code base will function as expected, automated testing is essential. Join Jeffery Payne as he discusses the unique challenges associated with integrating automated testing into continuous integration/continuous...
Wednesday, October 4
An AI-Partnered Testing Future—It’s Here!
Let’s be real, we are quite a ways out from AI taking over the world. AI doomsday apologists stay home! On the other hand, AI is changing everything about software creation. In this presentation, Kevin Pyles will take you on a walk down memory lane through waterfall, agile and DevOps practices, and will then introduce you to the future of software creation known as AI-Partnered Development. Let’s get practical with real-world examples of AI assisting designers, solving coding challenges and testing software right next to human testers. We will explore how AI is also involved today in...
Creating a Comprehensive API Testing Ecosystem
Maintaining API test cases across multiple environments, for different load levels, and types of tests (eg. smoke, functional, regression) traditionally required separate tests be written and maintained. Test maintenance is expensive. If you have three lower environments that tests are run for, then you usually have at least three different tests you are trying to keep in sync. If you have a new API added for a microservice, then you have to modify and validate across all three tests at a minimum. If you are running different load levels for build tests verses load tests, for example, that...
How AI Like ChatGPT & Bard Will Change Testing & DevOps
AI can now generate an automation script as good as humans in seconds. It can teach you about an API or write documentation for your code. What is really going on at the forefront of building AI systems for test automation? Working at companies like test.ai and Google, Chris Navrides has explored the intricacies of building a robot to assist a manual QA team. Through large data systems, he has dealt with training machines to determine a bug versus a feature. Chris will show how to best leverage this new wave of AI to be competitive in the work force, and increase your efficiency. As well...
Drive Down Defects With Service Virtualization & Metrics That Matter
If you can't measure your software quality, you can't manage it. Cox Automotive implemented service virtualization for their Dealertrack product development to more effectively diagnose and address issues in the application. This addition to their test automation has improved the overall quality of their product lines by significantly reducing the escaped defects. Visibility into key metrics, like escaped defects, can provide insights into potential risk areas so teams can make smart choices about what tests to run to achieve the desired code and test coverage. Join this session as Roya...
Thursday, October 5
How My Testing Skills Served My Personal Life
Kristoffer Nordström faced one of the most challenging and emotional times of his life when his daughter was diagnosed with a rare and life-threatening disease. As a caregiver, father, and primary project manager, he had to learn everything he could about her illness, treatment options, and potential outcomes. The skills he acquired as a tester helped him manage this overwhelming amount of information, make sense of it, and develop a plan of action while still being a loving and ever-present parent. He asked questions, researched, and analyzed data to make informed decisions about his...
Leveraging Machine Learning to Uncover the Value of Automated Tests with Machine Learning in Test Log Analysis
In today's rapidly evolving digital landscape, companies must keep pace with the speed of development and delivery. Agile, CI, and CD practices have revolutionized the way teams approach software development, but testing must also be done at a faster and continuous rate. With thousands of tests being conducted across hundreds of runs, tracking test results can be overwhelming. That's where the power of Machine Learning comes in. This session will showcase ReportPortal.io, an open-source AI-powered test automation dashboard. Discover how Machine Learning is being used to extract valuable...
AI in Testing: A Moderated Panel Discussion
Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Tariq King will moderate this panel discussion to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.
Simplify Agile Testing Using SPOCK
PreviewThis session will share how to simplify agile testing using SPOCK. If your team is being impacted by complexity in your testing, improve your design with self-contained, repeatable, and independent tests with consistent and expressive reports. Reduce cycle time and test more often. SPOCK also easily integrates with DevOps pipelines for a frictionless testing transformation. By applying these techniques, Pradynya Adwankar saw significant improvement in her development teams’ confidence in testing more often, an improved level of efficiency, and faster deployments. See how your non-...
How Building Accessibility Automated Testing in DevOps Helps Reduce Post-Deployment Overheads
#A11y, aka Accessibility is a hot topic nowadays. It is not only an important business priority for each digitally transformed company to increase user retention and sales revenue, but it also ensures that people with disabilities can use any digital product without any barriers. Many organizations started to focus on digital accessibility by investing tremendous amounts of budget in vendor or user testing post product deployment. However, quite a portion of this budget can be eliminated by educating their product teams, especially engineers to adopt accessibility automated test in their...
Pipelines and Deployments and QA! Oh My!
PreviewAs software delivery has evolved from monolithic, periodically released applications to microservices that are continuously deployed, our testing and validation practices need to evolve to support the new delivery models. An essential piece in this puzzle is the build and deployment pipelines that deliver the software to be tested and beyond. In this session, Kathleen Naughton and attendees will journey down the (yellow brick?) road to learn enough about build pipelines and deployments to ask the right questions. The questions that guide the consistent delivery of high-quality...
How I Spend More on Coffee Than DevOps
PreviewJacob Orshalick and focus.dev solutions are a development shop that provides Continuous Delivery for every client product they build. Even so, with the cloud solutions available today, they just don’t need a DevOps team. Maybe after this session you won’t need one either. Automating your infrastructure—you need an environment where your software product can be deployed for testing. Attendees will learn how to use AWS CloudFormation with AWS Serverless Access Model (SAM) to automate the creation of their deployment environment stack. They will see how they can then make changes to...
Distributed Load Testing in Kubernetes
In an increasingly interconnected digital world, consumers of online services have become more savvy with ever-increasing expectations. The performance and scalability of these online services are critical to their success, and load testing is an important tool to evaluate these capabilities. Traditional centralized load testing needs to catch up in replicating real-world scenarios. Organizations should replicate actual user behavior by distributing simulated user traffic across multiple geographically diverse locations, enabling a more realistic evaluation of system performance and...