Agile + DevOps West 2023 - Agile Development & Testing
Wednesday, June 7
DevOps, Development Cadence, and the Product Lifecycle
In many DevOps initiatives, the DORA metrics are treated as the gold standard. When teams have good scores on deployment frequency, lead time for changes, time to recover, and change failure rate, we assume that we are on track, but this steady-state view doesn’t align with the fact that innovation and delivery are often episodic and have cadences that vary cross the product lifecycle. In this session, we’ll look at the general issue of development and delivery cadence, and explore a model based on Kent Beck’s 3X which allows us to interpret and target DORA performance in terms of the...
You Want to Test What in the Build Pipeline? How to Move Integration, E2E, and Other Large Tests Reliably into the CI/CD Pipeline
Testing automation has a reputation for being slow and unreliable, but automated tests which are not run as a part of the CI/CD pipeline are often ignored or written off when they don't pass. If nobody pays attention to the results though, automated tests are not very useful. Any tests which depend on another system will eventually break, unless special care is taken, keeping the addition of integration (or larger) tests to the build pipeline just out of reach. During this session, John Jenkins will show attendees how these larger tests can be reliably automated, so that these tests can be...
What Are Your Automation Strategies?
Everyone in your organization has probably discussed automation at least once. But who is responsible for automation? And what are the automation strategies for your organization? Several factors should be considered before jumping into automation. In this session, Lisette Zounon will share her personal experiences and cover case studies and successful quality transformation. Lisette will also cover what to consider for your automation strategies because it always depends on your organization and what you are trying to achieve. Attendee takeaways from this session include identifying your...
Thursday, June 8
Collaborating Effectively as a Tester to Anticipate Defects in Code Review
Júlio de Lima has lost count of the times he's heard people saying that he should start testing as soon as possible when working as an agile tester. However, no one told him how to do this practically. So he started thinking about how to anticipate his tests and managed to find a few ways: 1) Gather refinements and ask questions about quality risks, 2) prepare his testing strategy in advance, and 3) read the code and mentally compile the code and verify that the tests he planned would pass. Júlio can say that #1 and #2 helped him a lot, but #3 had a big impact on the software testing...
A Test Automation Workflow for Mobile Software That Actually Works
The vision is shared amongst many engineering and quality teams: we’re going to automate our testing end to end and integrate it seamlessly into our CI/CD pipeline. It sounds beautiful and efficient. And for much of your software testing infrastructure, you’re probably making it happen! Then reality hits hard as soon as you deploy the latest release of your mobile app. You don’t have control over the third-party devices or SDKs your app depends on, or the universe of operating systems users actually use. If you care about quality, and you want complete coverage for your mobile app, it isn’...
A Journey in Improving Test Pipeline Stability
Building automated tests is only the first step. The true challenge is building them with high enough reliability that they can be run as part of a deployment pipeline. But understanding how to get to that point is hard, and getting to that point often seems unsurmountable. This session will focus on exactly how Olo went from having a few hundred tests being triggered manually, to having thousands of tests running as part of a deployment pipeline. Brian Kitchener will give concrete examples of what tools were used at each step of the process, what challenges were faced, what tools needed...