STARWEST 2017 Tutorial: Test Design for Fully Automated Build Architectures

Conference archive


Tuesday, October 3, 2017 - 8:30am to 12:00pm

Test Design for Fully Automated Build Architectures

Add to calendar

Imagine this … As soon as any developed functionality is submitted into the code repository, it is automatically subjected to the appropriate battery of tests and then released straight into production. Well, setting up the pipeline capable of doing just that is becoming more and more common. But most organizations hit the same stumbling block—just what IS the appropriate battery of tests? Automated build architectures don't always lend themselves well to the traditional stages of testing. In this hands-on tutorial, Melissa Benua introduces you to key test design principles—applicable to organizations both large and small—that allow them to take full advantage of the pipeline's capabilities without introducing unnecessary bottlenecks. Learn how to make highly reliable tests that run fast and preserve just enough information to let testers and developers determine exactly what went wrong and how to reproduce the error locally. Explore ways to reduce overlap while still maintaining adequate test coverage. Take back ideas about which test areas could benefit from being combined into a single suite and which areas could benefit most from being broken out altogether.


Melissa Benua has worked in nearly every software development role—dev, test, DevOps, and program management—at companies big and small. She's created and run high-availability, high-quality services on products such as mParticle, PlayFab, Bing, Cortana, and Xbox One. Melissa discovered her love of massively-scaled systems while growing the Bing backend, where she honed the art of keeping highly-available complex systems up while undergoing massive code churn. Melissa isn’t afraid to mix traditional approaches with bold new ideas to make her products better, faster, and more reliable. She’s passionate not only about maximizing efficiency both in her product code and in her developer tools but also about sharing best practices among colleagues and the tech world at large.