Integrate On-Device Test Automation into the Dev-Release Pipeline

With the vast number of platforms and device models, testing products on mobile can be a time-consuming and costly effort. Executing test automation on actual devices is one key to achieving scale and speed. How, when, and where do we build and execute these automation scripts on real devices? Danni Wu shares the approaches she uses at Bing to automate mobile device testing. At Bing, they run mobile automated test suites across different stages of product development cycles—pre-check-in, rolling integration build, pre-ship, and production. To validate different quality aspects of products, Bing has automated functional, UI, and end-to-end testing, leveraging open source projects to build an in-house automation lab with more than 600 devices today and still adding more! Danni explores using different testing approaches (e.g., write tests or auto-exploring) against both mature and prototype products. Take away tools and ideas that make mobile test automation easier so that you get the best possible ROI out of your test efforts and ship a good quality product that makes your users very happy.