STARWEST 2017 Concurrent Session : What to Do—Develop Your Own Automation or Use Crowdsourced Testing?

Conference archive


Wednesday, October 4, 2017 - 1:45pm to 2:45pm

What to Do—Develop Your Own Automation or Use Crowdsourced Testing?

Add to calendar

Modern software products tend to have a rich UI that supports many user workflows, all of which need to be covered in testing. Agile organizations quickly discover that manual end-to-end testing neither supports their velocity nor provides respectable regression coverage. A common progression is to move from fully manual testing to record/replay, then to Selenium IDE style tests, then to automation based on Selenium WebDriver, perhaps with a BDD overlay. Daria Mehra has practiced this approach and shares her experience. She compares the Selenium style of automation to an alternative—crowdsourced test execution— which provides all the benefits of test automation, including continuous integration. This approach allows non-coders to express test cases in natural language, avoids the dependency on UI implementation, adds a “human eye” advantage, and provides the ability to massively parallelize tests for fast execution. Learn the pros and cons of end-to-end, UI-based test automation via Selenium compared to crowdsourcing. Find out how you can assess the suitability of these testing approaches for your needs.

Daria Mehra
Quid, Inc.

Daria Mehra has been a bug huntress in the SF Bay Area since the roaring 2000s. Her software development background in distributed systems prepared her for the challenges of testing SaaS and appliance products in data storage space and, more recently, web-based data analytics. As a director of quality engineering, Daria built two QE teams from scratch—once at a startup that open sourced the new analytics programming language Juttle and now at Quid, Inc., a data intelligence platform. Daria is excited to experiment with novel testing approaches for data science and data quality, including crowdsourced test execution. A proud recipient of the “Best QA Team” award at Testathon 2014, Daria now runs Tester's Digest, a QA newsletter.