STAREAST Virtual+ 2020 - ML
Thursday, May 7
QA for ML: Testing around the AI Black Box
PreviewThere's been a lot of discussion around leveraging AI and machine learning (ML) for testing software, but seemingly less on how to test and provide QA for an AI- or ML-driven application. But Lauren Pehnke was faced with doing just that for a product that would combine natural language processing, computer vision, and image classification to drive ranked search results. She will outline the research on AI and ML she did before taking on this role, including basic vocabulary for the variants of AI involved and interesting AI "failures" to better inform what areas of the process would...
Testing Uncertainty for a Conversational AI
PreviewUncertainty has always been a key challenge for testers. But testing a chatbot adds a completely new level of uncertainty. There are a lot of platforms and tools available for chatbot development, but what we lack is a standardized chatbot testing strategy. The way testing is performed on chatbots differs a lot from "traditional" testing (like for an app or web portal) due to the apparent randomness of a conversation with a chatbot. From testing numerous clients' chatbots. Rajni Singh has experienced that it is impossible to anticipate all the situations that can happen during a...
A Seismic Shift in Software Testing: Rise of the Machines
PreviewEven sophisticated businesses struggle with software testing. End-to-end (E2E) testing, though vital, has remained a costly and inconsistent method of catching bugs. But there’s a light at the end of this tunnel. Advances in machine learning (ML) have increased test execution speed and stability. Now, technologies are emerging that allow machines to analyze live user traffic to produce test cases—using data to focus E2E testing on what users care about. In time, these technologies will be stitched together to allow machines to own the entire E2E testing process. This seismic shift...