STARWEST 2023 - Big Data, Analytics, AI/Machine Learning for Testing
Monday, October 2
Full-Stack Testing for Microservices Architectures
Software development is trending toward building systems using small, autonomous, independently deployable microservices. Leveraging microservices makes it easier to release software early, more frequently, and even continuously, which aligns well with Agile and DevOps. But how does the microservices architectural pattern affect software testing and testability? How can you ensure microservice-based applications have an adequate level of test coverage at each level? Does this paradigm change the test automation pyramid, and if so what does that look like? Join Tariq King as he walks...
Tuesday, October 3
A Quality Engineering Introduction to AI and Machine Learning
Although there are several controversies and misunderstandings surrounding AI and machine learning, one thing is apparent — people have quality concerns about the safety, reliability, and trustworthiness of these types of systems. Not only are ML-based systems shrouded in mystery due to their largely black-box nature, they also tend to be unpredictable since they can adapt and learn new things at runtime. Validating ML systems is challenging and requires a cross-section of knowledge, skills, and experience from areas such as mathematics, data science, software engineering, cyber-security,...
Prompt Engineering for Software Quality Professionals
NewWith the sudden rise of ChatGPT and large language models (LLMs), professionals have been attempting to use these types of tools to improve productivity. Building off prior momentum in AI for testing, software quality professionals are leveraging LLMs for creating tests, generating test scripts, automatically analyzing test results, and more. However, if LLM's are not fed good prompts describing the task that the AI is supposed to perform, their responses can be inaccurate and unreliable, thereby diminishing productivity gains. Join Tariq King as he teaches you how to craft high-quality AI...
Wednesday, October 4
The Rise of Generative AI: Judgment Day
It’s been over 70 years since Alan Turing defined what many still consider to be the ultimate test for a computer system—can a machine exhibit intelligent behavior that is indistinguishable from that of a human? Originally coined the imitation game, the Turing test involves having someone evaluate text conversations between a human and a machine designed to respond like a human. The machine passes the test if the evaluator cannot reliably tell the difference between the human versus machine-generated text. Although the Turing test generally serves as a starting point for discussing AI...
Riding the Hybrid Car—Our Continuous Test Automation Journey
This talk will provide a glimpse into how continuous test pipelines co-exist and integrate with strategic low code test automation tools. Multiple testing teams, each owning distinct applications, are faced with the task of testing their own product as well as the interactions and behaviors with each other. Tight schedules and the challenge of finding the right skill set can be solved with the use of low code SAAS test automation tools. In this talk, Shai Srinivasan will share some of the challenges she and her team faced—how do these tools integrate with the enterprise's testing process...
An AI-Partnered Testing Future—It’s Here!
Let’s be real, we are quite a ways out from AI taking over the world. AI doomsday apologists stay home! On the other hand, AI is changing everything about software creation. In this presentation, Kevin Pyles will take you on a walk down memory lane through waterfall, agile and DevOps practices, and will then introduce you to the future of software creation known as AI-Partnered Development. Let’s get practical with real-world examples of AI assisting designers, solving coding challenges and testing software right next to human testers. We will explore how AI is also involved today in...
How AI Like ChatGPT & Bard Will Change Testing & DevOps
AI can now generate an automation script as good as humans in seconds. It can teach you about an API or write documentation for your code. What is really going on at the forefront of building AI systems for test automation? Working at companies like test.ai and Google, Chris Navrides has explored the intricacies of building a robot to assist a manual QA team. Through large data systems, he has dealt with training machines to determine a bug versus a feature. Chris will show how to best leverage this new wave of AI to be competitive in the work force, and increase your efficiency. As well...
Building a QA Department With a New Vendor in a New Management Role
According to a recent study, only about 40% of new tech leaders receive formal training when they become a boss for the first time. The rest are forced to get scrappy to quickly equip themselves with new skills, techniques, and mindsets to effectively transition into their new roles. About seven years ago, Neeta Sonnakul elected to start at CAQH and was the only QA automation staff member, and eventually built a vast QA team and currently heads the department. The organization had taken delivery of several poor-quality software releases of our flagship product from our development partner...
Thursday, October 5
How My Testing Skills Served My Personal Life
Kristoffer Nordström faced one of the most challenging and emotional times of his life when his daughter was diagnosed with a rare and life-threatening disease. As a caregiver, father, and primary project manager, he had to learn everything he could about her illness, treatment options, and potential outcomes. The skills he acquired as a tester helped him manage this overwhelming amount of information, make sense of it, and develop a plan of action while still being a loving and ever-present parent. He asked questions, researched, and analyzed data to make informed decisions about his...
Leveraging Machine Learning to Uncover the Value of Automated Tests with Machine Learning in Test Log Analysis
In today's rapidly evolving digital landscape, companies must keep pace with the speed of development and delivery. Agile, CI, and CD practices have revolutionized the way teams approach software development, but testing must also be done at a faster and continuous rate. With thousands of tests being conducted across hundreds of runs, tracking test results can be overwhelming. That's where the power of Machine Learning comes in. This session will showcase ReportPortal.io, an open-source AI-powered test automation dashboard. Discover how Machine Learning is being used to extract valuable...
Software Test Case Selection Based on Comparative Cost and Risk-Based Value
PreviewThe testing challenge is being able to select an efficient and effective set of test cases within the limited resources available for testing. The term “efficient” refers to the realization that the number of test cases is inherently limited by the testing resources available. The term “effective” refers to the ability of the selected test cases to find code defects that exist. Mark Gillenson addressed this problem by interviewing a set of testing professionals in a corporate partner and applying qualitative research techniques to reach their conclusions. This work was conducted in...
Data Quality Engineering: Enabling Success of Data Driven Solutions
The success enabler tools supporting business organizations within an enterprise are primarily driven by the underlying AI/ML powered solutions, data & analytics platforms, and enterprise applications suite. In modern data driven economy, the dependability (quality and timeliness) of data powering these business enablers, directly influences the success or failure of the business offering and adoption. The major factors for constrained data dependability can be attributed to limiting capabilities for validation of data availability, usability, reliability, relevance, and presentability...
.jpg%3Fitok=jmeP_w0t&sc=070747eb8778cc8de775978547d32edc)
Smarter, RPA Based Testing of ERP and CRM Applications
When Sathish Rajamani asked clients what were the top challenges in managing their ERP and CRM programs, regression and automation testing was one of the top three concerns. Performing automated testing for ERP applications like Oracle Cloud or SAP S/4 HANA or Salesforce had always been a challenge across the lifecycle. This session is a demonstration of how SmartBOTS helps clients to configure and test the business process leveraging the RPA (Robotic Process Automation) based technology. UI, API Driven, unattended testing leveraging BOTS has helped in assuring the quality of the ERP and...