STARWEST 2022 - Concurrent Sessions

More companies are building ML and AI systems and applications, but they lack the same rigorous testing because many Testers don't know how to approach testing them. After having built and tested many different ML models and systems and talking to ML teams of small and large organizations, one thing always stands out: "We need better testing and automation in our MLOps lifecycle." So, we'll start by demystifying Machine Learning by breaking down a Prediction application so the audience better understands the "magic algorithms" behind the scenes. We'll explore an example of ML systems that...

Problem Statement: Current cross browser/device platforms are not built to handle the real scalability that software development design patterns require, in a cost-efficient way.

Most or all cross-browser platforms offer their services based on the number of parallel connections. The more connections you need, the more expensive it gets. Here you must choose quality vs cost. With the current providers, without spending in millions, you would not be able to implement shift left with full scalability. This is because the current platforms are not aligned to the best practices of CI CD...

What do you think about when you hear the words "test automation"? Are you considering developing your own tools to help you probe the product deeply, or will you apply a commercial tool for automated checking? Are you excited by new, powerful, enabling technologies, or do you worry that a robot will replace you? One thing is for sure: when we apply tools, we fundamentally change the context and the nature of the work we do.

Our panelists are software testing experts who will discuss all this and more with you! Together, we'll probe what people mean by automation, the power that...

We all know that Artificial Intelligence is here and here to stay. Most teams are wondering how to leverage AI for their automation. In this session, I will cover a case study on how to successfully leverage Artificial Intelligence in your automation strategies. Attendees in this session will take away a few key points. First, how to determine if your automation strategy can leverage AI tool, discuss the learning curve and mindset shift necessary for your QA team to embrace AI Tool, and discuss success case study of using AI tool as part of automation testing. Then, how to leverage AI...

Robotic Process Automation (RPA) is a term given to technology that allows developers to programmatically emulate the actions of a human to execute a business process. RPA often operates on the user interface (UI) layer to capture data or interact with an application or across multiple applications to perform tasks that are considered repetitive or time-consuming. Originally focused on business processes, many RPA solutions now integrate with SDLC tools. While the promises of easy adoption and scaling are made by almost every vendor, the reality is long-term commitment to an RPA program is...

Do you have a fully manual testing environment and want to move to automation but not sure how? Follow the journey of a heavy manual testing organization that capitalized on the strong manual testing skills of their employees, expanding their skill sets and helping to move the careers forward for the entire organization. Shay Hibler, Daniel Jiregna, Latha Vatti, and Cheryl Raya will take you on that journey of how our organization took on that task with tool evaluation to find the best tool to fit our needs, how doing selective talent acquisition moved our test automation forward at an...

You may have heard that software ate the world and AI is eating software. However, if you’ve been paying attention, then you’ve probably realized that the world is filled with bad software. Many organizations struggle with meeting their quality goals and keeping testing-related costs contained. Software is indeed revolutionizing the world, but the world is also paying a revolutionary price for bad software. So where do AI and machine learning (ML) fit in? Are AI/ML breakthroughs just new ways of filling the world with bad software? Or do they offer a path towards better software?

...

Traditionally, test automation was implemented with frameworks that require a specialized workforce (SDETs), need a significant amount of maintenance and infrastructure for the executions, notifications, and reporting. Today, the QA Automation Tools industry is ripe for the adoption of newer technologies and had been somewhat late to shift to SaaS, ML, and AI. Here at Fox, we have teams using various tools to augment our testing needs, and it's been very challenging, inefficient, and somewhat unreliable. Looking for a unified solution, we've conducted several POCs and have adopted the SaaS...

Tackling Microservices architecture testing through data-driven and contract-based testing, presented by Royal Cyber. System performance has become critical with the pace of agile and continuous delivery, where things like microservices, cloud, IoT, and many other environments keep changing the landscape of the IT world. There are many ways we can expand how we test performance—everything from testing, assurance, validation, verification, optimization, notification, and many other activities. With AI and ML technologies, we could even build a future where generic open tests for common...

Given I am a tester When I write Gherkin scenarios Then software development and testing go much more smoothly

Gherkin has become a quintessential part of BDD. Love it or hate it, Gherkin's simple "Given-When-Then" syntax makes it easy to frame behaviors and, by extension, test cases. What most folks don't realize, however, is that writing "good" Gherkin is more about semantics than syntax. We could argue over how many lines a scenario should be or how granular steps should be, but that misses the bigger picture: developing readable, runnable behavior definitions.In this talk, we'...

Maturing a new organization's quality practices, while challenging, is doable as processes are normally built with quality in mind. This can't be said for legacy applications, built on architectures that are decades old and supported by organizations leveraging varying development methodologies to deliver their products and capabilities. In this presentation we will discuss how T-Mobile embraced the diversity of our successful culture to not only transform but truly migrate to Quality as a Service.

During our discussion we will map the path that T-Mobile took to identify a horizon...

This session is designed to provide an overview of software architecture and design to testers so that you can understand how the different tiers and components fit together in a modern, complex system, and help you assess where the risks lie. When developing a robust test strategy, it is very important for all members of the team, including testers, to know how the system is put together. This session provides a brief historical perspective on how software architecture has evolved from mainframe to client-server, to web, to mobile, to micro-services. It includes examples of where...

Agile is not a fairy tale. You have to face real life challenges well prepared in order to succeed. The reality is: the bigger and older your organization is, the more difficult it is to pass through process level changes and that's when Chaos is born. Resolving all the issues with Chaos could potentially take years. Peter will share his story of one of his projects where he had to face numerous obstacles as a Test Manager in achieving proper Agile implementation and to raise the quality of the products of his client.

Some of the obstacles included: agile ceremonies not followed,...

As companies move towards a Microservice-oriented architecture, modernizing the Microservice Testing Strategy for modular distributed systems can be a challenge. A modernized testing strategy needs to adapt to these changes and involve a collaborative effort from Dev’s, SDET and DevOps to facilitate implementation of quality gates and enhance business value of the product. How do you ensure that a service that tests an individual functionality works seamlessly with other services? Are services resilient and fault tolerant? How to ensure seamless integration between cross functional teams...