STARWEST 2018 - Quality Assurance

Do you have access to lots and lots of test, development, app, and service data—really big data—from client and cloud service log files, test execution results, and more? Then, you have a great opportunity to begin using data analytics and machine learning (ML) to gain new product quality insights. Bring your laptops and your sense of discovery as Eun Chang introduce analysis techniques and ML tools to help you develop new and potentially groundbreaking insights. First, she will present a fast-paced statistics primer for those with no prior data exploration experience and others looking...

Have you ever worked on a project where you felt testing was thorough and complete—all features were covered and all tests passed—yet in the first week in production the software had serious issues and problems? Join Dawn Haynes to learn how to inject robustness testing into your projects to uncover those issues before release. Robustness—an important and often overlooked area of testing—is the degree to which a system operates correctly in the presence of exceptional inputs or stressful environmental conditions. Dawn shows you how—by expanding basic tests and incorporating specific...

Sometimes we allow ourselves to drown in work… Mary Thorn hears it all the time: testers complaining at retrospectives to their teams that they do not have enough time to test everything. She often sees testers work overtime the last week of a sprint to ensure the definition of done is accomplished. Why do they do this? Why do we, as testers, enable the bad behaviors of “Scrummerfall” or a lack of whole-team ownership of quality? Mary aims to arm testers with techniques that allow them to test smarter, not harder, and enable the testers and the team to have better conversations that make...

Data has become the most significant roadblock that testers face today. In fact, up to 60% of a tester’s time is spent waiting for data. Chris Colosimo shows that many factors contribute to this wait time, including internal requirements from the test data management team to pull data in the proper form, wait times for sanitized or “test-safe” data, or, most importantly, building data sets that do not exist. Compounding these challenges is the inherit complexity of today’s data. You have to be a DBA to even begin to understand the structure and relationships needed to support your testing...

Although processes and tools play an important role in software testing, the most important testing tool is the mind. Like scientists, testers search for new knowledge and share discoveries—hopefully for the betterment of people’s lives. More than sixty years ago, William I.B. Beveridge reframed discussion of scientific research in his classic book The Art of Scientific Investigation. Rather than add to the many texts on the scientific method, he focused on the mind of the scientist. Join Ben Simo as he applies Beveridge’s principles and techniques for scientific investigation to software...

Are you puzzled about why your estimate turned out wrong, or stressed from working to meet an impossible deadline? Some teams on inaccurately estimated projects suffer stress, burnout, and poor quality as pressure is applied to stick to an unrealistic schedule. Such project teams also descend into irrational decision-making—with potentially catastrophic consequences. Frustratingly, even when teams perform well, they are often judged by their failure to meet impossible deadlines. Andrew Brown will show how estimation errors are caused not just by new technology or intentionally...

When Isabel Evans learned to drive a car, she also learned how to check, clean, and change spark plugs, mend the fan belt with a stocking, and indicate speed and direction changes with arm and hand signals. Now, we don’t expect to have to do any of those things; we just drive the car. That’s how test tools and automation could be. Just drive and concentrate on the journey of delivering software continuously—concentrate on engineering the solutions, not on the automation. To be effective engineers, we need the support of a powerful toolset that we understand. Is that what we have? Or do we...

Today’s IT systems communicate with customers through multiple points of engagement and various interfaces, ranging from web, mobile, and voice to BOTs and apps like Alexa and Siri. Sanil Pillai says these systems need to provide seamless handoffs between different points of interaction—while at the same time providing relevant and contextual information quickly. To accomplish this, a team must be able to successfully pair device hardware capabilities and intelligent software technologies such as location intelligence, biometric sensing, and Bluetooth. Sanil shows that testing...

Delivering a compliant product is a resource intensive and challenging activity for most teams. Whether a team is trying to adhere to company, industry, or international standards, it needs to produce deliverables under tight deadlines with the right level of quality. When you work with Forensic teams the stakes are high! Next Generation Sequencing (NGS) is a new forensic DNA sequencing technology which can result in increased detection ability for degraded and complex mixture samples. It can also provide ancestry and physical trait information which help's narrow down suspects....

Modern software development has brought us an incredibly powerful tool: continuous integration and deployment. However, taking advantage of this new system isn’t always straightforward. With powerful new tools come powerful new ways of making mistakes that can take your product down in a heartbeat. Melissa Benua has years of experience making CI and CD work for her, with lots of insights—both good and not so good. Come and learn from her as she shares key tips and tricks for coding and testing for both forward and backward compatibility in software releases. Useful for both traditional...

The most common requests Dawn Haynes gets as a consultant these days is to help testers transition to an agile development process, or to help testers be more effective in “agile-ish” environments. But Dawn recognises that transforming the process and the environment is not enough. Interestingly, the core answer to these questions starts with forgetting the process for a moment and focusing on yourself and what you’re trying to accomplish. Being agile starts with a mindset and an attitude that drive focus, approaches, and solutions. When you start there, the path to improvement can almost...

Each of us has personal weaknesses that are often perceived to have negative impacts on performance and capability in the workplace. When this weakness is prominent to yourself or others, are you capable of benefiting IT teams and qualified to do the job? In dealing with negative impacts of her Generalized Anxiety Disorder, Julene Johnson falls into this category and has experienced personal doubt in her ability to perform her job well. Over time, however, she’s noticed that habits and techniques developed while dealing with anxiety can be applied in a manner that improves her life...

In a busy world, testing teams are asked to adopt new approaches to increase speed and flexibility of change. What methods and tools can help? Artem Golubev has seen many testing teams being told to use Docker. But for testers, this brings confusion. What it Docker and why is Docker useful to testers? How can Docker be used to increase confidence in our releases? To help you answer those questions, Artem shares his experience using this popular tool and approach. Starting with terminology Artem shares what is meant by Dockerfile, Docker Image, Docker Container, Compose, Kubernetes...

Agile testing is hard. Testers contend with terse requirements, minimal process, little documentation, continually evolving business, technical and organizational factors. Auditors demand proof of compliance. Some teams have trouble conforming to regulations while preserving agile practices. Griffin Jones, a tenured regulated software testing consultant, says “not only can agile practices blend with regulatory compliance - they can be harmonized with them leading to high quality and more agility.” Griffin feels that regulators are project stakeholders, who join the product owner in...

Articles on abc.net and elsewhere reported that Volvo has recently discovered a non-traditional requirement: Any self-driving vehicle approved for use outside Australian cities must recognize kangaroos on or near the roadway and take proper actions. The kangaroo’s bounce confused the large animal detector! In this session, industry expert David Gelperin shares a new perspective on the value of imprecise requirements and explores the nature of testing them. Excess precision may hamper the development of optimal solutions by excluding effective designs. Imprecise statements reduce the risk...

Do you remember sitting in front of the television as a kid enjoying your favorite Saturday morning cartoons? Chris Loder shows you how the lessons we learned from those cartoons apply to our everyday work in test automation. Wait until you hear what we’ve learned from the likes of Scooby Doo®, Wile E. Coyote®, and many other favorites! Like Bugs Bunny®, maybe we should “have taken that left turn at Albuquerque” and possibly done things a little differently. Discover how the animators in Spiderman® didn’t redraw every background but reused the animation cells, similar to our reusing pieces...

There are many crowdsourcing vulnerability discovery techniques available today, making it difficult for testers to choose an approach that finds important vulnerabilities while offering the best bang for the buck. Join Mike Shema as he shares several years of real-world data that will help you understand the different discovery techniques, such as bug bounty programs and scanners, and the best time to use each technique. Mike also will discuss how your approach may change according to your lifecycle, and ways to think about integrating security within that process. You'll see how metrics...