STARWEST 2018 - Architecture - Design

Software testing is sometimes described as “verification and validation”—or, according to Wikipedia, “the process of checking that a software system meets specifications and that it fulfills its intended purpose.” Yet, renowned tester and teacher Michael Bolton argues, if we examine the concept and logic of verification, we quickly recognize that there are serious limitations to what can and cannot be checked and verified. This is not to say that checking is a bad thing—on the contrary; checking can be very valuable. Still, it’s important for testers and their clients to recognize the...

Are you puzzled about why your estimate turned out wrong, or stressed from working to meet an impossible deadline? Some teams on inaccurately estimated projects suffer stress, burnout, and poor quality as pressure is applied to stick to an unrealistic schedule. Such project teams also descend into irrational decision-making—with potentially catastrophic consequences. Frustratingly, even when teams perform well, they are often judged by their failure to meet impossible deadlines. Andrew Brown will show how estimation errors are caused not just by new technology or intentionally...

Behavior-driven development (BDD) has been around for a while and is here to stay. However, the added abstraction levels pose a technical problem for writing and managing tests. While BDD does a great job of marrying the nontechnical aspect of test writing to the technical flow of an application under test, keeping this information under source control becomes problematic. Frameworks such as JBehave, Cucumber, or Robot give subject matter experts that additional ability to write tests, but they are often restricted access from them; because people treat test cases as code, they get stored...

Teams are sometimes asked to turn a mess of undocumented, poorly structured legacy code into a robust product under impossible deadlines. Test strategies blending automation, exploration, and refactoring can help focus development efforts and converge even the most chaotic projects. But, where do you start? Join Jonathan Solórzano-Hamilton as he shows how automation can help drive products into a state of release readiness. Learn how refactoring, test-driven development, SOLID principles, dependency injection, and mocking frameworks help break down complex development problems into...

The most common requests Dawn Haynes gets as a consultant these days is to help testers transition to an agile development process, or to help testers be more effective in “agile-ish” environments. But Dawn recognises that transforming the process and the environment is not enough. Interestingly, the core answer to these questions starts with forgetting the process for a moment and focusing on yourself and what you’re trying to accomplish. Being agile starts with a mindset and an attitude that drive focus, approaches, and solutions. When you start there, the path to improvement can almost...

In a busy world, testing teams are asked to adopt new approaches to increase speed and flexibility of change. What methods and tools can help? Artem Golubev has seen many testing teams being told to use Docker. But for testers, this brings confusion. What it Docker and why is Docker useful to testers? How can Docker be used to increase confidence in our releases? To help you answer those questions, Artem shares his experience using this popular tool and approach. Starting with terminology Artem shares what is meant by Dockerfile, Docker Image, Docker Container, Compose, Kubernetes...

Performance issues substantially impact quality, cost, and customer confidence. Agile teams are challenged to build in performance processes throughout the lifecycle, but it is critical to incorporate performance into your CI/CD pipeline. Join Amit Patel as he shares his recent project experiences and the steps his team took to change processes, leverage different technologies, and align internal stakeholders. He explains how they use production-monitoring solutions to create a real-world production feedback loop in order to ensure they can analyze data and turn the information...

Successful agile testers collaborate with programmers as code is written, isolating problems, troubleshooting defects, and debugging code all along the way to getting the product to done. But modern systems are scaling beyond what traditional teams are able to understand using familiar tools. New appreciation for systems and complexity theory, as well as disciplines and tools around emerging areas such as observability and resilience engineering, are offering solutions that allow teams to actively debug their systems and explore properties and patterns they have not defined in advance....

Articles on abc.net and elsewhere reported that Volvo has recently discovered a non-traditional requirement: Any self-driving vehicle approved for use outside Australian cities must recognize kangaroos on or near the roadway and take proper actions. The kangaroo’s bounce confused the large animal detector! In this session, industry expert David Gelperin shares a new perspective on the value of imprecise requirements and explores the nature of testing them. Excess precision may hamper the development of optimal solutions by excluding effective designs. Imprecise statements reduce the risk...

When the atmosphere is hostile to QA, and yet the demands on the QA Team are increasing, how do you transform a team where everything is tested and deployed manually, to an organization that delivers great software multiple times a day? Where do you start and how do you create the strategy for implementing Continuous Testing? Join David Lumpkin as he shares his company's journey to answer these questions and the team's evolution along the way. Over a three-year period, Craftsy went from an environment hostile towards QA, to one that embraces automation and exploratory testing,...