Agile Dev West 2016 - Testing & QA

Test-driven development (TDD) is a powerful technique for combining software design, unit testing, and coding in a continuous process to increase reliability and produce better code design. Using the TDD approach, developers write programs in very short development cycles. The developer first writes a failing automated test case that defines a new function or improvement, then produces code until the test passes, and finally refactors the new code to acceptable standards. The developer repeats this process many times until the behavior is complete—and fully tested. Rob Myers demonstrates...

To be most effective, test managers must develop and use metrics to help direct the testing effort and make informed recommendations about the software’s release readiness and associated risks. Because one important testing activity is to “measure” the quality of the software, test managers must measure the results of both the development and testing processes. Collecting, analyzing, and using metrics are complicated because many developers and testers are concerned that the metrics will be used against them. Join Mike Sowers as he addresses common metrics—measures of product quality,...

Avoiding siloed development is a tricky business. It’s easy for agile teams to fall into the rut in which testers only do traditional testing activities and programmers strictly do their time-worn coding activities. Rob Sabourin shares a number of examples of how testing skills can be applied to a wide variety of activities in an agile project. Testers are among the most skilled team members in story grooming, elicitation, and exploration. Risk analysis in self-organized agile teams empowers testers to drive design decisions. A tester’s affinity analysis skills help clear the way for teams...

In test automation, we must often use several tools that have been developed or acquired over time with little consideration of an overall plan or architecture, and without considering the need for integration. As a result, productivity suffers and frustrations increase. Join Mike Sowers as he shares experiences from multiple organizations in creating an integrated test automation plan and developing a test automation architecture. Mike discusses both the good (engaging the technical architecture team) and the bad (too much isolation between test automators and test designers) on his test...

In 2015, the Standard & Poor’s Ratings IT team set out an ambitious objective—to tighten the process and controls around the quality of code deployed to production. Based on internal cost of quality assessments, and supporting agile and waterfall internal engineering processes, distinct testing levels were identified to help push quality left and root out the underlying causes of defects as early as possible. The ‘14 Levels of Testing’ were defined to collaboratively span organizational functions, establish quality expectations, and help track towards the goal of eliminating defects....

Are you looking for insight into real-life companies and how “going mobile” has changed the roles for developers and testers in their organizations? Jennifer Bonine and Rick Faulise share strategies that have worked—and not worked—for organizations. What do you, as a developer or tester, need to think about when you move into mobile web and mobile apps? It is important to understand the changes required in your skillset and to keep up to date on what organizations are looking for in their resources as they embark on their mobile strategies. Jennifer and Rick explore the state of mobile...

Continuous integration (CI) is a buzzword in software development today. We know it means “run lots of builds,” but having a continuous integration pipeline opens up opportunities well beyond making sure your team's code compiles. What if this pipeline could improve everything from the quality of code reviews to how often and safely you deploy to production and how you monitor your product in the wild? What if CI could provide insights into how automated tests are performing and how to improve them? Melissa Benua describes how to set up a basic CI infrastructure and then transform it into...

If we observe the world through the lens of software testing, we discover that there are lessons all around us we can apply on the job, and one venue that’s packed with these tidbits is the movie theater. Bernie Berger gives examples of a few unlikely yet credible lessons from the language of some classic Hollywood movies—and how we can apply them as we test. Learn about the primary root cause of many software bugs from Office Space; see how the characters in Saving Private Ryan enacted ideas of exploratory testing; discover how to apply the skills of situational...

In many ways, the rapidly evolving mobile banking application industry is challenging for testers. Adding a wearable device brings new challenges, new user behaviors, and untested devices. To ensure a well-tested product, what changes and adaptations do you need to make to your test approach? Carl Johnson shares his hands-on experiences going from testing a mobile banking application to testing a wearable “watch-bank,” an application that makes it possible for customers to see balances and transactions on their smartwatches. Carl presents examples of his learnings—tools that could help you...

If testers sit passively through agile planning, important testing activities will be glossed over or missed altogether. Testing late in the sprint becomes a bottleneck, quickly diminishing the advantages of agile development. However, testers can actively advocate for customers’ concerns while helping the team implement robust solutions. Rob Sabourin shows how testers can—and should—contribute to the estimation, task definition, clarification, and scoping work required to implement user stories. Testers apply their elicitation skills to understand what users need, collecting great...

With the proliferation of IoT and consumer demand for smarter homes, appliances, automobiles, and wearables, many traditional product-based manufacturing companies are now becoming embedded software companies. This means that the design and manufacturing of physical products is becoming more complex since it now requires the integration of the physical components of the product, the firmware, and the myriad software components these products contain. Historically, embedded software developers have lagged behind IT in the adoption of agile development practices, largely due to the...

Your operational tools deliver continuous monitoring and alerting for applications deployed in the cloud. So why doesn’t your security suite do the same? Although no single path to a secure DevOps approach works for every organization, Tim Prendergast offers a set of key principles and techniques that have distinct advantages for delivering safe and secure products in the cloud. Security can no longer be thought of as a separate step in a product’s launch and must be integrated into the overall processes of continuous development and deployment. Implementing continuous security monitoring...

What is the most challenging aspect of running automation tests? Anshul Sharma believes it is covering multiple browsers and cross-device testing combined with faster execution of tests. One way to do this is parallel execution of tests concurrently over a Selenium Grid, but that comes with a substantial burden of managing and maintaining the platforms and browsers. Now that cloud-computing resources are available and affordable, an alternative is leveraging the cloud. Moving to the cloud makes tests easier and faster to run for several reasons. First, no installing/upgrading the browser...