STAREAST 2019 - Test Management

In order to support their automation team effectively, test managers must be able to recognize when the team is taking a ‘bad’ turn and know how to steer it back, or, when starting, know how to do things right from the very beginning. They don’t need to know all the technicalities, but they must know the basics of good automation and be able to explain to higher management what automation can or cannot deliver in order to secure and sustain their support. In this tutorial Seretta Gamba introduces the Test Automation Patterns Wiki and explains in detail the patterns test managers...

Many organizations invest a lot of effort in test automation at the system level but then have serious problems later on. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing value? This tutorial covers both “theory” and “practice”. Chris Loder explains the critical issues for getting a good start and his experiences in getting good automation started at a number of companies. The tutorial covers the most important management issues you must address for test automation success...

Imagine this … As soon as any developed functionality is submitted into the code repository, it is automatically subjected to the appropriate battery of tests and then released straight into production. Setting up the pipeline capable of doing just that is becoming more and more common and something you need to know about. But most organizations hit the same stumbling block—just what IS the appropriate battery of tests? Automated build architectures don't always lend themselves well to the traditional stages of testing. In this hands-on tutorial, Melissa Benua introduces you to key test...

Cognitive Adaptive Testing means harnessing the power of analytics and autonomics in support of continuous delivery. The emergence of cognitive, adaptive testing is driven by trends towards omnichannel content delivery, utilization of big data and improved customer experience. Our software/systems need to be extremely responsive to customer sentiment, work across a variety of devices, be resilient in the face of unpredictable failure modes, and process vast amounts of unstructured data. Such scenarios put extreme pressure on IT systems and processes to be not only more responsive but...

With the adoption of agile practices in many organizations, the test automation landscape has changed. Join Bob Galen & Mary Thorn as they explore current disruptors to traditional automation strategies, and discusses relevant and current adjustments you need to make when developing your automation business case. Open source tools are becoming incredibly viable and beat their commercial equivalents in many ways―not only in cost, but also in functionality, creativity, evolutionary speed, and developer acceptance. Agile and DevOps methods have fundamentally challenged our traditional...

Knowledge of Selenium, the industry-standard tool for testing web applications, is a much sought after skill in today’s world of test automation. If you want to learn Selenium, then this full-day tutorial provides a great start. Max Saperstone shows you how to build test automation using Selenium. But he doesn’t stop there. He uses his years of experience to show you how to build automation that is clean, robust, and easy to maintain. Max introduces other tools that work with Selenium to help manage the data used to drive your tests, evaluate JavaScript-heavy applications, manage your test...

Understanding when and how to apply test design techniques is fundamental to your testing. Join Isabel Evans to learn some basic techniques that she uses in her own work, and add these vital test design techniques to your personal toolbox of methods. Isabel will demonstrate how to use test design techniques not just to decide what tests to conduct, but also to find potential defects and missing requirements before coding starts, to derive a test basis when requirements are unwritten, to drive the direction for nonscripted approaches, and to provide input to automation. Different...

Today, many agile organizations are making a terrible error. They are assuming there is no place for test management and leadership in agile, self-directed team contexts. Mary Thorn and Bob Galen beg to differ with this view and believe a strong need exists for testing leadership in agile organizations—just different from the way we’ve typically approached it. Join Mary and Bob as they explore what excellent test team leadership looks like in agile contexts. Explore the aspects of self-directed teams and the implications to your previous leadership styles. Look under the covers of Scrum...

To be most effective, leaders—including development and testing managers, ScrumMasters, product owners, and IT managers—need metrics to help direct their efforts and make informed recommendations about the software’s release readiness and associated risks. Because one important evaluation activity is to “measure” the quality of the software, the progress and results of both development and testing must be measured. Collecting, analyzing, and using metrics are complicated because developers and testers often are concerned that the metrics will be used against them. Join Mike Sowers as he...

Skill with Git is a prerequisite for most software jobs today. This is because the vast majority of software developed is stored in Git-based repositories such as GitHub, GitLab, and BitBucket. GitHub's domination of social coding makes it the new business card to demonstrate your creativity, popularity, capability, and tenacity. “Configuration as code” is a standard DevOps practice so testers must know how to set up and use Git to obtain and update versions of their infrastructures. In this hands-on tutorial, create your own website and learn the GitHub markdown used to format...

Technologies, testing processes, and the role of the tester have evolved significantly in the past few years with the advent of agile, DevOps, and other new technologies. It is critical that we testing professionals evaluate ourselves and continue to add tangible value to our organizations. In your work, are you focused on the trivial or on real game changers? Jennifer Bonine describes critical elements that help you artfully blend people, process, and technology to create a synergistic relationship that adds value. Jennifer shares ideas on mastering politics, maneuvering core vs. context...

Docker is one of the hottest technologies in our industry today. It lets you create and manage containers—like virtual machines but smaller and faster. They can provide on-demand, disposable test environments that start quickly, repeatably, locally or in the cloud. When you want, you can tear down the environment and recreate a pristine copy within seconds. And since the process is automated, anyone on the team can use the same commands to get their own systems. When you finish testing, those containers can be deployed directly into production. At each stage, the environments for...

There is a lot of hype around continuous testing these days. It seems like every product vendor has a continuous testing product and every consulting company has a continuous testing practice. But what exactly is continuous testing? And how is it different from what we've been doing in testing for the past several decades? Join Jeffrey Payne as he discusses what continuous testing is all about and how today's organizations are leveraging it to improve their quality. Learn what tools and techniques enable continuous testing, and examine the pros and cons of moving toward a more continuous...

How long have you been in software testing? What was testing like when you first started? How did the discipline of software testing get to where it is today, and where is it headed in the future? Dot Graham takes a look back at software testing, from a personal perspective as well as a general view. She shares what she has learned from her experiences over the years and gives lessons for today. Dot started her working life by being put into a test group, where she wrote test execution and comparison programs (they weren’t called “tools” back then). In her more than forty years as a...

What can a tester do when they join an organization that isn’t really agile—or maybe is (gasp) still waterfall? In these situations, it is important to focus on the values and principles that make up agile. Even in a development environment that does not strictly follow an agile-related methodology like Scrum or kanban, the tester can still bring agile principles to their testing. Kat Rocha will share real-world experiences relating to how test engineering can act agile within a waterfall development team, as well as what is important for testing in a team that is undergoing an agile...

Moving to the cloud is no longer a question of if, but when. Most corporations are either underway in their cloud adoption or have it on their radar. Typically the move from on-premise to cloud is a few hops and different types of data, such as SQL or some version of a file. Couple this with data transformations and it poses a challenge to testing and QA. How do you validate at each hop? Is it required to validate contents between source and destination? Can this testing be automated? Do we build a tool to automate these steps or purchase one? In this session, Sanjay Srinivas will...

Maybe you’ve been testing the same application for a while and your rate of finding new bugs has slowed. Or you’re trying to find more ways to figure out what your devs are doing day to day. You have the tools at your disposal—you just need to dig in! Hilary Weaver-Robb will share tools and techniques you can use to take your testing to the next level. See everything the developers are changing, and learn how you can find the most vulnerable parts of the code. These strategies can help you focus your testing and track down those pesky bugs! Take away a better understanding of tools...

That AI is the future of testing seems to be a well-established fact. But assuming that AI will simply replace current manual testers is merely naive. Just like a tractor is no replacement for a farmer, there are many tasks in testing that by their very nature cannot be automated by current AI. As AI improves, many boring testing tasks will be automated, including creating test automation. But at some point, AI is much better suited to replace developers than testers. Think about a behavior-driven development test: It’s easier to generate code that makes the tests pass than it is to...

With all the tools available on the market, it can be overwhelming to determine which ones might meet your needs and which ones will work best in your environment to create a high-performing team. Join Jennifer Bonine as she explains the relationship of the DevOps cycle, your environment, and how a hub-and-spoke model can link all your different data sets and tools together. Jennifer will identify opportunities for applying test data analytics across the engineering and test landscape, ranging from high-value test cases to dynamically generated regression test suites. She will review ways...

One of the best things Melissa Tondi did for her career was disrupt it. She'll talk about what disruption means, how it can take form, and how it can help build out a team model that is more adaptable to change than ever while still focusing on the traits quality engineering brings to the table within project teams. Even if physically disrupting your career is not an option, in this session you will discuss how you can develop the mindset of a quality engineer and how a career disruption—whether planned or unplanned—can enhance your quality engineering career development. Melissa...

The reality distortion field (RDF) is a term coined by Bud Tribble at Apple Computers in 1981 to describe Steve Job's charisma and its effect on the developers working on the Macintosh project. The RDF was said to be Steve Job's ability to convince himself and others to believe almost anything with a mix of charm, bravado, marketing, appeasement, and persistence. The RDF warps an audience's sense of proportion for difficulties and makes them believe that any task is possible. When it comes to testing, we have this RDF all around us, with managers saying things like, "We can and should...

The DevOps movement is front and center across enterprises. Companies with mature systems are breaking down siloed IT departments and federating them into product development teams and departments. Testing and its practices are at the heart of these changes. Traditionally, development organizations have been filled with mostly manual testers and a limited number of automation and performance engineers. Adam Auerbach says this has to change. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and...

As managers, it's easy to fall into the trap of focusing on what we need out of our employees' one-on-one meetings, all the while forgetting that one-on-ones are for them! This talk is a list of eight behaviors that are guaranteed to make one-on-ones with employees less effective. For each of the eight unproductive behaviors, Jason Wick will provide examples of where he personally has failed, and share how this experience has become his guiding light of best practices for managing a dozen employees. The juxtaposition of the humorous tips to ruin your one-on-ones with a positive...

Where does testing fit in a DevOps world? DevOps encourages the development and operations teams to work together. This broadens the network of people who collaborate to deliver a product, which creates opportunities for the boundaries of testing to expand and for the nature of testing to evolve. Testing pushes right, toward production, once the development team understands the skills, practices, and tools available in operations. Examples include on-demand infrastructure that enables testing in a production-like environment, feedback from A/B test experiments provided by customer metrics...

Companies today must respond to the ever-increasing demand for delivering products in a fast-paced digital environment. As a result, many traditional testing departments are being dismantled, teams are being split up, and individual testers are being distributed across multiple projects or functional teams. This transition can lead to workflows that are awkward and siloed, with team members trying to figure out what exactly to do with the tester. Noha Gomaa thinks there must be a better way to handle the transition. Noha champions "testing as a service" to many project teams. She helps...

As organizations embrace DevOps and IT value chain automation, we are seeing the explosive growth of infrastructure-as-code capabilities, fueled by cloud scripting technology. As infrastructure-as-code capabilities evolve, what role does testing play? Especially for continuous testing, when it comes to infrastructure provisioning and configuration? How does this approach integrate with other traditional forms of testing, such as unit, integration, and systems testing? Join Joseph Ours as he presents what he's learned about infrastructure-as-code and provides live demonstrations for...