STAREAST 2019 - DevOps

Containers. Every manager thinks they want them, but few teams have experience in knowing what to DO with them. Used thoughtfully, containerization of your services can transform the way your organization thinks about testing. Gone can be the days of maintaining X different compute environments with Y different configurations. Imagine instead spinning up just the code you need, on the machine type it needs, and only for as long as you need it. In this technical training, Melissa will walk through what containerization means for a legacy code base attempting to practice continuous...

The modern world of testing gets noisier, more fragmented, and more confusing every day. Postmodern Testing is an admission of the imperfect world we live in—a new test strategy framework for today’s agile, continuous, and multiplatform teams. Jason Arbon will outline strategies for identifying any given product’s testing needs, as well as prescribe how to efficiently combine different testing techniques and test automation tools to deliver a coherent, well-reasoned, and cost-effective method to the madness. Jason draws on his learnings from how Google tested the Chrome browser,...

What is a test strategy, and how do you develop one? Join Adam Satterfield and Janna Loeffler as they talk through developing a test strategy. They’ll discuss how different software development methodologies influence your test strategy, as well as how techniques like common and coordinated test planning and risk-based testing can be applied to the creation of your test strategy to improve its quality. Adam and Janna also will detail how to develop a test strategy when working with different team dynamics; for example, does your test strategy look different for internal teams versus...

Dell EMC is driving to optimize and reimagine their testing practices with the application of data-driven smart assistants, powered by analytics and machine learning. At a macro level, Geoff Meyer will highlight the opportunities across the product engineering and testing landscapes that are ripe for the application of analytics and AI. Key ingredients in moving toward solutions that matter are the identification of organization-specific pain points, their prioritization, and the availability and cleanliness of essential data. Geoff will share the process of experimentation, staffing, and...

The goal of continuous testing is to find defects earlier in the development lifecycle and release software faster to the market. This can be achieved by integrating open source functional and performance testing tools in the early stages of your software delivery lifecycle. Klaus Neuhold will explain how to integrate the open source test automation framework Taurus, and other tools such as JMeter and Selenium, as a CI step in Jenkins pipelines, so that these tools can be triggered as part of everyday code commits or builds. Taurus can run a large variety of tests and has reporting...

Every customer has different expectations for their software, requiring different testing strategies. Game designers can help us understand how to plan our strategy for managing various QA tools so teams can successfully navigate each different customer strategy in a risk-reward environment. A customer who makes their money from understanding and teaching software to others, rather than selling it, requires continuous integration and delivery, because they need new material on a regular basis. A customer who uses the software to defend life and limb requires it to be right the first time...

When is the last time you read a five-star review in the App Store or Play Store that raved, “This app is so well-tested! Their quality assurance team really knows what they’re doing. Their test automation must fit so well into their CI pipeline that they can find all sorts of issues in a snap”? The fact is most end-users don’t care about all the things we do in testing on a day-to-day basis. Instead, they care that our applications solve their problems in the way that they expect them to or in a new way that delights them. Andrew Bardallis will challenge you to first think about...

That AI is the future of testing seems to be a well-established fact. But assuming that AI will simply replace current manual testers is merely naive. Just like a tractor is no replacement for a farmer, there are many tasks in testing that by their very nature cannot be automated by current AI. As AI improves, many boring testing tasks will be automated, including creating test automation. But at some point, AI is much better suited to replace developers than testers. Think about a behavior-driven development test: It’s easier to generate code that makes the tests pass than it is to...

Roughly speaking, "fuzzing" is testing without an oracle—essentially, testing without knowing what the outcome should be. We don’t know what should happen, but we have a good idea of things that shouldn’t happen, such as 404 errors and server or application crashes. We generally apply fuzzing to produce these kinds of errors when we’re testing text boxes, but why should text boxes have all the fun? Websites today are interconnected, multiserver applications that include connections to out-of-network servers, making it difficult to enumerate and control all the possible combinations...

The reality distortion field (RDF) is a term coined by Bud Tribble at Apple Computers in 1981 to describe Steve Job's charisma and its effect on the developers working on the Macintosh project. The RDF was said to be Steve Job's ability to convince himself and others to believe almost anything with a mix of charm, bravado, marketing, appeasement, and persistence. The RDF warps an audience's sense of proportion for difficulties and makes them believe that any task is possible. When it comes to testing, we have this RDF all around us, with managers saying things like, "We can and should...

There are many types of testing that companies need to perform in order to have confidence in their product: security testing, integration testing, system testing, performance testing, and more. Often, mobile developers focus on ensuring that main end-to-end flows of their applications work by relying on frameworks like Appium or Robotium. However, in the mobile domain, visual testing is essential because mobile devices differ drastically in capabilities, display dimensions, and even operating systems. Visual regression testing targets specific areas of visual concepts like layouts,...

API testing can be challenging—especially for the uninitiated. Ever wonder what makes an API test great? Patrick Poulin will arm you with an understanding of the benefits of automating API testing over doing it manually. Patrick will review the tools landscape and show common errors people make while creating API tests. He'll discuss the steps required to completely automate the entire testing framework for APIs, and show how it is simpler than most people assume. Leave this session with an understanding of how to automate API testing and overcome the fear of the unknown.

Where does testing fit in a DevOps world? DevOps encourages the development and operations teams to work together. This broadens the network of people who collaborate to deliver a product, which creates opportunities for the boundaries of testing to expand and for the nature of testing to evolve. Testing pushes right, toward production, once the development team understands the skills, practices, and tools available in operations. Examples include on-demand infrastructure that enables testing in a production-like environment, feedback from A/B test experiments provided by customer metrics...

As organizations embrace DevOps and IT value chain automation, we are seeing the explosive growth of infrastructure-as-code capabilities, fueled by cloud scripting technology. As infrastructure-as-code capabilities evolve, what role does testing play? Especially for continuous testing, when it comes to infrastructure provisioning and configuration? How does this approach integrate with other traditional forms of testing, such as unit, integration, and systems testing? Join Joseph Ours as he presents what he's learned about infrastructure-as-code and provides live demonstrations for...