STAREAST 2019 - Quality Assurance

Testing and requirements are bound together: You use requirements to understand what to test and what your customer expects from the product under test. Requirements appear in many forms—verbal, diagrams, user stories, or formal specifications. But sometimes once we start testing, we find that requirements are missing, inadequate, wrong, or changing. This is normal, and as testers, part of our role is to help the team and the customer clarify what is required. (Sometimes we even build the requirements to clarify our tests!) Join Isabel Evans to understand how to identify, capture,...

Anyone who has ever attempted to estimate software testing effort realizes just how difficult the task can be. The number of factors that can affect the estimate is virtually unlimited. The keys to good estimates are understanding the primary variables, comparing them to known standards, and normalizing the estimates based on their differences. This is easy to say but difficult to accomplish because estimates are frequently required even when we know very little about the project—and what we do know is constantly changing. Throw in a healthy dose of politics and a bit of wishful...

According to the 2018/2019 World Quality Report, the number one challenge in applying testing to agile development is overcoming the challenges of creating, managing, and maintaining test environments and test data. Over 48% of respondents had issues with test data. As our systems complexity and time to market demands have increased, the appetite for resolving the test data issue can be diminished or be viewed as test data doesn’t really matter. Join Julie Gardiner as she shares the good, bad and ugly of test environments and data, defines an approach to establish where you are in terms of...

Have you ever worked on a project where you felt testing was thorough and complete—all features were covered and all tests passed—yet in the first week in production the software had serious issues and problems? Join Dawn Haynes to learn how to inject robustness testing into your projects to uncover those issues before release. Robustness—an important and often overlooked area of testing—is the degree to which a system operates correctly in the presence of exceptional inputs or stressful environmental conditions. Dawn shows you how—by expanding basic tests and incorporating specific...

The modern world of testing gets noisier, more fragmented, and more confusing every day. Postmodern Testing is an admission of the imperfect world we live in—a new test strategy framework for today’s agile, continuous, and multiplatform teams. Jason Arbon will outline strategies for identifying any given product’s testing needs, as well as prescribe how to efficiently combine different testing techniques and test automation tools to deliver a coherent, well-reasoned, and cost-effective method to the madness. Jason draws on his learnings from how Google tested the Chrome browser,...

As testers in today’s world of agile and DevOps, we are challenged to champion quality in new ways and to develop innovative test approaches that focus on customer value. It's important to bring creativity as well as technical expertise to our test techniques so that we can make our most valuable contributions. We determine both what to test and how to test, and we test jointly with developers. We assess risk and communicate it to our teams and stakeholders through our stories. Our ability to innovate comes from not only our technical skills, but also from our skills in...

Maybe you’ve been testing the same application for a while and your rate of finding new bugs has slowed. Or you’re trying to find more ways to figure out what your devs are doing day to day. You have the tools at your disposal—you just need to dig in! Hilary Weaver-Robb will share tools and techniques you can use to take your testing to the next level. See everything the developers are changing, and learn how you can find the most vulnerable parts of the code. These strategies can help you focus your testing and track down those pesky bugs! Take away a better understanding of tools...

Every customer has different expectations for their software, requiring different testing strategies. Game designers can help us understand how to plan our strategy for managing various QA tools so teams can successfully navigate each different customer strategy in a risk-reward environment. A customer who makes their money from understanding and teaching software to others, rather than selling it, requires continuous integration and delivery, because they need new material on a regular basis. A customer who uses the software to defend life and limb requires it to be right the first time...

Roughly speaking, "fuzzing" is testing without an oracle—essentially, testing without knowing what the outcome should be. We don’t know what should happen, but we have a good idea of things that shouldn’t happen, such as 404 errors and server or application crashes. We generally apply fuzzing to produce these kinds of errors when we’re testing text boxes, but why should text boxes have all the fun? Websites today are interconnected, multiserver applications that include connections to out-of-network servers, making it difficult to enumerate and control all the possible combinations...

Kubernetes is one of the fastest growing open source projects in history, and it's taking the DevOps world by storm. With so many resources being poured into this technology, it would be nice if there were some benefits for testing. It may seem that the Kubernetes framework revolves around operations and microservices, but with a little know-how, we can leverage the internet excitement around the project to enhance our own automated testing frameworks. Glenn Buckholz will demonstrate how, with just a little bit of knowledge about Docker and Git, an automated testing team can leverage...

The reality distortion field (RDF) is a term coined by Bud Tribble at Apple Computers in 1981 to describe Steve Job's charisma and its effect on the developers working on the Macintosh project. The RDF was said to be Steve Job's ability to convince himself and others to believe almost anything with a mix of charm, bravado, marketing, appeasement, and persistence. The RDF warps an audience's sense of proportion for difficulties and makes them believe that any task is possible. When it comes to testing, we have this RDF all around us, with managers saying things like, "We can and should...

There are many types of testing that companies need to perform in order to have confidence in their product: security testing, integration testing, system testing, performance testing, and more. Often, mobile developers focus on ensuring that main end-to-end flows of their applications work by relying on frameworks like Appium or Robotium. However, in the mobile domain, visual testing is essential because mobile devices differ drastically in capabilities, display dimensions, and even operating systems. Visual regression testing targets specific areas of visual concepts like layouts,...

It’s often said that with great power comes great responsibility. As technology becomes more powerful, security becomes a great responsibility. You’ve read all the books, followed the latest updates on all the blogs and forums, or maybe you just have a gut feeling that there’s a potential for disaster. As software testers, is it our job to be the security police? If you don’t protect the public, who will? Then there is the business—who is going to protect them from themselves? You go into meetings ready to save the day only to be shot down or, even worse, ignored. What went wrong? Why were...

Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Adam Auerbach and Jennifer Bonine will moderate this panel discussion—which will include Jason Arbon, Dan Belcher, Tariq King, Jeff Nyman, and Jeremias Rößler—to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.

Companies today must respond to the ever-increasing demand for delivering products in a fast-paced digital environment. As a result, many traditional testing departments are being dismantled, teams are being split up, and individual testers are being distributed across multiple projects or functional teams. This transition can lead to workflows that are awkward and siloed, with team members trying to figure out what exactly to do with the tester. Noha Gomaa thinks there must be a better way to handle the transition. Noha champions "testing as a service" to many project teams. She helps...