STAREAST 2019 - Test Automation

Many organizations invest a lot of effort in test automation at the system level but then have serious problems later on. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing value? This tutorial covers both “theory” and “practice”. Chris Loder explains the critical issues for getting a good start and his experiences in getting good automation started at a number of companies. The tutorial covers the most important management issues you must address for test automation success...

As testers we are faced with many challenges especially when designing and executing tests. Most problems reside in the fact that we usually do not know which test case design technique to use and more importantly we usually do not have time to run all of our tests. This workshop will uncover what the challenges are with test design and explains the real problems associated with combinatorial testing. During this tutorial Lloyd Roden looks deeply into the two methods for designing tests using the pairwise design technique; Orthogonal Arrays and pairwise algorithms. Pairwise testing helps...

The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...

Software development is trending toward building systems using small, autonomous, independently deployable services called microservices. Leveraging microservices makes it easier to add and modify system behavior with minimal or no service interruption. Because they facilitate releasing software early, frequently, and continuously, microservices are especially popular in DevOps. But how do microservices affect software testing and testability? Are there new testing challenges that arise from this paradigm? Or are these simply old challenges disguised as new ones? Join Tariq King as he...

Web applications are often security critical or serve as front-ends for security critical applications, making web testing for vulnerabilities an essential part of software testing. Unfortunately, most software testers have not been taught how to identify web security issues while testing applications. Join Jeffery Payne as he shares what you need to know to security test web-based applications as part of your overall testing process. Learn about the most common web security vulnerabilities and how they are introduced into web code and exploited by hackers. Explore test techniques for...

Software continues to revolutionize the world, impacting nearly every aspect of our work, family, and personal life. Artificial intelligence (AI) and machine learning (ML) are playing key roles in this revolution through improvements in search results, recommendations, forecasts, and other predictions. AI and ML technologies are being used in platforms for digital assistants, home entertainment, medical diagnosis, customer support, and autonomous vehicles. Testing practitioners are recognizing the potential for advances in AI and ML to be leveraged for automated testing—an area...

Functional test automation is a wonderful way to frequently and expeditiously execute regression testing. However, the test scripts that we write are limited to the few assertions we’ve considered. Many times, these assertions only cover the tip of the iceberg and account for a small fraction of what a human being would have subconsciously verified. For example, a test automation script can verify that when adding 2 and 2 via a calculator app, the sum that is returned on screen is 4. But does the 4 appear correctly? Is it upside down? Or sideways? Is it the right color? Are there errors...

Docker is one of the hottest technologies in our industry today. It lets you create and manage containers—like virtual machines but smaller and faster. They can provide on-demand, disposable test environments that start quickly, repeatably, locally or in the cloud. When you want, you can tear down the environment and recreate a pristine copy within seconds. And since the process is automated, anyone on the team can use the same commands to get their own systems. When you finish testing, those containers can be deployed directly into production. At each stage, the environments for...

How long have you been in software testing? What was testing like when you first started? How did the discipline of software testing get to where it is today, and where is it headed in the future? Dot Graham takes a look back at software testing, from a personal perspective as well as a general view. She shares what she has learned from her experiences over the years and gives lessons for today. Dot started her working life by being put into a test group, where she wrote test execution and comparison programs (they weren’t called “tools” back then). In her more than forty years as a...

The modern world of testing gets noisier, more fragmented, and more confusing every day. Postmodern Testing is an admission of the imperfect world we live in—a new test strategy framework for today’s agile, continuous, and multiplatform teams. Jason Arbon will outline strategies for identifying any given product’s testing needs, as well as prescribe how to efficiently combine different testing techniques and test automation tools to deliver a coherent, well-reasoned, and cost-effective method to the madness. Jason draws on his learnings from how Google tested the Chrome browser,...

Moving to the cloud is no longer a question of if, but when. Most corporations are either underway in their cloud adoption or have it on their radar. Typically the move from on-premise to cloud is a few hops and different types of data, such as SQL or some version of a file. Couple this with data transformations and it poses a challenge to testing and QA. How do you validate at each hop? Is it required to validate contents between source and destination? Can this testing be automated? Do we build a tool to automate these steps or purchase one? In this session, Sanjay Srinivas will...

Maybe you’ve been testing the same application for a while and your rate of finding new bugs has slowed. Or you’re trying to find more ways to figure out what your devs are doing day to day. You have the tools at your disposal—you just need to dig in! Hilary Weaver-Robb will share tools and techniques you can use to take your testing to the next level. See everything the developers are changing, and learn how you can find the most vulnerable parts of the code. These strategies can help you focus your testing and track down those pesky bugs! Take away a better understanding of tools...

Every customer has different expectations for their software, requiring different testing strategies. Game designers can help us understand how to plan our strategy for managing various QA tools so teams can successfully navigate each different customer strategy in a risk-reward environment. A customer who makes their money from understanding and teaching software to others, rather than selling it, requires continuous integration and delivery, because they need new material on a regular basis. A customer who uses the software to defend life and limb requires it to be right the first time...

When is the last time you read a five-star review in the App Store or Play Store that raved, “This app is so well-tested! Their quality assurance team really knows what they’re doing. Their test automation must fit so well into their CI pipeline that they can find all sorts of issues in a snap”? The fact is most end-users don’t care about all the things we do in testing on a day-to-day basis. Instead, they care that our applications solve their problems in the way that they expect them to or in a new way that delights them. Andrew Bardallis will challenge you to first think about...

With all the tools available on the market, it can be overwhelming to determine which ones might meet your needs and which ones will work best in your environment to create a high-performing team. Join Jennifer Bonine as she explains the relationship of the DevOps cycle, your environment, and how a hub-and-spoke model can link all your different data sets and tools together. Jennifer will identify opportunities for applying test data analytics across the engineering and test landscape, ranging from high-value test cases to dynamically generated regression test suites. She will review ways...

Kubernetes is one of the fastest growing open source projects in history, and it's taking the DevOps world by storm. With so many resources being poured into this technology, it would be nice if there were some benefits for testing. It may seem that the Kubernetes framework revolves around operations and microservices, but with a little know-how, we can leverage the internet excitement around the project to enhance our own automated testing frameworks. Glenn Buckholz will demonstrate how, with just a little bit of knowledge about Docker and Git, an automated testing team can leverage...

Existing QA solutions were built for a world where software changed infrequently. Highly adopted tools such as Selenium, Appium, and JUnit require a specialized skill set and too much maintenance, once you start factoring in the brittle nature of tests and the infrastructure required to run tests at scale. But there is still hope for QA in machine intelligence. Next-generation AI tools are here to help QA keep up with the agility of modern software delivery practices in two ways: by enabling manual testers who don't know how to code to automate, and by easily automating repetitive tasks so...

Load and performance testing can be messy, last minute and expensive in most organizations. It is possible to change the status quo with a mixture of technology and process. Incorporating performance testing into your CI pipeline can help mitigate the last minute part. Jmeter has been around since 1998 and offers a low-cost alternative for getting the job done, alleviating the expense. Incremental Test Driven Development of performance test cases can help alleviate the mess. Join Glenn as he uses the Cloud, Jmeter, and TDD to help to demonstrate how performance testing can be brought from...

Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Adam Auerbach and Jennifer Bonine will moderate this panel discussion—which will include Jason Arbon, Dan Belcher, Tariq King, Jeff Nyman, and Jeremias Rößler—to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.

Price rate is used to calculate an insurance premium based on the different insurance coverage. Every year the price rate is based on updated regulations, so after each change, the new price rate has to be tested for a large amount of data to make sure that the premium is correct based on the coverage. Testing fifty thousand data entries and their variations is impossible for any testing team. Alireza Razavi will present an AI automation testing framework designed to solve this testing problem. Discover how to use a supervised machine learning algorithm to determine the type of training...