STAREAST 2018 - Software Tester

Many teams go crazy because of brittle, high-maintenance automated test suites. Jim Holmes helps you understand how to create a flexible, maintainable, high-value suite of functional tests using Selenium WebDriver. Learn the basics of what to test, what not to test, and how to avoid overlapping with other types of testing. Jim includes both philosophical concepts and hands-on coding. Testers who haven't written code should not be intimidated! We'll pair you up to make sure you're successful. Learn to create practical tests dealing with advanced situations such as input validation,...

Technologies, testing processes, and the role of the tester have evolved significantly in the past few years with the advent of agile, DevOps, and other new technologies. It is critical that we testing professionals evaluate ourselves and continue to add tangible value to our organizations. In your work, are you focused on the trivial or on real game changers? Jennifer Bonine describes critical elements that help you artfully blend people, process, and technology to create a synergistic relationship that adds value. Jennifer shares ideas on mastering politics, maneuvering core vs. context...

Many organizations invest a lot of effort in test automation at the system level but then have serious problems later on. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing value? This tutorial covers both “theory” and “practice”. Dot Graham explains the critical issues for getting a good start, and Chris Loder describes his experiences in getting good automation started at a number of companies. The tutorial covers the most important management issues you must address for...

The skill to self-manage our testing work and our learning—making learning and discovery a habit—is what differentiates skilled exploratory testing from simply putting random testing activities together. Maaret Pyhäjärvi says that exploratory testing treats test design, test execution, and learning as parallel, mutually supportive activities—with the goal of discovering things that we don’t realize we don’t know. Exploratory testing frames our thinking about the system and engulfs the idea of creating artifacts to support testing. Join Maaret to experience exploratory testing hands-on and...

You're under tight time pressure with barely enough information to proceed with testing. How do you test quickly and inexpensively—yet still produce informative, credible, and accountable results? Rapid Software Testing, adopted by context-driven testers worldwide, offers a field-proven answer to this all-too-common dilemma. In this one-day sampler of the approach, Michael Bolton introduces you to the skills and practice of Rapid Software Testing through stories, discussions, and “minds-on” exercises that simulate important aspects of real testing problems. The rapid approach isn't just...

With many organizations adopting agile practices, the test automation landscape has changed. Bob Galen explores current disruptors to traditional automation strategies, and discusses relevant and current adjustments that must be made when developing an automation business case. Open source tools are becoming incredibly viable and often best their commercial equivalents―not only in cost but also in functionality, creativity, evolutionary speed, and developer acceptance. Agile methods have fundamentally challenged our traditional automation strategies. Now we must keep up with incremental...

If you are a software tester in 2018, chances are you're testing a website or web application. Whether you are testing in a browser, within a web “wrapper” framework like Electron, or even a web app wrapped in a mobile application, your customers are using web apps and websites constantly—and they want them to work well. Our challenge in test, of course, is to test as thoroughly and efficiently as we can, given our time and resource constraints. Long time software testing veteran Alan Page demonstrates some of his favorite free or inexpensive tools for testing web apps and shares...

Many organizations find that test automation does not work as well as they thought it would. In many cases, these failures are due to generic technical reasons, which can be fixed with relative ease. Other solutions that have worked well are patterns, common to automation efforts at any level with whatever tools you are using. Dot Graham focuses on often-neglected technical issues—i.e., non-management issues—and the patterns that help solve them. These are not development or code patterns—this is a code-free tutorial. Using a set of patterns developed with Seretta Gamba, Dot looks...

Do you have access to lots and lots of test, development, app, and service data—really big data—from client and cloud service log files, test execution results, and more? Then, you have a great opportunity to begin using data analytics and machine learning (ML) to gain new product quality insights. Bring your laptops and your sense of discovery as Ken Johnston and Eun Change introduce analysis techniques and ML tools to help you develop new and potentially groundbreaking insights. First, they present a fast-paced statistics primer for those with no prior data exploration experience and...

Have you ever worked on a project where you felt testing was thorough and complete—all features were covered and all tests passed—yet in the first week in production the software had serious issues and problems? Join Dawn Haynes to learn how to inject robustness testing into your projects to uncover those issues before release. Robustness—an important and often overlooked area of testing—is the degree to which a system operates correctly in the presence of exceptional inputs or stressful environmental conditions. Dawn shows you how—by expanding basic tests and incorporating specific...

After its highly hyped introduction decades ago and followed by a long, quiet “winter,” artificial intelligence (AI) has slowly crept back into our consciousness. While our Siri and Alexa assistants entertain us, machine learning (ML) has brought new conveniences into our lives with solutions including Nest and Netflix. Today, AI brings us to the tantalizing brink of the autonomous vehicle. The sea change of this 4th Industrial Revolution has begun to disrupt industry after industry. The emerging capabilities of these fascinating machines demand our attention as AI starts to be applied in...

Ken Johnston sees today’s software ecosystem in the light of Everything as a Service (EaaS). Operating systems like Windows, Android, and Chrome OS all ship regularly like a service. Browsers automatically update every few weeks, and apps are constantly updating through all the app stores. Although getting a test to pass once and signing off has gone by the wayside for software testing, still we run test cases over and over again. Ken shares how Microsoft took millions of test cases—yes, actually millions—and turned the important ones into measures based on real world telemetry. Massive...

Advances in artificial intelligence (AI) and machine learning (ML) are leading to a new generation of software, which is becoming self-adaptive, autonomous, and smart. Academic researchers and industry practitioners are investigating how these new AI and ML technologies can be leveraged to improve software testing and testing services. A handful of testing-as-a-service (TaaS) vendors already offer services that use AI bots to perform some functional and performance testing. How well do they live up to their claims? Can they be used as an effective substitute or supplement for human testers...

MindMapping is a general technique of organizing your thoughts, aligning your ideas, and breaking things down. It’s uses are, in fact, mind blowing. But in this session, join Bob Galen, as he takes you on a visual tour of mindmapping as applied in the software testing space. We’ll be using a free tool and be creating maps to illustrate test case design, test idea generation, sprint-level test planning, and release-level test planning using mindmaps. Along the way, you’ll also gain some new insights into risk-based testing with an agile twist, as we explore the 3-Amigos metaphor. You’ll...

Selenium has been the cure for free and low-cost browser testing for years, and—in the world of agile, mobile, DevOps, and browserless interfaces—it is showing its age. Comparing Selenium to what’s coming, Jason Arbon says that machine learning and data analytics will become the new standard for test automation. With Selenium, test engineers suffer from the pains of broken element identification; broken, buggy, and partially implemented mobiletest capabilities; exploding costs of building abstraction layers on their apps; brittle test code when the application under test changes;...

Although Selenium has become the open source standard for simulating user interactions with the browser, Andrew Krug likes to think of it as more than one tool in your toolbelt. Andrew says Selenium is like the Craftsman Bolt-On tool—with one battery and one grip, it can become a circular saw, drill, jig saw, or even a tire inflator. He’ll cover thirty or more Selenium hacks in this fast-paced session. Find out how you can employ Selenium for security testing, visual testing, email testing, easy content testing, performance testing, load testing … you get the drift. Briefly...

Substantial confusion exists about the roles and responsibilities of test management when using an agile software development process. Agile seeks to streamline project management and leadership under the role of a ScrumMaster. But what does this mean for test managers? How do they stay involved in the process? What role do they fill? Is it possible that test managers are no longer needed? Join Jeffery Payne for a collaborative dialog to discuss the pros and cons of a variety of test management models he has seen used by companies who have adopted agile. Learn how to best position yourself...

As more applications are hosted on servers, they produce immense quantities of logging data. Quality engineers should verify that apps are producing log data that is existent, correct, consumable, and complete. Otherwise, apps in production are not easily monitored, have issues that are difficult to detect, and cannot be corrected quickly. Tom Chavez presents the four steps that quality engineers should include in every test plan for apps that produce log output or other machine data. First, test that the data is being created. Second, ensure that the entries are correctly formatted and...

Today’s IT systems communicate with customers through multiple points of engagement and various interfaces, ranging from web, mobile, and voice to BOTs and apps like Alexa and Siri. Sanil Pillai says these systems need to provide seamless handoffs between different points of interaction—while at the same time providing relevant and contextual information quickly. To accomplish this, a team must be able to successfully pair device hardware capabilities and intelligent software technologies such as location intelligence, biometric sensing, and Bluetooth. Testing these systems and...

The combination of microservice architectures and continuous delivery (CD) create a difficult scenario for integration and release testing. Even though microservices often introduce a huge number of integrations and transitive dependencies, testing still must be completed quickly to keep the pipeline flowing smoothly. Robert Williams surveys the techniques and tools available today for testing one or more microservices against a mix of real and virtualized dependencies in various stages of the CD pipeline. He explores structured testing around multiple versions of those services...

Most software organizations have a test automation initiative—some just beginning and others humming right along. Typically, these initiatives focus on traditional automation—using a software package to automate test cases or user stories. However, if you use only the traditional approaches to automation, you will miss opportunities to exploit the complete powers of automation. Paul Grizzaffi shares real-world examples where non-traditional automation or “automation assist” approaches, including high volume automated testing, have provided high business value testing in his company. He...

To emulate production-like conditions that cannot be tested on the unit level, many integration and functional tests need a realistic environment. However, performing these tests in a production-like environment is fraught with problems—test data management issues, tests that are difficult to execute repeatedly, and network traffic that causes long-running test execution times. Instead of having to deal with these problems and others, Irene Dhong employs Docker to simulate dependencies. Learn how you can take advantage of Dockerized dependencies for quick test writing, reusability...

It seems almost everyday we see a product announced with a clever, new digital interface—and the rush has only just begun. From chatbots and motion sensors to facial recognition and voice integrations, these digital interfaces have a complex software side. Amir Rozenberg discusses the challenges we face now and explores a more challenging future to come for testers and testing. With concrete examples from the market, he offers new approaches for you to embed quality and test activities into the development cycle to tame the digital interface beast. With Amir, you’ll look at ways to...

Augmented reality (AR) and virtual reality (VR) mobile apps are going to dominate the technical landscape for the next few years. Compared to current mobile apps, testing this new AR and VR technology will require more preparation, more effort, and new tools. BJ Aberle breaks down the methods and tools he uses to test AR and VR applications. Explore test environment requirements and discover the types of test data you’ll need to prepare for AR and VR testing. Learn about Google’s Tango AR platform and BJ’s experiences testing AR apps, including the Tango-based Cydalion app for the...

In the shift toward “continuous everything” in software development and delivery, we know that testing and testers must foster and support innovation within technology. Many of us just don’t know how to gauge that shift or, more importantly, know what needs to happen within our role to make it happen. Melissa Tondi explores the future of testing, what skills we should have/develop to ensure we are prepared for that future, and the traits of a quality engineer (QE)—where she believes many tester roles are shifting. Melissa walks you through what an innovation-oriented QE organization looks...

Imagine this scenario: Business users are excited to finally get their hands on an implementation delivery that is on schedule, (mostly) on budget, and passed rigorous testing with flying colors. Unfortunately, when working with the new app or feature, the users realize that the way they described their needs didn’t translate into what they actually needed. Sound familiar? While she may not be able to offer telekinetic mind-reading tools, Kim Tatum is convinced that leveraging a behavior-driven development (BDD) approach helps bridge the gap between domain experts and technical teams. Join...

The trend in mobile apps today is who can deliver the best and the most new apps as quickly as possible to keep up with the competition. With this, the need for more and better testing seems to grow exponentially. Open source Appium is a unique mobile app testing framework that allows you to write a single test which executes for native or hybrid apps on different operating systems running simulators/emulators and real devices in parallel. Harry Roberts describes how to create and implement a successful mobile testing strategy using Appium across Android and iOS devices. After discussing...