STAREAST 2017 - Test Automation Engineer

In the tradition of James Whittaker’s book series, How to Break Software, Jon Hagar applies the testing “attack” concept to mobile and embedded software systems. First, Jon defines the environments of mobile and embedded software. He then examines the issues of software product failures caused by defects found in these types of software. Next, Jon shares a set of attacks against mobile and embedded software based on common modes of failure that teams can direct against their software. Like different kinds of software design patterns, attacks are test design patterns that must be...

Let’s build a mobile app quality and testing strategy together. Whether you have a web, hybrid, or native app, building a quality and testing strategy means (1) knowing what data and tools you have available to make agile decisions, (2) understanding your customers and your competitors, and (3) testing your app under real-world conditions. Jason Arbon guides you through the latest techniques, data, and tools to ensure your mobile app quality and testing strategy is awesome. Leave this interactive session with a strategy for your very own app—or one you pretend to own. The information Jason...

Test automation has become a must, especially in agile and DevOps projects with their goals of continuous integration and fast deployment. We know that test automation is a deciding factor in achieving competitive strength, as it contributes to faster time-to-market and higher quality-to-market in software delivery. Even though powerful automation technologies like Selenium are available, they alone do not give you scalability in testing big and complex systems with their many components, workflows, and configurations. To help you learn how to achieve scalability in automated...

Note: We will be working online with the wiki during this tutorial, so please bring a laptop, tablet, or similar web-enabled device.

Many organizations find that test automation does not work as well as they thought it would. In many cases, these failures are due to generic technical reasons, which can be fixed relatively easily. Solutions that have worked well for others are patterns; these test automation patterns are common to automation efforts at any level with whatever tools you are using. Dot Graham focuses on often-neglected technical issues—i.e., non-management issues—and...

No longer just a futuristic concept, the Internet of Things (IoT) has a strong presence in our world even today. If your business is not prepared for it, you’re already behind. With the proliferation of connected “things”—devices, appliances, cars, and even clothes—Jennifer Bonine says that the stage is set. IoT apps are here to stay. Testing, product management, and development teams must address developing and testing in this paradigm. Testers, accustomed to traditional platforms, are now asked to test on more complex devices and more advanced platforms. Testers must keep up with the...

Many organizations invest a lot of effort in test automation at the system level but then have serious problems later on. As a manager, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing value? Dot Graham describes the most important management issues you must address for test automation success, particularly when you are new to automation. Dot helps you understand and choose the best approaches for your organization—no matter which automation tools you use. Focusing on system...

You have just been assigned a new testing project. Where do you start? How do you develop a plan and begin testing? How will you report on your progress? Paul Holland shares new test project approaches that enable you to plan, test, and report effectively. Paul demonstrates ideas, based on the Heuristic Software Test Model from Rapid Software Testing, that can be directly applied or adapted to your environment. In this hands-on tutorial, you’ll be given a product to test. Start by creating three raw lists (Product Coverage Outline, Potential Risks, and Test Ideas) that help ensure...

In many organizations, agile development processes are driving the pursuit of faster software releases, which has spawned a set of new practices called DevOps. DevOps stresses communications and integration between development and operations, including rapid deployment, continuous integration, and continuous delivery. Because DevOps practices require confidence that changes made to the code base will function as expected, automated testing is essential. Join Jeffery Payne as he discusses the unique challenges associated with integrating automated testing into continuous integration/...

Finding time to learn test techniques, mentor other testers, grow application knowledge, and cross-train your team members is a daunting task with a complicated recipe. What if you could do these things while testing and finding bugs? Enter Pair Testing. What’s that? Well, maybe you’ve heard of pair programming. It’s like that—only you’re testing rather than programming. And it’s the secret sauce of agile testing because it makes your routine, bland testing so much more fun! Testers on Jess Lancaster’s team use pair testing not only to make better software but also to foster better...

Artificial intelligence (AI) is the most important technology for software testers to understand today. All software will soon have AI-powered components, and they are unlike anything you’ve ever tested before. As risky as AI can be, it is a powerful weapon for testers to solve some of their most painful testing challenges today. The web was great, mobile is interesting, but AI will truly change the way you build and test all software. Jason Arbon gives a brief introduction to AI and machine learning (ML) so you can nod your head knowingly when the topics come up. Explore how products that...

Over the past twenty years, Mary Thorn has had the opportunity to work at many startups, creating several QA/test departments from scratch. For the past ten years, she has done this in agile software companies. Recently Mary moved from leading small agile test organizations to leading a large agile test organization. She has learned how to lead agile testers and agile testing in large contexts. Mary takes you through what she has learned, identifies the keys to transitioning your test organization as it grows, and discusses the techniques required to lead it through the changes. Agile...

Classical test process improvement is often not today’s best solution. With virtualization, SOA, web, cloud, mobile, and integration with social media, the way we develop, test, and manage has drastically changed. Jeroen explores why Agile, context-driven testing, SCRUM, continuous integration/development and DevOps require a flexible and pragmatic context-driven approach to test improvement. Context-driven test improvement is organized on two levels. [1] The improvement architecture level starts by clarifying the goal, scope, and context. This results in the improvement approach, a...

Why do test automation implementations often result in budget and schedule overruns and often diverge from the test objectives they were meant to support? Because test automation is a form of software development—but rarely is treated as such. Lee Barnes discusses how the application of software development practices, specifically agile principles, to test automation efforts helps ensure a reliable and maintainable solution that is closely aligned with both testing AND business objectives. Benefits of incorporating agile practices in test automation development include: increased customer...

Manual testing is becoming less needed as more companies realize the time and money to be saved by automating testing. But let’s face it. Test automation is scary and still new to many QA organizations, many of whom are unclear about where to begin. Do you need a degree or significant development training to write automated tests? What are the programming basics and required tools that a tester needs to know? Leo Laskin answers these questions with data on untrained Selenium and non-technical users and the time it took them to learn Selenium. Discover the programming basics needed to be...

Have you ever been dragged into a production emergency that severely drains deadlines, budgets, morale, and weekends only to find out—yet again—that the problem is related to application stability and performance under load? Building a culture that embraces proactive and well-planned performance testing is no small feat. Tom Poirier shares a journey that begins with clarifying enterprise performance requirements, performing competitive analysis, cost-justifying purchases, and closing the deal with senior management. Tom walks through practical challenges including technical difficulties,...

James Koch demonstrates how to apply test-driven development and continuous integration using Appium, an industry leading open-source automation tool. Appium was inspired by Selenium for web browser testing. Their philosophy—Why do anything different for mobile? Appium allows you to run tests without having to add any third party framework or extension into your application, so you are testing the same application you are shipping! With faster release cycles, the need for quality testing is more necessary than ever. Tools like Appium leverage continuous integration and test-driven...

Traditional performance testing practices don't scale when you begin delivering software using cloud computing and DevOps. Troy Marshall shares how Ellucian transformed their performance testing program using the same principles DevOps uses to deliver software. It isn't enough just to automate the execution of performance tests. You must continually optimize every step—from building the performance test tool infrastructure, configuring test scripts and scenarios, collecting metrics, and reporting results. In addition, by using cloud computing to implement performance testing, you...

Cloud computing continues to grow rapidly, and as everything moves to the cloud, testing must adapt and move to the cloud as well. The cloud enables building solutions that scale larger and faster than before—back when adding capacity in data centers took weeks or months. Now applications can be deployed to cloud servers not in days but minutes. The cloud enables new approaches that increase testing efficiency and quality while decreasing total testing time. Tom Chavez discusses the migration of applications to the cloud, and the new tools and services there—from web browser functional...

The most critical component in capacity planning and performance engineering is the Workload Model, which defines the workflows, throughputs, and target performance your system must support at peak loads. As critical as it is, it can be difficult and particularly challenging to predict loads for new applications, features, or events. A typical approach starts with a wild-guess worst-case scenario—but overestimates waste time and money, and force you to engineer applications and infrastructure to support unrealistic loads. Low estimates can result in terrible customer experiences, lost...