STARWEST 2019 - Software Tester

Testing is fundamentally associated with understanding requirements and risk. We use test design techniques to deliver what is required by our customers, and we use testing to help our customers assess risk at every stage of the software’s life. These goals give us a focus for what to test and what to report, but they also present tricky and changing targets. Join Isabel Evans to practice using test design techniques in multiple ways, not just to design tests for execution, but also to understand risks, clarify requirements, and report the information that is most useful to our team and...

Imagine this … As soon as any developed functionality is submitted into the code repository, it is automatically subjected to the appropriate battery of tests and then released straight into production. Setting up the pipeline capable of doing just that is becoming more and more common and something you need to know about. But most organizations hit the same stumbling block—just what IS the appropriate battery of tests? Automated build architectures don't always lend themselves well to the traditional stages of testing. In this hands-on tutorial, Melissa Benua introduces you to key test...

Do you want to take your testing skills to the next level? Are you trying to stay relevant on an agile team where testing is shifting to the left on the project timeline? Do you want to help your organization reap the full benefits of testing earlier? Then join Tariq King to explore the fundamentals of unit testing so you can find bugs as soon as they happen and do more thorough, targeted testing during software development. This introductory session is for everyone—of all programming skill levels. Learn how to apply program-based techniques such as testing by looking, automated unit...

According to the 2018/2019 World Quality Report, the number one challenge in applying testing to agile development is overcoming the challenges of creating, managing, and maintaining test environments and test data. Over 48% of respondents had issues with test data. As our systems complexity and time to market demands have increased, the appetite for resolving the test data issue can be diminished or be viewed as test data doesn’t really matter. Join Julie Gardiner as she shares the good, bad and ugly of test environments and data, defines an approach to establish where you are in terms of...

Containers. Every manager thinks they want them, but few teams have experience in knowing what to DO with them. Used thoughtfully, containerization of your services can transform the way your organization thinks about testing. Gone can be the days of maintaining X different compute environments with Y different configurations. Imagine instead spinning up just the code you need, on the machine type it needs, and only for as long as you need it. In this technical training, Melissa will walk through what containerization means for a legacy code base attempting to practice continuous...

The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...

Communication is at the heart of our profession. If we can’t convey our concerns in ways that connect with key members of the project team, our contribution is likely to be ignored—no matter how advanced our testing capabilities are. Because we act in an advisory capacity rather than being in command, our power to exert influence is almost entirely based on our communication skills. Join Julie Gardiner as she draws on techniques from psychology and marketing to help you get your message across. With people suffering information overload and deluged with emails, it is more important than...

Do you have access to lots and lots of test, development, app, and service data—really big data—from client and cloud service log files, test execution results, and more? Then, you have a great opportunity to begin using data analytics and machine learning (ML) to gain new product quality insights. Bring your laptops and your sense of discovery as Eun Chang introduce analysis techniques and ML tools to help you develop new and potentially groundbreaking insights. First, she will present a fast-paced statistics primer for those with no prior data exploration experience and others looking...

Knowledge of Selenium, the industry-standard tool for testing web applications, is a much sought after skill in today’s world of test automation. If you want to learn Selenium, then this full-day tutorial provides a great start. Max Saperstone shows you how to build test automation using Selenium. But he doesn’t stop there. He uses his years of experience to show you how to build automation that is clean, robust, and easy to maintain. Max introduces other tools that work with Selenium to help manage the data used to drive your tests, evaluate JavaScript-heavy applications, manage your test...

Technologies, testing processes, and the role of the tester have evolved significantly in the past few years with the advent of agile, DevOps, and other new technologies. It is critical that we testing professionals evaluate ourselves and continue to add tangible value to our organizations. In your work, are you focused on the trivial or on real game changers? Jennifer Bonine describes critical elements that help you artfully blend people, process, and technology to create a synergistic relationship that adds value. Jennifer shares ideas on mastering politics, maneuvering core vs. context...

Software development is trending toward building systems using small, autonomous, independently deployable services called microservices. Leveraging microservices makes it easier to add and modify system behavior with minimal or no service interruption. Because they facilitate releasing software early, frequently, and continuously, microservices are especially popular in DevOps. But how do microservices affect software testing and testability? Are there new testing challenges that arise from this paradigm? Or are these simply old challenges disguised as new ones? Join Tariq King as he...

Anyone who has ever attempted to estimate software testing effort realizes just how difficult the task can be. The number of factors that can affect the estimate is virtually unlimited. The keys to good estimates are understanding the primary variables, comparing them to known standards, and normalizing the estimates based on their differences. This is easy to say but difficult to accomplish because estimates are frequently required even when we know very little about the project—and what we do know is constantly changing. Throw in a healthy dose of politics and a bit of wishful...

In many organizations, agile development processes are driving the pursuit of faster software releases, which has spawned a set of new practices—DevOps. DevOps stresses communications and integration between development and operations, including rapid deployment, continuous integration, and continuous delivery. Because DevOps practices require confidence that changes made to the code base will function as expected, automated testing is essential. Join Jeffery Payne as he discusses the unique challenges associated with integrating automated testing into continuous integration/continuous...

With the advent of frameworks like Angular, React, and Vue, the landscape of application performance has changed significantly in terms of testing and measurement. Gone are the days of measuring response time as a single value based on back-end performance. In modern web and mobile applications, additional layers need to be peeled apart at the front end to truly understand its performance characteristics. Traditional approaches to performance testing are no longer sufficient to provide a delightfully responsive user experience. Join Kaushal Dalvi as he details new developments in the...

To be most effective, leaders—including development and testing managers, ScrumMasters, product owners, and IT managers—need metrics to help direct their efforts and make informed recommendations about the software’s release readiness and associated risks. Because one important evaluation activity is to “measure” the quality of the software, the progress and results of both development and testing must be measured. Collecting, analyzing, and using metrics are complicated because developers and testers often are concerned that the metrics will be used against them. Join Mike Sowers as he...

A decade ago Microsoft had over twelve thousand full-time testers, and when you added up all the contract and outsourced testers too, there were more software test engineers than developers. The test automation solutions alone had more than a hundred million lines of code. However, that process was built for a company that would release a new version of a monopoly-scale product once every three years and ship it on a CD. That world had already begun to change, and Microsoft was missing the boat. When Microsoft tester Ken Johnston first encountered agile development and DevOps, he realized...

A software test is no better than the data that drives it. Fuzz testing is a great way to find buggy, exploitable, or otherwise bad code – and if you’re working with a native application that operates on file input, it’s a solved problem. Grab AFL or some other all-in-one suite, hit go, and profit! But what about web services? What about managed applications? For a service-based developer, fuzz testing your HTTP serving layer isn’t all that interesting if you’re running on the latest version of Apache. Fuzz testing your application along its interface boundaries, though? Very interesting...

Because of its specialized nature, many aspects of application security testing are often assigned to testers from another team or another company, and they may be brought in to perform a point-in-time assessment prior to a release. Your team is interested in implementing continuous deployment, and automation seems like the obvious answer. But when attempting to automate your security tests, you may run into a wide variety of challenges beyond simply adding a tool into your build system. Josh Gibbs will discuss how to choose what to test, how to avoid slow tests, how to keep...

Nonfunctional tests like performance tests are often left until the end of the delivery cycle because they can be expensive in terms of time, resources, and effort. However, performance issues can be difficult to resolve when found late in the software development lifecycle. Apache JMeter is an open source tool designed to load test functional behavior and measure performance. JMeter can be used to develop, manage, and execute load and performance tests while the code is being developed, rather than waiting to do performance testing until just before release. By using it early in your...

Testing artificial intelligence- and machine learning-based systems presents two key challenges. First, the same input can trigger different responses as the system learns and adapts to new conditions. Second, it tends to be difficult to determine exactly what the correct response of the system should be. Such system characteristics make test scenarios difficult to set up and reproduce and can cause us to lose confidence in test results. Yury Makedonov will explain how to test AI/ML-based systems by combining black box and white box testing techniques. His "gray box" testing approach...

By now you have probably heard that there should be a healthy tension between the product and engineering teams. The key word there is "healthy"—when this relationship is unhealthy, silos tend to form, ideas may be thrown over the wall, and a lack of ownership can develop. But what exactly goes into making this relationship work? Vidya Dinamani and Heather Samarin will explore this question and provide the product perspective in not just identifying and overcoming the root causes of most dysfunctions, but getting on the path to thriving. They will share examples from their...

The internet of things (IoT) brings connectivity to a range of previously non-internet-enabled physical devices and real-world objects. This shift has an impact testing—changing what we test, when we test, and the way we test. For one thing, once you’re in the real world, the number of possible issues explodes due to environmental conditions. Just like a race car must adjust its tires for different track conditions, IoT devices must account for environmental factors such as temperature and humidity to prevent unanticipated failures. Jane Fraser believes that for the IoT to be successful,...

A big problem with test automation on any platform or operating system is synchronizing test automation interactions with the UI. It is challenging to know when the UI is ready for the next automated click(). Traditional black box tools try to address this problem by explicit or implicit waiting, but this technique is slow and error-prone. A new generation of test frameworks, starting with Espresso, understands the internals of the app and synchronizes interactions only when the view is ready, making the framework very fast and reliable. This same technique is making Cypress and...

The approaches to testing are continuously evolving as we try to keep up with the application needs of today’s users. Our industry is facing a new paradigm where AI is helping achieve scale, coverage, and business impact for many organizations that have been primarily focused on finding defects and refactoring test cases. Are your teams struggling to figure out how to leverage AI to improve their testing? To successfully do this, you must first understand one of AI’s underpinning foundations: data mining. Lorna Smyth will explain the fundamentals of data mining and how it is the...

Once upon a time, in a land far away, application performance was a differentiator in the market. But in today's competitive landscape, having a highly responsive and scalable application is a basic expectation. Performance no longer lives on the fringe of the quality world, and it is becoming more common for organizations to include performance testing as part of their CI/CD pipelines. However, engineers are faced with a common dilemma: Do they implement small and simple performance tests that may not be very realistic but are fast and reliable in the build pipeline, or do they...

In a world of continuous delivery, deployments happen faster than ever. But while every organization wants to move faster, many teams struggle to keep up with digital consumers’ expectations for quality. Join Philip Soffer to learn how smaller companies can reduce risk in their deployment processes by combining automation with human insight and performing functional and nonfunctional tests in a synchronized process. Using real-world examples, Philip will discuss the interactions among continuous integration, automated functional testing, crowd testing, feature flagging, and...

Any business that uses technology to interface with or provide service to their customers, suppliers, and partners requires customer-facing applications that have exceptional quality. The assurance of business outcomes must become an imperative for IT professionals, which means we must learn how to continually engineer quality into every product and process to provide confidence that our technology solutions protect the company brand. However, delivery within the required time frames is continually constrained by the quality, relevance, quantity, and security of test data. Join...

Many organizations have embarked on a digital transformation in order to stay competitive and gain market share. Whether it is enabling access to legacy applications via a web front end or a migration to the cloud, the journey is complex and requires comprehensive testing. To begin with, most systems use responsive web design to accommodate for the myriad mobile devices retail customers use. How do you test for interoperability across these multiple digital footprints? What about UI testing? ADA compliance? And many digital transformations make use of a microservices architectures using...