STARWEST 2017 - Test Techniques
Sunday, October 1
Agile Tester Certification (2-Day)
Software Tester Certification—Foundation Level (3-Day) - SOLD OUT
Fundamentals of Agile Certification—ICAgile (2-Day)
Requirements-Based Testing Workshop (3-Day)
Mobile Application Testing (2-Day)
Monday, October 2
Get Started with Risk-Based Testing
Whether you are new to testing or looking for a better way to organize your test practices, understanding risk is essential to successful testing. Lee Copeland describes a general risk-based framework—applicable to any development lifecycle model—to help you make critical testing decisions earlier and with more confidence. Learn how to focus your testing effort, what elements to test, and how to organize test designs and documentation. Review the fundamentals of risk identification, analysis, and the role that testing plays in risk mitigation. Develop an inventory of test objectives to...
Selenium Test Automation: From the Ground Up
Selenium expertise, the industry-standard tool for testing web applications, is a much sought after skill in today’s world of test automation. Many believe it is a must-have tool for test engineers. If you want to learn Selenium, then this tutorial is a great start. Cheezy Morgan shows you how to build test automation using Selenium. But he doesn’t stop there. He uses his years of experience to show you how to build automation that is clean and easy to maintain. Cheezy introduces other tools that work with Selenium to help manage the data used to drive your tests, work with JavaScript...
Better Test Design for Great Test Automation
When we discover—often late in an automation effort—that the automated tests are cumbersome and costly to maintain, we often view this as a technical problem for the automator to solve. However, an often-overlooked cause is the role that testers who designed these tests play in making automation scalable and maintainable. In this interactive tutorial for both testers and automation engineers, Hans Buwalda explores how better test designs not only will result in much improved test automation but also can make the difference between automation success and failure. See why successful...
Implement BDD with Cucumber and SpecFlow
We’ve all been there. We work incredibly hard to develop a feature and design tests based on written requirements. We build a detailed test plan that aligns the tests with the software and the documented business needs. And when we put the tests to the software, it all falls apart because the requirements were changed without informing everyone. But Mary Thorn says help is at hand. Enter behavior-driven development (BDD) and Cucumber and SpecFlow, two tools for running automated acceptance tests and facilitating BDD. Mary explores the nuances of Cucumber and SpecFlow, and shows you how to...
Exploratory Testing: Explore with Intent
NewThe skill to self-manage our testing work and our learning—making learning and reflection a habit—is what differentiates skilled exploratory testing from simply putting random testing activities together. Maaret Pyhäjärvi says that exploratory testing treats test design, test execution, and learning as parallel, mutually supportive activities—with the goal of discovering things that we don’t know we don’t know. Exploratory testing frames our thinking about the system and engulfs the idea of creating artifacts to support testing. Join Maaret to experience exploratory testing hands-on and...
Harnessing Your Automation: Choose Your Own Adventure
You've seen this before. The project requirement states that You will be responsible for developing test automation that covers ______. And it is rarely as simple as it first seems. With upstream and downstream considerations, tool changes, and course correction at every juncture, how can you possibly improve efficiency and quality, and still plan for and stay on target during the process of developing and implementing a robust test automation harness? Dawn Code will guide you through the steps of building test automation that can suit a variety of needs. Following a Choose Your Own...
Unit Testing: What Every Tester Should Know
Do you want to take your testing skills to the next level? Are you trying to stay relevant on an agile team where testing is shifting to the left on the project timeline? Do you want to help your organization reap the full benefits of testing earlier? Then join Tariq King to explore the fundamentals of unit testing so you can find bugs as soon as they happen and do more thorough, targeted testing during software development. This introductory session is for everyone—of all programming skill levels. Learn how to apply program-based techniques such as testing by looking, automated unit...
Tuesday, October 3
A Rapid Introduction to Rapid Software Testing
You're under tight time pressure with barely enough information to proceed with testing. How do you test quickly and inexpensively—yet still produce informative, credible, and accountable results? Rapid Software Testing, adopted by context-driven testers worldwide, offers a field-proven answer to this all-too-common dilemma. In this one-day sampler of the approach, Michael Bolton introduces you to the skills and practice of Rapid Software Testing through stories, discussions, and “minds-on” exercises that simulate important aspects of real testing problems. The rapid approach isn't just...
Fundamentals of Software Test Design
As testers, we know that we can define many more test cases than we will ever have time to design, execute, and report. The key problem in testing is choosing a small, “smart” subset—from the almost infinite number of tests available—that will find a large percentage of the defects. Join Lee Copeland to discover how to design test cases using formal black-box techniques, including equivalence class testing, boundary value testing, decision tables, and state-transition diagrams. Explore examples of each of these techniques in action. Don’t just pick test cases randomly. Learn to selectively...
End-to-End Testing with the Heuristic Test Strategy Model
You have just been assigned a new testing project. Where do you start? How do you develop a plan and begin testing? How will you report on your progress? Paul Holland shares new test project approaches that enable you to plan, test, and report effectively. Paul demonstrates ideas, based on the Heuristic Software Test Model from Rapid Software Testing that can be directly applied or adapted to your environment. In this hands-on tutorial, you’ll be given a product to test. Start by creating three raw lists—product coverage outline, potential risks, and test ideas—that help ensure...
How to Break Software: Robustness Edition
Have you ever worked on a project where you felt testing was thorough and complete—all features were covered and all tests passed—yet in the first week in production the software had serious issues and problems? Join Dawn Haynes to learn how to inject robustness testing into your projects to uncover those issues before release. Robustness—an important and often overlooked area of testing—is the degree to which a system operates correctly in the presence of exceptional inputs or stressful environmental conditions. Dawn shows you how—by expanding basic tests and incorporating specific...
Shift Left to Test User Experience
Preview NewIn today’s environment, the user experience (UX) is overwhelmingly important—and is not just about the product. UX describes all facets of a person’s interactions with and reactions to the product, the organization that supplies it, and the environment in which it is experienced. Isabel Evans says that in order to focus our tests appropriately, it is vital that we testers understand our users’ experiences. We need to explore and measure human, business, and societal impacts of products we develop, and how those are underpinned by technical qualities. Unless we “shift left” as...
Building Your Mobile App Quality and Test Strategy
PreviewLet’s build a mobile app quality and testing strategy together. Whether you have a web, hybrid, or native app, building a quality and testing strategy means (1) knowing what data and tools you have available to make agile decisions, (2) understanding your customers and your competitors, and (3) testing your app under real-world conditions. Jason Arbon guides you through the latest techniques, data, and tools to ensure the awesomeness of your mobile app quality and testing strategy. Leave this interactive session with a strategy for your very own app—or one you pretend to own. The...
Wednesday, October 4
Mind Maps for Testers
Do you ever sit in test strategy or test plan review sessions and get little or no participation from others? Are you looking for a better way to communicate important information around the test plan or strategy? Do you want your stakeholders to understand and engage in providing feedback and suggestions? Jennifer Bonine and Karen Schaefer have a solution for you—a mind mapping tool that can help you address these questions. A Mind Map is a visual approach used to help organize information rather than a text outline or list. Jennifer and Karen will help you download a free mind mapping...
Move from Scripted Manual Testing to Scenario-Based Testing
PreviewThink of manually executed test scripts—like pulling a wagon without wheels. Eventually the wagon will make it to the final destination, but the journey itself will be long and painful. Many people think test scripts are outdated because of the long, painful process of writing and running them. Andrea Fox says that their analytics team shared this way of thinking. To make things worse, the team also was dealing with defects being constantly introduced because the restrictive scripts were not catching the issues. Change was vital to provide more efficiency in manual testing, as well...
Automate Your API Testing Process
PreviewCreating automated tests for your team stories, integration, or regression test cycles within agile sprints is almost every tester’s top challenge. Usually it consumes many hours and requires a great deal of effort to achieve, especially in complex and large agile projects. Teams need to deliver software as quickly as they can while producing the best possible product quality. Talal Ibdah shows how you can achieve these goals and automate your API functional and performance tests; define test environments and configuration files; make chaining requests; continuously deliver your...
Testing RESTful Web Services
PreviewA lot of folks doing testing (QAs, BAs, and Devs alike) are experienced with testing applications through the front end—a graphical user interface or a mobile app. However, Hilary Weaver-Robb says that with this type of testing we often miss the internal web services and APIs that power those applications. Integration or web service tests are right in the middle of the Testing Pyramid, so to ensure adequate coverage it’s vital for testers to know how to test at that level. Thankfully, to test web services we can apply many of the same principles we already know. Hilary focuses on...
Machine Learning: Will It Take Over Testing?
PreviewMachine learning (ML), a branch of artificial intelligence, is gaining widespread adoption and interest on software development projects. Paul Merrill says that ML isn't typical programming. Algorithms can be changed and checked for accuracy at runtime to “learn” from data. Some companies are already generating and executing test cases using machine learning algorithms. It is projected that significant areas of the labor force—16 percent in transportation and 9 percent of healthcare—could see job cuts in the next few years. So it's time to start thinking: Might testing be on that...
Thursday, October 5
Leverage Big Data and Analytics for Testing
PreviewSabermetrics turned the baseball world upside down by challenging decades-old measures of individual performance and their perceived linkage to team success. After cementing their legacy as the Lovable Losers for 108 years, the Chicago Cubs were able to leverage a data-driven approach to finally win a World Series. A high-school football coach, devoted to statistical analysis, has won three state championships—by never punting. Formula 1 racing teams collect staggering amounts of telemetry data from their race cars for the purpose of eking out seconds during the course of a race....
Test Cases Are Dead, Long Live Checklists
PreviewFor testers, creating tests is critical for a healthy testing process, so it is painful to see how boring writing test cases can be. In classical approaches, test cases are overcrowded with words—mostly project information that everyone already knows. What test cases don’t have is distilled information that allows testers to focus on the core functionality. Hipo has recently changed their approach to writing test documentation. Ömürden Cengiz believes that checklists are poised to take the throne from test cases, especially among startups and client-servicing shops where projects...
The Secrets to Blazing-Fast, Rock-Solid Mobile Acceptance Testing
PreviewAutomated acceptance testing is an essential component of a healthy agile software development process. Unfortunately, attempts to adopt this approach in mobile often result in slow, brittle, and highly complex device tests, based on UI automation. This approach harms confidence in mobile development. Automation used in this way often creates more problems than it solves, leaving development teams and businesses wondering where it all went wrong—often blaming tools rather than their approach. Revisiting fundamentals via a simple example of a mobile app, Paul Stringer helps us re-...
Get Involved Early: A Tester’s Experience with Requirements
PreviewAlthough requirements provide valuable information that informs and shapes testing, sometimes the information provided is incomplete or unclear. Join Julie Lebo as she shares her experience with requirements engineering and how she has integrated her testing group into the requirement process. She believes testers are a valuable asset to the requirement process, and their involvement can improve quality in many ways including finding bugs earlier in the lifecycle, gaining a deeper understanding of their project and product, and writing tests that provide more value to the...
User Experience Testing—with the Pilots at 18,000 Feet
All testers have users with unique needs. Are these needs included in your requirements? Lisa denDekker-Redemann says that was not always the case at UPS. Were we testing the mobile systems that our crew members use like we should? Sometimes to get it right, we have to go out into the wild—or in our case, out into the wild blue yonder. To get the whole story (and awesome test coverage), we boarded an aircraft to design scripts and test live 18,000 feet in the air. We found real conditions our users face that didn’t make the user stories and test conditions. Lisa shares why she went into...
Say Goodbye to Flaky Selenium Tests
PreviewSelenium has an industry reputation of being a “flaky” tool where individual tests pass, then fail—sometimes with no production changes at all. Such flakiness in your test suites can be extremely difficult, time consuming, and frustrating to debug. The vast majority of these issues stem from using either bad locators or bad wait conditions. But both of these root causes can be addressed by implementing the right framework for your Selenium tests. Craig Schwarzwald shares the most important concepts in creating such a Selenium framework. He has proved that using a framework...
Mobile Testing: Where to Start Your Journey
PreviewYour company has decided to move into the 21st century and is developing a shiny new mobile app. But you don’t know where to start. How many devices do you need to test? Can you take existing tests and modify them? How do you account for conditions such as loss of connectivity, a virtual keyboard, and new user interactions? What about the questions you don’t even know to ask? Join Bambi Rands as she introduces you to the world of mobile testing. Learn from Bambi’s first-hand experience testing mobile apps and building a mobile test strategy. Discuss the shift from testing web...
Globalization Testing for Cloud Products
PreviewEvery year, VMware has hundreds of releases for its virtualization products that cover data centers, networking, storage, cloud management, and digital workspace. Testing many different products while adapting to their development lifecycle introduces some special challenges for the product globalization team. Vincent Truong describes the processes and testing techniques a large-size software company needs to correctly support the globalization of its products. Vincent examines the agile process of globalization—internationalization and localization—testing and how the test...
Use Model-Based Testing to Navigate the Software Forest
PreviewEven seemingly simple software systems can be a dense forest of intersecting logical pathways which may leave you wondering if your testing was robust enough. Traditional test cases are flawed since they only execute the pathways the tester considered at the time the test case was written, and they will execute the same way—every time and without variation. Jon Fetrow shows how, using model-based testing, you can create a map of your software forest and answer the question “Did you test enough?” Jon discusses the use of models to catch defects in the requirements and design phase...
Get Ready for Cloud Testing
PreviewIn the past few years, deployment of applications in the cloud has become an industry standard. Meher Nori believes that it is very important for QA/testing organizations to understand the impact the cloud may have on them and prepare accordingly. The impact primarily involves a change in the testing strategy, and two items become very important. (1) Security testing and elasticity/scalability testing—new types of tests which previously were not so important—need to be created and executed once an application is hosted in the cloud. (2) Some traditional tests—availability testing...