Skip to main content

Test Design

Tutorials

MB A Rapid Introduction to Rapid Software Testing
Michael Bolton, DevelopSense
Mon, 09/28/2015 - 8:30am

You're under tight time pressure with barely enough information to proceed with testing. How do you test quickly and inexpensively, yet still produce informative, credible, and accountable results? Rapid Software Testing, adopted by context-driven testers worldwide, offers a field-proven answer to this all-too-common dilemma. In this one-day sampler of the approach, Michael Bolton introduces you to the skills and practice of Rapid Software Testing through stories, discussions, and “minds-on” exercises that simulate important aspects of real testing problems. The rapid approach isn't just testing with speed or a sense of urgency; it's mission-focused testing that eliminates unnecessary work, assures that the most important things get done, and constantly asks how testers can help speed up the successful completion of the project. Join Michael to learn how Rapid Testing focuses on both the mind set and skill set of the individual tester, using tight loops of exploration and critical thinking skills to help continuously re-optimize testing to match clients' needs and expectations. NOTE: Participants are strongly encouraged to bring a Windows-compatible computer to the class.

Read more
MG Exploratory Testing Explained
Paul Holland, Doran Jones, Inc.
Mon, 09/28/2015 - 8:30am

Exploratory testing is an approach to testing that emphasizes the freedom and responsibility of testers to continually optimize the value of their work. Exploratory testing is the process of three mutually supportive activities—learning, test design, and test execution—done in parallel. With skill and practice, exploratory testers typically uncover an order of magnitude more problems than when the same amount of effort is spent on procedurally-scripted testing. All testers conduct exploratory testing in one way or another, but few know how to do it systematically to obtain the greatest benefits. Even fewer can articulate the process. Paul Holland shares specific heuristics and techniques of exploratory testing that will help you get the most from this highly productive approach. Paul focuses on the skills and dynamics of exploratory testing, and how it can be combined with scripted approaches.

Read more
ML High-Volume Combinatorial Test Automation NEW
Bj Rollison, Testing Mentor
Mon, 09/28/2015 - 1:00pm

Imagine you are assigned to test a feature with twenty independent parameters, with five possible states for each parameter. The total number of possible combinations is greater than a half trillion. At one test per millisecond, it would take more than 3,000 years to test all possible combinations. Bj Rollison explains that historical evidence shows that the vast majority of errors are caused by the interaction between two parameters. Pairwise testing is a systematic technique using powerful tools to efficiently produce a pairwise subset of all parameters. This technique quickly uncovers hard-to-find bugs while improving code coverage. Unfortunately, most discussions about pairwise tests only consider this technique on small-scale projects. However, its real power is revealed when we are faced with complex features that have multiple input parameters that interact. Bj introduces advanced modeling concepts to model input parameters. Using simple test framework, delegates will use a powerful, free tool to test a high volume of inputs.

Note: This hands-on tutorial assumes that delegates are familiar with the basic concepts of pairwise testing and a basic understanding of programming. Delegates are strongly encouraged to bring a laptop with Visual Studio or Visual Studio C# Express installed.

 

Read more
MN End-to-End Testing with the Heuristic Software Test Model
Paul Holland, Doran Jones, Inc.
Mon, 09/28/2015 - 1:00pm

You have just been assigned to a new testing project. So, where do you start? How do you develop a plan and begin testing? How will you report on your progress? In this hands-on session, Paul Holland shares test project approaches based on the Heuristic Software Test Model from Rapid Software Testing. Learn and practice new ways to plan, execute, and report on testing activities. You’ll be given a product to test and start by creating three raw lists—Product Coverage Outline, Potential Risks, and Test Ideas—that help ensure comprehensive testing. Use these lists to create an initial set of test charters. Employing “advanced” test management tools—Excel and whiteboards with Sticky Notes—you’ll create clear and concise test reports without using “bad metrics” (counts of pass/fail test cases, percent of test cases executed vs. plan). Look forward to your next testing project—or improve your current one—with new ideas and your new-and-improved planning, testing, and reporting skills.

Read more
TB Testing under Pressure: A Case for Session-Based Test Management NEW
Jon Bach, eBay, Inc.
Tue, 09/29/2015 - 8:30am

The nature of exploration, coupled with the ability of testers to rapidly apply their skills and experience, make exploratory testing a widely used test approach—especially when time is short. Unfortunately, exploratory testing is often dismissed by project managers who assume that it is not reproducible, measurable, or accountable. If you have these concerns, you may find a solution in a technique called Session-Based Test Management (SBTM), developed by Jon Bach and his brother James. In SBTM, testers explore an area of a product, framing their testing in time-boxed “sessions” meant to create a meaningful and countable unit of work. In this hands-on tutorial (laptop required), Jon guides you through the mechanics of session-based testing to help you discover if it’s something valuable for your project. Through practical open-ended testing exercises, you may discover some surprising things about how you perform under pressure and can see how your colleagues respond to the same challenges.

Participants are required to bring a laptop computer to this tutorial.

 

Read more
TC Getting Started with Risk-Based Testing
Dale Perry, TechWell Corp.
Tue, 09/29/2015 - 8:30am

Whether you are new to testing or looking for a better way to organize your test practices, understanding risk is essential to successful testing. Dale Perry describes a general risk-based framework—applicable to any development lifecycle model—to help you make critical testing decisions earlier and with more confidence. Learn how to focus your testing effort, what elements to test, and how to organize test designs and documentation. Review the fundamentals of risk identification, analysis, and the role testing plays in risk mitigation. Develop an inventory of test objectives to help prioritize your testing and translate objectives into a concrete strategy for creating tests. Focus your tests on the areas essential to your stakeholders. Execution and assessing test results provide a better understanding of both the effectiveness of your testing and the potential for failure in your software. Take back a proven approach to organize your testing efforts and new ways to add more value to your project and organization.

Read more
TD User Experience Testing: Adapted from the World of Design
Parimala Hariprasad, Amadeus Software Labs
Tue, 09/29/2015 - 8:30am

Have you ever entered a room in a new office and started to look for switches? Were you able to switch on the right light on your first attempt? Did you blame yourself for the failure? If you did, you became a victim of false blame, cursing yourself for the poor design of products. Sharing why testers must be aware of the psychology behind product design, Parimala Hariprasad talks about how design concepts—affordances, signifiers, natural mappings, and gulfs of execution—can help you become a better tester. Parimala highlights how designers and testers, working together, lead both to designing explorable systems and helping to build great products that incorporate concepts like immediate feedback and visibility. Key takeaways include learning the basics of design thinking, understanding design case studies, familiarizing yourself with the concept of natural mappings, and applying these lessons to user experience testing.

Read more
TE Fundamentals of Test Design
Lee Copeland, TechWell Corp.
Tue, 09/29/2015 - 8:30am

As testers, we know that we can define many more test cases than we will ever have time to design, execute, and report. The key problem in testing is choosing a small, “smart” subset—from the almost infinite number of tests available—that will find a large percentage of the defects. Join Lee Copeland to discover how to design test cases using formal black-box techniques, including equivalence class testing, boundary value testing, decision tables, and state-transition diagrams. Explore examples of each of these techniques in action. Don’t just pick test cases randomly. Instead, learn to selectively choose a set of test cases that maximizes your effectiveness and efficiency to find more defects in less time. Then, learn how to use the test results to evaluate the quality of both your products and your testing. Discover the test design techniques that will make your testing more productive.

Read more
TJ How Testers Master Github and Git
Wilson Mar, Results Positive
Tue, 09/29/2015 - 8:30am

Github, the new business card for professionals working with software, enables anyone to contribute to existing projects and create new projects. That's why interviewers look to Github to gauge a potential hire's creativity, popularity, capability, and tenacity. To collaborate with developers, today’s testers need Github. Source code for most open source projects is stored on Github.com. That's where issues are filed. Project documents are written within Github as plain-text marked up with formatting codes, and then processed into html for display on github.io. Join Wilson Mar as he examines the major Github repositories testers are expected to know. In this hands-on tutorial, learn special tips testers use to markup text and raise issues. Gain skill at commenting and editing test code increasingly mingled among procedural code. Learn to fork repositories and pull them into a Git client; then using the appropriate text editor, compare changes, add, commit, and push code back into Github for developers to pull.

Note: Delegates are strongly encouraged to bring a Windows or Mac computer to this tutorial.

 

Read more
TK Test Design for Better Test Automation SOLD OUT NEW
Hans Buwalda, LogiGear
Tue, 09/29/2015 - 1:00pm

When automated tests are cumbersome to maintain, we often view this as a technical problem. However, an often-overlooked factor is the role that testers play in making automation scalable and maintainable. Test design can help or hurt how automation engineers can implement tests efficiently. If tests are too detailed or lack focus, good automation becomes virtually impossible. In this tutorial—for both testers and automation engineers—Hans Buwalda addresses what it means for test design when tests are to be automated. See why successful automated testing is not so much a technical challenge as it is a test design challenge. Hans shares a template that you can follow to get your tests organized and ready for efficient automation. Whether you work on a traditional or agile project, join Hans to learn how techniques including action-based testing, behavior-driven development, and exploratory testing will help you achieve better test design and great automation results.

Read more
TL Pairwise Testing Explained
Lee Copeland, TechWell Corp.
Tue, 09/29/2015 - 1:00pm

Many software systems are required to process huge combinations of input data, all of which deserve to be tested. Since we rarely have time to create and execute test cases for all combinations, our fundamental problem in testing is how to choose a reasonably-sized subset that will find a large percentage of defects and can be performed within the limited time and budget available. Lee Copeland says that pairwise testing is the most effective—but not well-understood—test design technique to deal with this problem. The answer is not to attempt to test all combinations of all values for all input variables but to test all pairs of variables. This significantly reduces the number of tests that must be created and run but still finds a large percentage of defects. Lee demonstrates the effectiveness of pairwise testing through the use of orthogonal arrays, James Bach’s all-pairs algorithm, and Microsoft’s PICT tool. Learn to apply the pairwise testing technique as you work through a number of hands-on exercises.

Read more

Concurrent Sessions

W8 Service and Network Virtualization: Keys to Continuous Testing
Clint Sprauve, HP
Todd DeCapua, HP
Wed, 09/30/2015 - 1:45pm

Many development and test organizations must work within the confines of compressed release cycles, various agile methodologies, and cloud and mobile environments for their business applications. So, how can test organizations keep up with the pace of development and increase the quality of their applications under test? Clint Sprauve and Todd DeCapua describe how service virtualization and network virtualization can help your team improve speed and increase quality. Learn how to use service virtualization to simulate third-party or internal web services to remove wait times and reduce the need for high-cost testing infrastructures. Take back techniques to incorporate network virtualization into the testing environment to simulate real-world network conditions. Learn from Clint and Todd how the combination of service and network virtualization allows teams to implement a robust and consistent continuous testing strategy to reduce defects in production applications.

Read more
W9 Test the Tests: Using Fault Injection and Chaos Testing
Jay Kremer, Zoosk
Wed, 09/30/2015 - 1:45pm

Can your test automation actually find defects? Are there situations where your software will fail, but your automation will still report “pass”? How can you be certain that your automation does what it’s supposed to do? Jay Kremer asked himself all these questions when taking over as test manager for Zoosk, an international dating site with 27 million monthly customers. In searching for answers to these questions, Jay examined several different approaches and landed on chaos testing, the Netflix-developed approach that involves intentionally breaking the service to simulate failure scenarios. Learn how Jay adapted chaos testing for pre-production environments, identified and fixed faults in his own automation, and demonstrated the success of Zoosk’s automation solution to his management and engineering as a whole. If you want to prove to yourself and your team how reliable your automation is—and you are always looking for ways to respond faster—then this session is for you.

Read more
W12 Test Automation: The Special Cases
Hans Buwalda, LogiGear
Wed, 09/30/2015 - 1:45pm

Many functional tests of dialogs and web pages are done through the user interface, and the expected results of each test are clear. However, Hans Buwalda recognizes that some applications are “special” and pose challenges for automated testing. For example, oil exploration applications frequently produce complex 3D graphics output that is not easy to describe in a test case, let alone write the automation code. A game may implement randomized behavior, and a test must know where that behavior is in that game and where it needs to go next.

Read more
W14 Put Models at the Heart of Testing
Paul Gerrard, Gerrard Consulting Ltd.
Wed, 09/30/2015 - 3:00pm

Models exist all around us. To the untrained, models appear rather esoteric. In fact, our brain is a fantastic modeling engine. How do you think we can move without collision, use language, reason, and make sense of our world? Paul Gerrard explains how models underpin the common test methods. We testers can use models at every level of our work—to simplify the testing problem, to scope the testing tasks, to communicate with stakeholders and peers, to inform test design/selection decisions, and to measure coverage or progress in our work.

Read more
T2 Improve Testing with a Zone Defense
Pamela Gillaspie, TestPlant
Thu, 10/01/2015 - 9:45am

At one time or another, every tester hears the dreaded question, “Why didn’t you guys catch these bugs?” We all have some standard responses, and they are most likely true). But what can we learn about our testing when we look beyond the easy answers? Pamela Gillaspie proposes that the key to improving your testing is determining the areas where bugs are slipping past your defenses. For her team, the practice is a lot like basketball. If you group the bugs into zones, you can devise a strategy to cover those zones more effectively. Some zones need a different testing approach than you’ve used; others might reveal a need for closer communication. Join Pamela as she shares her experience as defensive coordinator, addressing the developers’ playbook (What kinds of recurring problems do we see?), trick plays (The user is doing what?), and penalties (That wasn’t in the requirements!).

Read more
T9 Automate REST Services Testing with RestAssured
Eing Ong, Intuit, Inc.
Thu, 10/01/2015 - 11:15am

Many browser, UI, and Java-based tools and frameworks can help you test REST services. However, in the world of continuous integration and delivery, manual UI- or browser-based tools typically fall short in many aspects—from early test development to developer support. When using Java-based libraries such as HttpClient, much code has to be written for all aspects of a web service call. These extensions or wrappers tend to be complex, hard to read, and difficult to maintain. This is where RestAssured comes in. RestAssured is an open source Java DSL for testing REST-based services, making test code more readable, easier to write, and cheaper to maintain. Learn how easily you can write HTTP get and post requests as well as more complex scenarios involving session management, authentication, and (de)serialization of objects. Take back good practices and an open source command line tool that can help you jumpstart your RestAssured testing.

Read more
T11 Six Thinking Hats for Designing Exploratory Testing Charters
Xiaomei Tai
Thu, 10/01/2015 - 11:15am

Before starting an exploratory testing session, you should create a charter that defines the range and the goal of your effort. Because a good charter usually results in a productive testing session, charter design is an important and creative skill in session-based exploratory testing. During her years of coaching, Xiaomei Tai has found that many testers have difficulty creating high-quality charters, so she likes to share the way of using Edward de Bono’s Six Thinking Hats approach in charter design. For example, use the blue hat to generate initial ideas for intake sessions; use the white hat to create collecting-information charters for survey sessions; use the black hat and the green hat to get some negative or creative testing charters for deep coverage sessions; and so on. In this session you will practice using the six thinking hats in an interesting exercise, and then compare and discuss the designs of the other delegates. Take away the benefits of applying the six thinking hats in charter design.

Read more
T12 A Robust Big Data QA Framework
Sushmitha Geddam, Cognizant Technology Solutions
Karen Pruitt, Comcast Corporation
Thu, 10/01/2015 - 11:15am

Big Data, a term to describe the exponential growth and availability of data, has become increasingly more important to businesses due to large-scale and location-aware social media and mobile applications. These applications generate massive amounts of data, much of it in real-time. This drives the need for scalable, real-time platforms, which can process humongous data volumes and can derive real time analytics. Unfortunately, Big Data may contain bad data which causes organizations to make poor decisions. Even worse for testers is the fact that Big Data testing is challenging due to a[WU3] embraces complex technology stack, numerous data sources, real time events and streams, complex transformations, and more. Karen Pruitt and Sushmitha Geddam describe the critical testing of focal areas with[WU4]  in Big Data batching and real-time data processing. They describe frameworks that support Big Data testing and help frameworks that support Big Data testing which helps to strengthen data quality. Join this session to learn how to handle big data integration challenges and the skill sets you’ll need to be successful. Take away valuable insights for testing your Big Data implementations.te

Read more
T14 Integration Testing as Validation and Monitoring
Melissa Benua, PlayFab, Inc.
Thu, 10/01/2015 - 1:30pm

In the world of software-as-a-service, just about anyone with a laptop and an Internet connection can spin up their very own cloud-based web service. Software startups, in particular, are often big on ideas but small on staff. This makes streamlining the traditional develop-test-integrate-deploy-monitor pipeline critically important. Melissa Benua says that an effective way to accomplish this is to reduce the number of different test suites that verify many of the same things for each stage. Melissa explains how teams can avoid this by authoring the right set of tests and using the right frameworks. Drawing on lessons learned in companies both large and small, Melissa shows how teams can drastically slash time spent developing automation, verifying builds for release, and monitoring code in production—without sacrificing availability or reliability.

Read more