Skip to main content

Project Management

Tutorials

Large-scale and complex testing projects can stress the testing and automation practices we have learned through the years, resulting in less than optimal outcomes. However, a number of innovative ideas and concepts are emerging to better support industrial-strength testing for big projects. Hans Buwalda shares his experiences and presents strategies for organizing and managing testing on large projects. Learn how to design tests specifically for automation, including how to incorporate keyword testing and other techniques.

Read more
ME What’s Your Leadership IQ?
Jennifer Bonine, tap|QA, Inc.
Mon, 05/04/2015 - 8:30am

Have you ever needed a way to measure your leadership IQ? Or been in a performance review where the majority of time was spent discussing your need to improve as a leader? If you have ever wondered what your core leadership competencies are and how to build on and improve them, Jennifer Bonine shares a toolkit to help you do just that.

Read more
MG Measurement and Metrics for Test Managers
Rick Craig, Software Quality Engineering
Mon, 05/04/2015 - 8:30am

To be most effective, test managers must develop and use metrics to help direct the testing effort and make informed recommendations about the software’s release readiness and associated risks. Because one important testing activity is to “measure” the quality of the software, test managers must measure the results of both the development and testing processes. Collecting, analyzing, and using metrics are complicated because many developers and testers are concerned that the metrics will be used against them.

Read more
MH Take a Test Drive: Acceptance Test-Driven Development
Jared Richardson, Agile Artisans
Mon, 05/04/2015 - 8:30am

The practice of agile software development requires a clear understanding of business needs. Misunderstanding requirements causes waste, slipped schedules, and mistrust within the organization. Jared Richardson shows how good acceptance tests can reduce misunderstanding of requirements. A testable requirement provides a single source that serves as the analysis document, acceptance criteria, regression test suite, and progress-tracker for any given feature. Jared explores the creation, evaluation, and use of testable requirements by the business and developers.

Read more
TL Integrating Automated Testing into DevOps NEW
Jeffery Payne, Coveros, Inc.
Tue, 05/05/2015 - 1:00pm

In many organizations, agile development processes are driving the pursuit of faster software releases, which has spawned a set of new practices called DevOps. DevOps stresses communications and integration between development and operations, including rapid deployment, continuous integration, and continuous delivery. Because DevOps practices require confidence that changes made to the code base will function as expected, automated testing is essential.

Read more

Keynotes

K2 Deliberate Testing in an Agile World
Dan North, Dan North & Associates
Wed, 05/06/2015 - 10:00am

In the decade since agile has gone mainstream, testing has received more emphasis—and in many organizations an automated test suite is now a prerequisite for delivery. For the first time, testing is a core activity within an integrated dev team rather than a downstream activity to be commoditized or outsourced. However, when you scratch the surface of agile testing, it seems we have lulled ourselves into a false sense of security.

Read more
K3 Lightning Strikes the Keynotes
Lee Copeland, Software Quality Engineering
Wed, 05/06/2015 - 4:15pm

Throughout the years, Lightning Talks have been a popular part of the STAR conferences. If you’re not familiar with the concept, Lightning Talks consists of a series of five-minute talks by different speakers within one presentation period. Lightning Talks are the opportunity for speakers to deliver their single biggest bang-for-the-buck idea in a rapid-fire presentation. And now, lightning has struck the STAR keynotes. Some of the best-known experts in testing will step up to the podium and give you their best shot of lightning.

Read more
K4 Blunders in Test Automation
Dorothy Graham, Software Test Consultant
Thu, 05/07/2015 - 8:30am

In chess, the word blunder means a very bad move by someone who should know better. Even though functional test automation has been around for a long time, people still make some very bad moves and serious blunders. The most common misconception in automation is thinking that manual testing is the same as automated testing. And this thinking accounts for most of the blunders in system level test automation.

Read more
K5 The Future of the Software Testing Profession
Mike Sowers, Software Quality Engineering
Thu, 05/07/2015 - 4:15pm

The world of testers and test managers—like most professions—continues to evolve. Some say the more things change, the more things stay the same; others say that testing as a profession is dying. These divergent views raise compelling questions. Are we approaching the era of minimal defects in which testing is diminished? Or is testing on the brink of becoming the most important aspect of software development as the risk of failure grows exponentially? What role will testers play on development teams? What critical skills will testers need in the future?

Read more

Concurrent Sessions

W2 Common System and Software Testing Pitfalls
Donald Firesmith, Software Engineering Institute
Wed, 05/06/2015 - 11:30am

In spite of many great testing “how-to” books, people involved with system and software testing—testers, requirements engineers, system/software architects, system and software engineers, technical leaders, managers, and customers—continue to make many different types of testing-related mistakes. Think of these commonly-occurring human errors as a system of software testing pitfalls. And when projects fall into these pitfalls, testing is less effective at uncovering defects, people are less productive when testing, and project morale is damaged.

Read more
W3 An Automation Framework for Everyone
Chris Loder, Halogen Software
Wed, 05/06/2015 - 11:30am

Chris Loder shares how his team at Halogen Software has implemented Selenium in a framework that everyone in his company's R&D group can use. With an ever-increasing amount of manual regression testing, the team needed an easy-to-use automation framework. Chris presents an example of how the framework they developed at Halogen Software is used and, while doing so, shows parts of the supporting code that automation developers will find interesting. Written in Java, the framework is using Selenium in some pretty cool ways.

Read more
W5 Unleashing the Creative Mind of the Test Engineer
Audrey Marak, AmerisourceBergen Corporation
Wed, 05/06/2015 - 11:30am

Do we each have a natural capacity for creativity? Can creativity be learned or enhanced? How do we ignite inventiveness? To be competitive in today’s world, it’s important to creatively respond to unanticipated challenges, make new connections, and adapt and continually improve. The good news is that our brains are built for creative problem solving, and it’s easy to discover and enhance our natural inventiveness.

Read more
W6 Deliberate Discovery
Dan North, Dan North & Associates
Wed, 05/06/2015 - 11:30am

Modern software delivery involves the decomposition of a problem into packets of business and technical analysis, design, architecture, programming, testing, integration, deployment, documentation, and training. No matter how well-intentioned our iterative or sequential approach is to these activities, our success rate of software delivery is still far below what it should be. Advances in these disciplines haven’t reduced the unpleasant surprises that occur uncomfortably late in projects.

Read more
W7 The Changing Face of Test Management in an Agile World
Tom Roden, Neuri Consulting
Ben Williams, Neuri Consulting
Wed, 05/06/2015 - 1:45pm

Test management doesn't exist in the world of agile, or rather test managers don't—or do they? Agile methods such as Scrum have many traditional test management activities built in. With practices like self-organizing teams, role blurring, and skill diversification, the face of test management is changing. But is that a bad thing? Tom Roden and Ben Williams explore the key tenets of test management in an agile context, the likely dispersal of traditional responsibilities, and the profound effect on teams and managers.

Read more
W10 Risk-Based Testing for Agile Projects
Erik van Veenendaal, Improve IT Services BV
Wed, 05/06/2015 - 1:45pm

Many projects implicitly use some kind of risk-based approach for prioritizing testing activities. However, critical testing decisions should be based on a product risk assessment process using key business drivers as its foundation. For agile projects, this assessment should be both thorough and lightweight. Erik van Veenendaal discusses PRISMA (PRoduct RISk MAnagement), a highly practical method for performing systematic product risk assessments. Learn how to employ PRISMA techniques in agile projects using Risk Poker.

Read more
W11 Measuring Quality: Testing Metrics and Trends in Practice
Liana Gevorgyan, Infostretch Corporation
Wed, 05/06/2015 - 1:45pm

In today's fast-paced IT world, companies follow “best” testing trends and practices with the assumption that, by applying these methodologies, their product quality will improve. But that does not always happen. Why? Liana Gevorgyan questions and defines, in the language of metrics, exactly what is expected to be changed or improved, and how to implement these improvements. While your project is in progress, choosing the right metrics and looking at their trends help you understand what must change to improve your methodology.

Read more
W12 Eliminate Regression Testing through Continuous Deployment
Matthew Heusser, Excelon Development
Wed, 05/06/2015 - 1:45pm

Most traditional teams do testing at least twice—once during development as new features are created and again during release candidate testing right before release. As a system grows, regression testing takes more and more time, making tight releases impossible—or at least risky—and adding to the burden of maintaining automated tests. Matt Heusser suggests that adopting continuous integration (with its continuous testing) and continuous delivery (with its associated production monitoring) can eliminate the need for classic regression testing.

Read more
W14 Static Testing: We Know It Works, So Why Don’t We Use It?
Meenakshi Muthukumaran, Tata Consultancy Services
Wed, 05/06/2015 - 3:00pm

We know that static testing is very effective in catching defects early in software development. Serious bugs, like race conditions which can occur in concurrent software, can't be reliably detected by dynamic testing. Such defects can cause a business major damage when they pop up in production. Despite its effectiveness in early defect detection and ease of use, static testing is not very popular among developers and testers.

Read more
W15 Reduce Third-Party Tool Dependencies in Your Test Framework
Chris Mauck, Neustar, Inc.
Wed, 05/06/2015 - 3:00pm

Have you found yourself forced to use outdated test tools because the cost to migrate was prohibitive? Have you abandoned or rewritten existing tests because it was easier (and cheaper) than migrating? With technology ever changing, most businesses struggle to keep up with producing high-quality products for the lowest price possible. And it is usually testers who suffer the most, as they are forced to use tools that are outdated, or no longer supported, because the company cannot afford the migration cost.

Read more
W16 Testers and Testing: A Product Owner’s Perspective
Scott Barber, PerfTestPlus, Inc.
Wed, 05/06/2015 - 3:00pm

Testers frequently feel that they and their contributions to delivering software are undervalued. These feelings may stem from patterns of important defects being de-prioritized, receiving lower salaries than their peers who code, being assigned seemingly pointless tasks, or being expected to “test comprehensively” with insufficient time and resources (that tend to shrink as the target release date approaches). If you’ve experienced these feelings, you’ve probably wondered “What does senior management value if not the information testers provide?!?” If so, here are some answers.

Read more
T4 Mobile App Testing: The Good, the Bad, and the Ugly
Jon Hagar, Independent Consultant
Thu, 05/07/2015 - 9:45am

Mobile app testing has lots of good practices, some not so useful (bad) concepts, and some really ugly, don’t-ever-do ones. In the tradition of James Whittaker’s How to Break Software books, Jon Hagar applies the testing “attack” concept to mobile app software. Jon starts by defining the big problems and challenges of testing mobile app software and examines the patterns of product failures that you must attack. He then shares a set of good, bad, and ugly test techniques, which testers and developers can direct against their software to find important bugs quickly.

Read more
T5 Release Automation: Better Quality, Faster Deployment, Amazing ROI
Bryan Linder, tap|QA
Thu, 05/07/2015 - 9:45am

A great deal of confusion surrounds the concepts of release automation, continuous integration, continuous delivery, and continuous deployment. Even some industry experts are confused about the differences. How these concepts work progressively to achieve high quality software delivery is generating a lot of discussion and controversy. Bryan Linder defines the methodology, processes, and tools associated with release automation, as well as the differences between its maturity levels.

Read more
T6 Improve Your Test Process from the Bottom Up
Gitte Ottosen, Capgemini-Sogeti Denmark
Thu, 05/07/2015 - 9:45am

Test process improvement can be done in many ways. In a top-down approach a central organization does all the planning, and then implementation is done when everything is ready. In a bottom-up approach the improvements, developed and implemented in individual projects, are then spread throughout the organization.

Read more
T7 Avoid Testing Mistakes or Really Bad Things Can Happen
Bart Knaack, Professional Testing
Thu, 05/07/2015 - 11:15am

In our work we assess the quality of software to give well-grounded advice on the “go live” decision. We test software to prevent bad things from happening to users once the software is deployed. However, in some cases, the mere act of testing breaches safety barriers and can put companies on the spot, causing embarrassment, damage, or even death. The worst test ever to go bad—the Chernobyl meltdown which cost approximately 200,000 lives―was caused by a stress test executed in production.

Read more
T10 Designing a Robust Test Strategy for Mobile Apps
Parimala Hariprasad, Amadeus Software Labs India Pvt. Ltd
Thu, 05/07/2015 - 11:15am

Every day thousands of mobile apps are built, and many are released with poor quality. Dozens of new mobile devices become available every day. Immense pressure mounts on organizations to test mobile apps with shorter go-to-market cycles. Mobile app testing becomes overwhelming due to multiple platforms, varying OS versions, device manufacturers, screen resolutions, and more. Parimala Hariprasad presents an approach to designing test strategies for mobile apps. She addresses such questions as: What devices to test? How to select them? Can we use simulators/emulators?

Read more
T11 Continuous Testing in the Cloud
Chris Broesamle, Sauce Labs
Thu, 05/07/2015 - 11:15am

Are you looking to fulfill the promise of continuous delivery (CD), a process that accelerates the release of software through automation and the practice of continuous integration (CI)? Chris Broesamle can help with that. Explore how to create a full CD solution entirely in the cloud using GitHub, Selenium, Sauce Labs, and a Travis CI server. Chris shows you how you can take advantage of these open source and hosted development resources to increase the velocity of your releases and improve application quality demanded by your users.

Read more
T12 Continuous Test Improvement in a Rapidly Changing World
Martin Pol, Polteq Testing Services BV
Thu, 05/07/2015 - 11:15am

Classical test process improvement models no longer fit in organizations adopting the newest development approaches. Instead, a more flexible approach is required today. Solutions like SOA, virtualization, web technology, cloud computing, mobile, and the application of social media have dramatically changed the IT landscape. In addition, we are innovating the way we develop, test, and manage. Many organizations are moving toward a combination of agile/scrum, context-driven testing, continuous integration and delivery, DevOps, and TestOps.

Read more
T13 What Do Defects Really Cost? Much More Than You Think
Wayne Ariola, Parasoft
Thu, 05/07/2015 - 1:30pm

As software increasingly becomes the face of the business, defects can lead to embarrassment, financial loss, and even business failure. Nevertheless, in response to today's demand for speed and “continuous everything,” the software delivery conveyer belt keeps moving faster and faster. It's foolhardy to expect that speeding up an already-troubled implementation process will achieve the desired results. Wayne Ariola shares why and how to evolve from automated to continuous testing and discusses the methods to help you do so.

Read more
T15 Implement an Enterprise Performance Test Process
Ryan Riehle, InCycle Software
Thu, 05/07/2015 - 1:30pm

Suddenly, application performance is important to your business, and you have been given the budget to improve it. You’re in a hurry because customers are complaining or because you expect jumps in transaction volume and your application needs to scale quickly. Do you know where to start? Join Ryan Riehle as he shares his experiences developing enterprise performance testing programs. Ryan covers the key techniques and heuristics that lead to an effective performance improvement effort.

Read more
T24 Web and Mobile App Accessibility Testing
Nancy Kastl, SPR Consulting
Thu, 05/07/2015 - 3:00pm

If a website or mobile app is not accessible to all potential visitors, is it truly a quality product? Services, products, information, and entertainment on the web and mobile devices can be made available to millions of consumers with vision, hearing, or motor control difficulties by complying with accessibility standards. Assistive technologies enable access by converting the text and images of mobile screens and web pages into computerized voice.

Read more