STAREAST 2019 - Testing in DevOps
Monday, April 29
Blockchain Quality: Securing Trust in a Digital Age
NewBlockchain technology introduces decentralized, distributed, cryptographically linked digital structures that record information across many computers. Due to its highly secure structure, blockchain is growing at a rapid pace in the financial and automotive industries, and adoption is starting in other industries. We are also witnessing the rise of the smart contract, a set of immutable programmatic auto-enforcing rules that live on the blockchain. However, although there are many benefits, blockchain introduces a unique set of testing and quality concerns. For example, race conditions and...
Instill a DevOps Testing Culture in Your Team and Organization
The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...
Getting a Grip on Cognitive Adaptive Testing
Cognitive Adaptive Testing means harnessing the power of analytics and autonomics in support of continuous delivery. The emergence of cognitive, adaptive testing is driven by trends towards omnichannel content delivery, utilization of big data and improved customer experience. Our software/systems need to be extremely responsive to customer sentiment, work across a variety of devices, be resilient in the face of unpredictable failure modes, and process vast amounts of unstructured data. Such scenarios put extreme pressure on IT systems and processes to be not only more responsive but...
Clean Coding Practices for Test Automation
NewWe are often reminded by those experienced in writing test automation that code is code. The sentiment being conveyed is that test code should be written with the same care and rigor that production code is written. However, many people who write test code may not have experience writing production code, so it’s not exactly clear what is meant by this statement. And even those who write production code find that there are unique design patterns and code smells that are specific to test code in which they are not aware. Join Angie Jones for this workshop, at which, you will be given a...
Tuesday, April 30
Test Data: Mining, Morphing, Managing and Maintaining It!
NewAccording to the 2018/2019 World Quality Report, the number one challenge in applying testing to agile development is overcoming the challenges of creating, managing, and maintaining test environments and test data. Over 48% of respondents had issues with test data. As our systems complexity and time to market demands have increased, the appetite for resolving the test data issue can be diminished or be viewed as test data doesn’t really matter. Join Julie Gardiner as she shares the good, bad and ugly of test environments and data, defines an approach to establish where you are in terms of...
Bash Scripting with Git and GitHub for Open Source Contribution
PreviewSkill with Git is a prerequisite for most software jobs today. This is because the vast majority of software developed is stored in Git-based repositories such as GitHub, GitLab, and BitBucket. GitHub's domination of social coding makes it the new business card to demonstrate your creativity, popularity, capability, and tenacity. “Configuration as code” is a standard DevOps practice so testers must know how to set up and use Git to obtain and update versions of their infrastructures. In this hands-on tutorial, create your own website and learn the GitHub markdown used to format...
Testing Transformation: The Art and Science for Success
Technologies, testing processes, and the role of the tester have evolved significantly in the past few years with the advent of agile, DevOps, and other new technologies. It is critical that we testing professionals evaluate ourselves and continue to add tangible value to our organizations. In your work, are you focused on the trivial or on real game changers? Jennifer Bonine describes critical elements that help you artfully blend people, process, and technology to create a synergistic relationship that adds value. Jennifer shares ideas on mastering politics, maneuvering core vs. context...
Integrating Automated Testing into DevOps
In many organizations, agile development processes are driving the pursuit of faster software releases, which has spawned a set of new practices—DevOps. DevOps stresses communications and integration between development and operations, including rapid deployment, continuous integration, and continuous delivery. Because DevOps practices require confidence that changes made to the code base will function as expected, automated testing is essential. Join Jeffery Payne as he discusses the unique challenges associated with integrating automated testing into continuous integration/continuous...
Continuous Testing Using Containers
NewContainers. Every manager thinks they want them, but few teams have experience in knowing what to DO with them. Used thoughtfully, containerization of your services can transform the way your organization thinks about testing. Gone can be the days of maintaining X different compute environments with Y different configurations. Imagine instead spinning up just the code you need, on the machine type it needs, and only for as long as you need it. In this technical training, Melissa will walk through what containerization means for a legacy code base attempting to practice continuous...
Better Test Design for Great Test Automation
Test automation is an essential element in modern system development. And test design can make or break automation efforts throughout the entire CI/CD pipeline. We want automated tests to find problems in a build quickly, run without a hitch, and be easily maintained. However, if tests are badly structured and unnecessarily detailed, you may have a hard time automating them—even with great tools and great technical expertise. Hans Buwalda explores how testers, both technical and non-technical, can design or restructure tests to make them suitable for automation. In this session, you’ll...
Wednesday, May 1
Cutting through the Hype around Continuous Testing
There is a lot of hype around continuous testing these days. It seems like every product vendor has a continuous testing product and every consulting company has a continuous testing practice. But what exactly is continuous testing? And how is it different from what we've been doing in testing for the past several decades? Join Jeffrey Payne as he discusses what continuous testing is all about and how today's organizations are leveraging it to improve their quality. Learn what tools and techniques enable continuous testing, and examine the pros and cons of moving toward a more continuous...
Data Curation: Refine and Shine
PreviewWe now live in a world where data is generated with every action taken. From buying groceries to walking the dog, we're generating data all the time, everywhere. Companies are starting to undertake harnessing that data efficiently for business cases, and that requires developing a process around data curation. This process must determine which data to curate, how to maintain curated data, and when to delete stale data. A robust data curation process agreed upon by stakeholders is essential to mining data effectively if you want to strike gold. Michael Hobbs will walk through the...
Postmodern Testing
PreviewThe modern world of testing gets noisier, more fragmented, and more confusing every day. Postmodern Testing is an admission of the imperfect world we live in—a new test strategy framework for today’s agile, continuous, and multiplatform teams. Jason Arbon will outline strategies for identifying any given product’s testing needs, as well as prescribe how to efficiently combine different testing techniques and test automation tools to deliver a coherent, well-reasoned, and cost-effective method to the madness. Jason draws on his learnings from how Google tested the Chrome browser,...
Agile Testing in a Waterfall World
What can a tester do when they join an organization that isn’t really agile—or maybe is (gasp) still waterfall? In these situations, it is important to focus on the values and principles that make up agile. Even in a development environment that does not strictly follow an agile-related methodology like Scrum or kanban, the tester can still bring agile principles to their testing. Kat Rocha will share real-world experiences relating to how test engineering can act agile within a waterfall development team, as well as what is important for testing in a team that is undergoing an agile...
Automated Security Scanning for Your Delivery Pipeline
Agile development and DevOps depend on an automated pipeline to build, test, and deploy code quickly. Security is all too often viewed as a manual task that is too difficult to automate and is left for later—not a good decision! Matt Grasberger says that by leveraging automated security scans with open source scanners, you can reduce the risk of security vulnerabilities, get the most out of your pipeline, and increase software quality. Matt will thoroughly explain and demonstrate several ways to implement automated security scans. Discover how to quickly test endpoints against SQL...
The Who, What, Where, When, and How of Test Strategies
What is a test strategy, and how do you develop one? Join Adam Satterfield and Janna Loeffler as they talk through developing a test strategy. They’ll discuss how different software development methodologies influence your test strategy, as well as how techniques like common and coordinated test planning and risk-based testing can be applied to the creation of your test strategy to improve its quality. Adam and Janna also will detail how to develop a test strategy when working with different team dynamics; for example, does your test strategy look different for internal teams versus...
Timeless Testing Skills for Modern Testers
PreviewAs testers in today’s world of agile and DevOps, we are challenged to champion quality in new ways and to develop innovative test approaches that focus on customer value. It's important to bring creativity as well as technical expertise to our test techniques so that we can make our most valuable contributions. We determine both what to test and how to test, and we test jointly with developers. We assess risk and communicate it to our teams and stakeholders through our stories. Our ability to innovate comes from not only our technical skills, but also from our skills in...
Big Data Migration to the Cloud: Testing Challenges and Strategies
PreviewMoving to the cloud is no longer a question of if, but when. Most corporations are either underway in their cloud adoption or have it on their radar. Typically the move from on-premise to cloud is a few hops and different types of data, such as SQL or some version of a file. Couple this with data transformations and it poses a challenge to testing and QA. How do you validate at each hop? Is it required to validate contents between source and destination? Can this testing be automated? Do we build a tool to automate these steps or purchase one? In this session, Sanjay Srinivas will...
The Dell EMC Journey in the Age of Smart Assistants
Dell EMC is driving to optimize and reimagine their testing practices with the application of data-driven smart assistants, powered by analytics and machine learning. At a macro level, Geoff Meyer will highlight the opportunities across the product engineering and testing landscapes that are ripe for the application of analytics and AI. Key ingredients in moving toward solutions that matter are the identification of organization-specific pain points, their prioritization, and the availability and cleanliness of essential data. Geoff will share the process of experimentation, staffing, and...
Excuse-Free Testing: An Open Source Tool for Simpler CI Integration
PreviewThe goal of continuous testing is to find defects earlier in the development lifecycle and release software faster to the market. This can be achieved by integrating open source functional and performance testing tools in the early stages of your software delivery lifecycle. Klaus Neuhold will explain how to integrate the open source test automation framework Taurus, and other tools such as JMeter and Selenium, as a CI step in Jenkins pipelines, so that these tools can be triggered as part of everyday code commits or builds. Taurus can run a large variety of tests and has reporting...
Future-Proofing Test Engineers in the Era of ML and AI
PreviewWe're all hearing the buzzwords of AI, machine learning, chatbots, and next-generation testing. Does this mean that the days of traditional testing as we know and practice it are over? Eran Kinsbruner doesn't think so. Join Eran to learn about the clear transformation happening toward smarter testing techniques and tools. These approaches drive better pipeline efficiency and release velocity with high quality, and Eran thinks this means good things for the testing practice and practitioners. Discover the key trends that are happening around AI, machine learning, and bots in the web...
The Next-Generation Skills Needed for the Future of Testing
That AI is the future of testing seems to be a well-established fact. But assuming that AI will simply replace current manual testers is merely naive. Just like a tractor is no replacement for a farmer, there are many tasks in testing that by their very nature cannot be automated by current AI. As AI improves, many boring testing tasks will be automated, including creating test automation. But at some point, AI is much better suited to replace developers than testers. Think about a behavior-driven development test: It’s easier to generate code that makes the tests pass than it is to...
Thursday, May 2
Are You the Best Leader You Can Be?
We are all leaders. At a minimum, we must lead ourselves every single day, but many of us also have teams that we lead and serve. Have you ever stopped to analyze yourself to determine if you are the best leader you can be? Amy Jo Esser has had the joy of learning from many great leaders outside the testing arena, including John C. Maxwell, Tony Robbins, Mel Robbins, Brendon Burchard, Michael and Megan Hyatt, and Rachel Hollis. Amy Jo continues to learn from leaders in our testing community, including the inspiring leaders and speakers who have been a part of the Women Who Test community....
Where Does Data Come From?
With all the tools available on the market, it can be overwhelming to determine which ones might meet your needs and which ones will work best in your environment to create a high-performing team. Join Jennifer Bonine as she explains the relationship of the DevOps cycle, your environment, and how a hub-and-spoke model can link all your different data sets and tools together. Jennifer will identify opportunities for applying test data analytics across the engineering and test landscape, ranging from high-value test cases to dynamically generated regression test suites. She will review ways...
Disrupt Your Career and Discover True Quality Engineering
PreviewOne of the best things Melissa Tondi did for her career was disrupt it. She'll talk about what disruption means, how it can take form, and how it can help build out a team model that is more adaptable to change than ever while still focusing on the traits quality engineering brings to the table within project teams. Even if physically disrupting your career is not an option, in this session you will discuss how you can develop the mindset of a quality engineer and how a career disruption—whether planned or unplanned—can enhance your quality engineering career development. Melissa...
Leveraging Kubernetes as a Tester
Kubernetes is one of the fastest growing open source projects in history, and it's taking the DevOps world by storm. With so many resources being poured into this technology, it would be nice if there were some benefits for testing. It may seem that the Kubernetes framework revolves around operations and microservices, but with a little know-how, we can leverage the internet excitement around the project to enhance our own automated testing frameworks. Glenn Buckholz will demonstrate how, with just a little bit of knowledge about Docker and Git, an automated testing team can leverage...
Example Mapping: The New Three Amigos
Example mapping is a collaboration technique used by teams to help refine requirements. Every team should have a set of “ready” criteria that includes some kind of workshop for development team members to establish a shared understanding. In a time-boxed example mapping session, rules will summarize examples or constraints about a user story, and the team will document questions about outcomes or dependencies for future refinement. The end result is requirements written as user behavior, with a shared understanding among all roles on the agile team. Join Thomas Haver to participate in a...
The Reality Distortion Field of Testing
The reality distortion field (RDF) is a term coined by Bud Tribble at Apple Computers in 1981 to describe Steve Job's charisma and its effect on the developers working on the Macintosh project. The RDF was said to be Steve Job's ability to convince himself and others to believe almost anything with a mix of charm, bravado, marketing, appeasement, and persistence. The RDF warps an audience's sense of proportion for difficulties and makes them believe that any task is possible. When it comes to testing, we have this RDF all around us, with managers saying things like, "We can and should...
The Era of Intelligent Testing
Existing QA solutions were built for a world where software changed infrequently. Highly adopted tools such as Selenium, Appium, and JUnit require a specialized skill set and too much maintenance, once you start factoring in the brittle nature of tests and the infrastructure required to run tests at scale. But there is still hope for QA in machine intelligence. Next-generation AI tools are here to help QA keep up with the agility of modern software delivery practices in two ways: by enabling manual testers who don't know how to code to automate, and by easily automating repetitive tasks so...
Testing in Production
PreviewHow do you know your feature is working perfectly in production? And if something breaks in production, how will you know? Will you wait for a user to report it to you? What do you do when your staging test results do not reflect current production behavior? In order to test proactively as opposed to reactively, test in production! By testing in production, you will have increased accuracy of test results, your tests will run faster due to elimination of mock and bad data, and you will have higher confidence before releases. You can accomplish this through feature flagging,...
API Testing: Going from Manual to Automated
API testing can be challenging—especially for the uninitiated. Ever wonder what makes an API test great? Patrick Poulin will arm you with an understanding of the benefits of automating API testing over doing it manually. Patrick will review the tools landscape and show common errors people make while creating API tests. He'll discuss the steps required to completely automate the entire testing framework for APIs, and show how it is simpler than most people assume. Leave this session with an understanding of how to automate API testing and overcome the fear of the unknown.
A Practical Guide to Testing in DevOps
Where does testing fit in a DevOps world? DevOps encourages the development and operations teams to work together. This broadens the network of people who collaborate to deliver a product, which creates opportunities for the boundaries of testing to expand and for the nature of testing to evolve. Testing pushes right, toward production, once the development team understands the skills, practices, and tools available in operations. Examples include on-demand infrastructure that enables testing in a production-like environment, feedback from A/B test experiments provided by customer metrics...
AI in Testing: A Moderated Panel Discussion
Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Adam Auerbach and Jennifer Bonine will moderate this panel discussion—which will include Jason Arbon, Dan Belcher, Tariq King, Jeff Nyman, and Jeremias Rößler—to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.
Using and Implementing BDD a Day in the Life
PreviewLearn how to discover, prioritize and plan the features that really matter: those that will deliver real business value and that will make a difference to your organization. You will discuss effective user stories that are pitched at the appropriate level, and writing actionable acceptance criteria that will guide developers and provide valuable feedback and documentation on application features and project progress. And you will experience how building a better synergy between BAs, developers and...
Testing as a Service: Forming a Service-Oriented Testing Team
Companies today must respond to the ever-increasing demand for delivering products in a fast-paced digital environment. As a result, many traditional testing departments are being dismantled, teams are being split up, and individual testers are being distributed across multiple projects or functional teams. This transition can lead to workflows that are awkward and siloed, with team members trying to figure out what exactly to do with the tester. Noha Gomaa thinks there must be a better way to handle the transition. Noha champions "testing as a service" to many project teams. She helps...
Testing Large Data Sets with Supervised Machine Learning
Price rate is used to calculate an insurance premium based on the different insurance coverage. Every year the price rate is based on updated regulations, so after each change, the new price rate has to be tested for a large amount of data to make sure that the premium is correct based on the coverage. Testing fifty thousand data entries and their variations is impossible for any testing team. Alireza Razavi will present an AI automation testing framework designed to solve this testing problem. Discover how to use a supervised machine learning algorithm to determine the type of training...
Lessons Learned Automating Cloud and Infrastructure Testing
As organizations embrace DevOps and IT value chain automation, we are seeing the explosive growth of infrastructure-as-code capabilities, fueled by cloud scripting technology. As infrastructure-as-code capabilities evolve, what role does testing play? Especially for continuous testing, when it comes to infrastructure provisioning and configuration? How does this approach integrate with other traditional forms of testing, such as unit, integration, and systems testing? Join Joseph Ours as he presents what he's learned about infrastructure-as-code and provides live demonstrations for...
Full-Coverage Testing in Small-Business Environments
PreviewIn small-business environments, testing is often completed in hindsight—or overlooked entirely. Chad Jung, Curtis Severance, and Kaleb Weddle will discuss the struggles and successes of ensuring a quality product from the perspectives of a developer, lead software test engineer, and software engineer in test working together on a DevOps team. They will show how to use an automated build pipeline, how to bring it all together for your team, and how to leverage developers who know the in and outs of the code better than anyone. They will discuss the pressures of releasing faster and...
Beyond Coding: Test Automation as Art
The rise of test automation is changing the testing landscape as organizations urgently accelerate their automation goals. As demand for automation increases, those accountable for testing roles are learning to write code, but few are learning the skills that support the creation of truly useful automated assets. Just as using a paintbrush does not make an artist, writing code does not make an engineer. Without a wider perspective, we can end up with test automation frameworks and tests that are inefficient and difficult to maintain. As a test practice manager at a major financial...