STARWEST 2021 - Performance Testing & Monitoring
Monday, October 4
Instill a DevOps Testing Culture in Your Team and Organization
The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...
Tuesday, October 5
Testing Strategies for Microservices
Software development is trending toward building systems using small, autonomous, independently deployable services called microservices. Leveraging microservices makes it easier to add and modify system behavior with minimal or no service interruption. Because they facilitate releasing software early, frequently, and continuously, microservices are especially popular in DevOps. But how do microservices affect software testing and testability? Are there new testing challenges that arise from this paradigm? Or are these simply old challenges disguised as new ones? Join Tariq King as he...
Automation Framework Essentials
Automation is critical in today’s software delivery lifecycle, and yet many organizations struggle to keep their automation running. How can we mitigate difficulties and get consistent automation runs and results we can trust? The secret is implementing a solid automation framework, but that isn’t as easy as it seems. Chris Loder has built several automation frameworks over his career and has learned what works—and, more importantly, what doesn’t. This tutorial will cover what an automation framework is, the benefits of having one, and the keys to a successful framework, including...
Quality and Testing Measures and Metrics
To be most effective, leaders—including development and testing managers, ScrumMasters, product owners, and IT managers—need metrics to help direct their efforts and make informed recommendations about the software’s release readiness and associated risks. Because one important evaluation activity is to “measure” the quality of the software, the progress and results of both development and testing must be measured. Collecting, analyzing, and using metrics are complicated because developers and testers often are concerned that the metrics will be used against them. Join Jeff Pierce as he...
Holistic Performance Testing for Modern Applications
With the advent of frameworks like Angular, React, and Vue, the landscape of application performance has changed significantly in terms of testing and measurement. Gone are the days of measuring response time as a single value based on back-end performance. In modern web and mobile applications, additional layers need to be peeled apart at the front end to truly understand its performance characteristics. Traditional approaches to performance testing are no longer sufficient to provide a delightfully responsive user experience. Join Kaushal Dalvi as he details new developments in the...
Wednesday, October 6
End to End Performance Testing - Automated!
APIs – Security & Performance – How to Avoid Getting in the News!
We all know that Application Programming Interfaces (APIs) are critical in the modern economy, however, if you don't pay attention to the security or performance aspects of APIs, the results can be catastrophic. From large scale data-breaches, major system-wide outages and executives being hauled in front of Congress, failure to adequately plan and carry out API performance and security testing will definitely make the front-page news.... not in a good way. This session will discuss the present a comprehensive strategy for performance and security testing of your APIs, it will include best...
Performance Testing in DevOps
Performance testing isn’t the first thing organizations think about when moving to DevOps – in fact, it’s often ignored as traditional approaches don’t jive well with the fast and nimble world of DevOps. However, performance is still a critical part of the user experience, and poor performance and outages will quickly negate the value of the features you’re delivering. Lee believes that organizations don’t have to gamble with application performance. He will discuss techniques for implementing continuous performance testing in your pipeline, so you don’t have to roll the dice on your user...
Thursday, October 7
Testing Your Serverless Applications
This talk is about applying best practices of testing to your serverless applications. Serverless technologies allow you to focus on building your application by reducing the work you do managing infrastructure. You'll learn how to overcome the challenges of testing in a serverless architecture, and how to efficiently test your Lambda functions efficiently. This includes unit testing, integration testing, and end-to-end testing. After this talk, you will gain an understanding of the benefits of using the AWS Serverless Application Model (SAM) CLI to test code manually, and verifying...
Security Testing is Everyone's Responsibility
How many news stories have you seen recently where a company puts out a statement stating they have been hacked? As applications grow in complexity and scale with technologies such as mobile, microservices and cloud hosting, testers are finding themselves on the forefront of needing to understand how to add security to their suite of testing skills. Paired with an uptick in bad actors trying to take advantage of any application that can be reached via the internet, there is a large need for security testing. Unfortunately, combined with the move to push testing left, security is oftentimes...
Bots Testing Bots: From Manual to Automated Testing for Conversational AI
Testing is a crucial enabler for the success of chatbots and voice assistants. Doing it manually requires enormous time and effort. As DevOps and furthermore AIOps grow in importance, automated testing will remain critical to ensure that bots actually do what their designers intend. Unlike traditional software where the application follows a predefined flow, a chatbot runs without any restrictions. Talking to a chatbot has no barriers. Combining this with an unpredictable user behavior, it becomes utmost difficult to verify the correctness of conversational AI. Training data and test sets...