Better Software West 2017 Concurrent Session - Drive Product Improvements with Telemetry | TechWell

Conference archive


Wednesday, June 7, 2017 - 2:45pm to 3:45pm

Drive Product Improvements with Telemetry

Add to calendar

Do you want to know how real users are interacting with your product? Do you want to know which features they don’t use? Would you like to understand how your product works internally under real operational conditions? Then you need telemetry—the instrumentation of your product to record this information and transmit it back to you for analysis. Windows 10 implemented this capability. Today, there are more than 450 million devices running Windows 10 providing constant feedback on its operation. Ken Johnston says Microsoft learned a lot about what they did right for that launch—and what they have to do better going forward. Ken shares the internal architecture of Microsoft Windows Telemetry and how its data cloud is constructed. He describes how Windows implemented privacy controls for users, how they gather and categorize customer feedback, and what they learned by sharing features early with users. All this infrastructure is now an integral part of how Microsoft prioritizes bugs and feature requests. Learn how to add telemetry to your applications to answer your use and quality questions.

Ken Johnston

Ken Johnston is a principal data science manager on the Microsoft core data science team where he and his team focus their research on Windows post sales monetization and device usage in the commercial and education segments. Since joining Microsoft in 1998 Ken’s roles have included GPM for Bing data quality and measurements; group manager for Bing shopping and data operations; test lead and test manager on MSN, hosted exchange, subscription and billing platform, and office products. He previously served as the Microsoft director of test excellence. Ken is a frequent presenter, a regular blogger, coauthor of How We Test Software at Microsoft, and contributor to Experiences of Test Automation: Case Studies of Software Test Automation. Contact Ken on Twitter @rkjohnston.