Trends in Big Data Testing

The Big Data has three unique characteristics—Volume, Velocity, and Variety. Today’s big data applications are growing dramatically. We must process data ever more quickly so we can respond to events as they happen, and that data is arriving from an ever wider array of channels, sensors, and formats. Stefano Rizzo explains that the main challenges of testing big data by little agile teams, beside the apparent contradiction, are related to testing individual components vs. testing the big product, traceability, and organizing massive amounts of test data vs. minimal testing with spreadsheets, and testing the final products of development vs. test-driven development. After reviewing these challenges, Stefano  shares practices and tools to address both testing Big Data and managing the Testing of Big Data—the huge amount of data coming from massive and continuous testing practices.