Listings for: Performance Reporting
Over my many years working in performance testing and performance engineering, I’ve had the chance to use a broad range of load testing tools. Whether it’s Load Runner, Neoload, JMeter, or even good old Microsoft Homer, they all have one thing in common: they’re great at generating load but mediocre at results reporting and build-over-build product performance analysis.
Sure, you can get some summary statistics on response times and throughput. You may even be able to get graphs that span the duration of a single test. If you’re lucky, the load tool may allow you to compare two performance reports to find regressions. But when it comes to doing advanced reporting and analysis, such as graphing performance results across dozens of iterative builds or drilling down to the performance of every individual HTTP request, these tools fall flat. As a result, many software performance engineers (including myself) find themselves stuck spending hours in Excel trying to summarize data for management reports or find themselves faced with the daunting task of writing a custom reporting solution. Read More…