Sep. 19th, 2016

Understanding Your Reports - Part 4: How to Read Your Load Testing Reports on BlazeMeter

Welcome to part 4 of our “Understanding Your Reports” series. In part 1, we talked about what KPIs are in the context of Performance Testing. In part 2, we went over KPI correlations. In part 3, we explained basic statistics.

 

This time, we will see how this knowledge can be implemented into analyzing your load testing reports on BlazeMeter. Reports are important for viewing the summary of each test and analyzing the trends and statistics.

 

We will go over three types of reports:

1. Summary Report (Dashboard)

2. Request Stats Report

3. Timeline Report


1. Summary Report (Dashboard)

 

The Summary Report, as can be understood by its name, displays a summary of the test. The top part of the dashboard presents statistics, and the bottom shows trends. The statistics shown here are the general parameters that we at BlazeMeter believe are the most valuable for a first glance and overview.

 

The statistics shown at the top are:

- Maximum Users - The Maximum number of Virtual Users that were tested. This is important for understanding your site or app’s load capabilities.

- Average Throughput - The average number of Hits per Second per user during the test. This is important for understanding the amount of traffic your site or app can handle.

- Errors -  The error percentage out of all requests. This is important for understanding if your site or app works properly, or not.

- Average Response Time - How long, in milliseconds, did it take the average user to receive a response for their request. This is important for measuring and understanding your users’ experience when using your site or app.

- 90% Response Time - The slowest response time, in milliseconds, the 90th percentile receives. This is important for measuring and understanding the majority of your users’ experience, when using your site or app, excluding extreme incidents.

- Average Bandwidth - The average amount of data transferred in KIB. This helps to understand the typical network load on your servers during high traffic scenarios.

 

summary report dashboard blazemeter

 

The bottom part of the dashboard displays KPI trends. For more information about reading these reports, see part 2 of this series.

 

This data can be exported to PDF and shared as an executive summary. It is also shareable among team members with the right permissions.

 

2. Request Stats Report

 

The Request Stats Report provides you with even more statistics than those shown on the board. These statistics are shown for each transaction that occurred during the test, as well as for the top-level user experience. Users can determine the time of the test they want to examine, on the Time Slider above the table. The data is displayed in a table, which can also be downloaded in CSV format.

 

request stats report blazemeter

 

Users can also choose which statistics they want to view.

 

request stats report statistics blazemeter

 

These are the available statistics (the report displays them per transaction).

- Element Label - The name of the transaction

- # Samples - The sample size

- Average Response Time - How long, in milliseconds, did it take the average user to receive a response for their request.

- Average Hit/s - The average number of Hits per Second per transaction during the test.

- 90% line (ms) - The response time for the 90th percentile

- 95% line (ms) - The response time for the 95th percentile

- 99% line (ms) - The response time for the 99th percentile

- Min Response Time - The lowest response time

- Max Response Time - The highest response time

- Average Bandwidth (KBytes/s) - The average amount of data transferred per second

- Error Rate - The error percentage

- Average Latency (ms) - The average time in milliseconds from before sending the request to just after receiving the first response.

- Geo Mean Response Time (MS) - Geometric mean response time. This KPI is important for understanding the general health of systems, and excluding anomalies.

- StDev (ms) - The standard deviation

- Error Count - The error sample size

- Duration (hh:mm:ss) - The length of the time between the first time this transaction was seen and the last time

- Median Response Time (ms) - The response time of the transaction for the VU at the 50% percentile

 

3. Timeline Report

 

The Timeline Report shows us statistical trends over time, visually. Users can view different types of KPIs, analyze how they changed over time, and correlate them together. The results are shown in a graph. For more information about reading these reports, see part 2 of this series. You can zoom into a 1 second granularity of the data.

 

The left panel of the report offers a tree view of all the KPIs that were calculated and measured during the test on each label or transaction. The filter lets you quickly find the KPI or label you are looking for and plot it on the graph that appears on the right.

 

timeline report blazemeter

 

After viewing and analyzing your results, you can export the graph as an image for any purpose you might need.

 

Congratulations! You can now read and analyze BlazeMeter’s KPI reports. Stay tuned for next time.

 

Want to learn more about the latest BlazeMeter features and capabilities? Register to view our webinar - Performance Testing with BlazeMeter - New and Advanced Features

Interested in writing for our Blog? Send us a pitch!