Comparison reports: new KPI for 90th percentile 

 

Now you can view the 90th percentile in your comparison report. This new KPI reduces the manual work of processing data from different reports. 

 

Introducing a new “status” to pass/fail criteria

In a case where a report has no data to determine the pass/fail criteria (due to reporting error) it will be indicated as “No Data”. This allows you to have better visibility about test runs and their results.

 

Ability to apply filters to a downloaded CSV in Request Stats

Shift the filtering from excel to BlazeMeter!  Now, when you filter within the request stats table, the results will be shown in the downloaded CSV content.

 

Detailed test times on dashboard On the main dashboard 

You can now hover over the executed time, to see more specific time details of when a test was executed. 

 

Enhanced data for your performance testing reports is here! 

Over the past few months, we’ve been constantly improving the accuracy for your data calculations in reports using our new processing mechanism. You now have access to even faster and more accurate calculations for all your reports with a one-second resolution level that gives you better data granularity. Examples of metrics enhanced include the following:

 

• Max virtual users calculation
• Bandwidth calculation
• Time picker resolution granularity

 

You will be able to see these updated in your new performance testing reports, and we will continue to work on enhancing your data and reporting experience 

Unselect all labels in requests stats tab

We added the ability to unselect all labels in the labels filtering dropdown

 

 

Export Comparison Reports to CSV Files

 

When comparing reports, instead of just analyzing graphs, now you can also download a CSV representing that data in the compared graphs.

 

Mock Services: Expand the MAR Asset Catalog by importing Mar assets from Enterprise Service Virtualization VSEs

BlazeMeter Mock Services integrates directly with your enterprise Service Virtualization product.  The Asset Catalog allows you to store all your Virtual Service/MAR assets from a single location and to deploy them directly to your Service Virtualization product.  To enable a quick way to add MAR assets to the catalog, you can directly sync whatever is available on your running VSEs  to the catalog. Click here to learn more.

 

 

 

API Monitoring: Updated DX Application Performance Management Integration

We have updated our integration with DX Application Performance Management (formerly known as CA APM) to support the new URL structures introduced in version 20.1 of DX Application Performance Management. Check out our updated DX APM integration documentation here.

 

 

We enhanced the Requests Stats Tab just for you!

 

We’ve upgraded the UX in the report’s requests stats tab to make it easier to customize, including an easier way to navigate between the pages, adapting the number of results per page and a new, advanced way to filter & sort your labels!

 

 

Account disabled notification screen

Sometimes, due to security or financial reasons, accounts can get disabled. In order to notify you, we created a new page that will show once an account you are part of is disabled. If this happens, please follow the instructions on the page to enable your account.

 

New booting screen improvements

We fixed bugs and improved flows based on your feedback including adding a scenario filter, naming EUX sessions, and more!

 

Infrastructure upgrade

We have successfully finished upgrading our database infrastructure to further enhance  performance and data security.

 

Mock Services: Support for Dynamic Responses

Mock Services already are a powerful tool to eliminate testing constraints such as unavailable  services or third party systems.  With the introduction of Dynamic Responses, we  have made Mock Services more robust and easier to use.  Now you can configure your transactions to respond based on the information that was shared in the request.  For example, if you were looking up an account based on a user ID, you do not need to create transactions for different IDs but can pass the ID from the request and ensure the response will include whatever ID was provided. Click here for more information on how to utilize this feature.

 

Mock Services: Limit Port Ranges Supported

We recently introduced the capability to limit the port range that is allowed when spinning up a Mock Service.  Please make sure the range is wide enough to accommodate all the Mock Services you would like to run. Click here to learn more.

We got a new booting screen!
 

Waiting for your tests to be ready? We’ve upgraded the UX in our booting screen to make it easier to customize with the information you need. 

 

Besides the new look & feel, we’ve split the screen into two parts, advanced and basic, with added functionalities. For example, you can see logs for specific sessions, filter information, see only added sessions to a current test that is running, and more!

 

 

Taurus 1.14.0 now supported

We’ve upgraded our engine images to support Taurus 1.14.0. See changelog here

Upcoming Depredations, reminders:

The following items will be deprecated soon:

• Python 2.7 (EOL: January 1, 2020)
• Jmeter 2.13 (launched on 2015)
• Gatling 2.1.7, Gatling 2.2.3 (launched on 2015/2016)
• Java 7, Java 9

 

Failure Criteria

We raised the limitation of defined failure criteria to 100 (when no sliding window is enabled)
 

CA APM Rename

 

Oops, where is the CA APM integration? It is still here! You can find it in the same place, but under a new name DX APM

 

Resource Consumption Alert

 

Worried about users not calibrating their tests and running big, misconfigured tests which consume too much resources in your Private Locations? We added a new alert that triggers a notification to account admins when more than X amount of engines are configured. 

 

New Way to Create Private Locations

Now you get more control on your Private Locations and Ship’s content. Our new flow lets you define the properties of the Private Location which will affect the roles and behavior of the Ships configured in it.

New UX on Private Locations page 

 

We’ve refreshed the way you disable / enable the Private Location and changed the text-based links to icons.Please note that the “Delete location” operation has moved to the edit window.

 

 

Upcoming Taurus upgrade

 

Stay tuned! In our next release, we will upgrade the Taurus image in our images to 1.13.9 version

 

Upcoming Deprecations

The following items will be deprecated during December:

• Python 2.7
• Java 7, Java 9
• Jmeter 2.13
• Gatling 2.1.7, Gatling 2.2.3
   

Network emulation

We added support for 5G network option under the Network Emulation section in a performance test configuration.

 

API additions

/api/sessions/<session_id> endpoint now lists the public IPs of the cloud load engines it launched
 

RTE Support

 

The JMeter RTE plugin was added to our engine. You can read more about the plugin and its use case here. 

 

Security enhancement for on-premises component & infrastructure

Part of our on-going efforts to provide the best & most secure product, we improved security in our on-premises components by removing default assumptions, tightened the permissions, etc.

Indication for unsupported configuration of a JMX file

A new warning message was added for users who are running JMX with unsupported forward slash in specific fields.
 

Display Public IP address for Ships

 

You can now find the public IP of a ship, in addition to the internal IP, in the “Address” column of the Private Location page. 

 

Measurement Units are Now Available in Requests Statistics’ CSV 

The Request Stats Report shows the metrics for each element of a test script, allowing you to drill down and review the statistics (stats) for how every single element of your test performed. You can download it as a CSV file, and we have now added the unit of measurement to the CSV’s header (milliseconds and seconds).

 

 

Support for Auto Update from Internal Repository

Customers with on premise locations can now pull images directly from an internal docker registry managed and controlled by them instead of manually updating the existing Ships each time BlazeMeter release new images.

Dedicated IPs are now detailed in the Engines Health tab

We added the used dedicated IP to the Load Engines dropdown so users can now easily locate the relevant Load Engine associated to their test that is running. 
 

 

Improved Graphs

We upgraded our graphs library with  a better visual experience.  We also improved the functionality to download graph images. 

 

Improved authentication process

We have improved our authentication process and now offer a more secure way to log in with Two Factor Authentication (2FA). We also enhanced our Single Sign On (SSO) experience.

 

Taurus 1.13.7 now supported

We’ve upgraded our engine images to support Taurus 1.13.7

 

Blocking testers from accessing Private Location’s configuration

In order to improve the product’s security, users with a “Tester” role won’t be able to modify the configuration of Private Locations.

 

Find tests quicker with sizeable columns in project’s test view

We added the option to modify the columns size for the tests’ table in a project, so it is easier to look for tests with long data (name, description, locations, etc).

 

 

Compare reports between projects

You asked for it, and now you can do it - we've added the ability to compare reports between different projects instead of limiting you to the specific project the report is located at.

Enhancement to the Admin view - Locations Utilization 

We’ve made it easier to see where members in your account run their tests by adding the ability for account admins to see a graph representing the locations utilization spread between all the test runs in the account.

Ship’s new status

Any Ship that hasn’t been connected to BlazeMeter for over 3 months (e.g. server was offline, no network connection etc), will be marked as detached and unable to be used in the system for future test runs. If your Ship has been “detached” you will need to re-generate it or create a new ship. 

Personal settings have moved to the top header

Check out our sleek, new design in the top header for accessing your personal setting. Navigate from the top header to personal settings, to access the settings screen where you can change things such as your name and password. 

Manage account invites directly from envelope icon in header

You can now view all your account invites directly from the header. Just click on the envelope icon, and you’ll access the notifications. You can then choose to accept or decline.

 

 

New Admin view filters

We added extra filters to the admin view so you can now see  results by workspace or by location.

Added Descriptions to the Projects page

We added a description column to the project page to make it easier to understand the tests created..The description is fetched from the test’s description which is added in the test creation page.

 

Taurus 1.13.6 now supported

We’ve upgraded our engine images to support Taurus 1.13.6

New UI for Blazemeter header!

We added two separate tabs for Functional and Performance Tests, so you can easily navigate between your functional and performance tests. When clicking on each tab retrospectively, the tests and reports are filtered, but the projects, workspaces, and all other account information can be accessed the same way. 

JMeter log tail

You can now get a live view of the last 300 lines in you JMeter logs live for V4 tests. This can be found in the log tab, in application view of the tail, to allow for easier debugging.
 

Account Admins: Full Visibility on Current Usage

For a BlazeMeter account admin, it’s important to have full visibility on the usage and resource utilization on the account level. The new admin view can be accessed from the top-right from any workspace dashboard, and allows account admins to see all tests that are currently running, including their details. Account admins can also choose to stop any tests directly in this new admin view. We are expanding this admin view to include more information such as location utilization.

 

 

Support for search in projects page

Have access to tens of projects and you can’t find the one you are looking for? In order to help you navigate and find your projects, we’ve added a  search capability in the projects page to easily find what you are looking for.

 

 

New default location

We modified the default location in the new created test to be US East (Virginia) in Google Cloud. You can then choose your desired location from the same list. 

Control the size of your engine

Need different engine sizes for different testing purposes? No problem! Account admins can now control the Engine size (CPU & RAM) and have different engine “types” from various locations. We will soon be adding the option so users with “tester” permission/role will not be able to access the Private Locations configuration.

 

New Design and architecture for RPS & remote control

New design and architecture for Remote Control update during test run allows you to update JMeter parameters for every scenario and location simultaneously. Furthermore, if a test has multiple scripts and locations, we will divide the RPS relatively between the scenarios and locations, according to the VUHs configured per location \ scenario

JMeter 5.1 now supported

We’ve upgraded our engine images to support JMeter 5.1

 

Centralized scheduling management

Users now have full visibility & management on scheduled tests across each workspace they are part of.
 

JMeter logs uploaded throughout test run 

For easier debugging and faster understanding of the issues in the test, we now upload JMeter log files periodically during the test

Compare report now supports two resolutions

You’ve asked for it, and we’ve added support for both 1 sec and 1 min resolutions on the compare report.

Schedule tests directly from the UI

We have now brought the scheduling capability to UI, allowing users to schedule their tests directly & simply from UI. If you need advanced configuration, you can set a cron syntax in under the advanced section.

 

 

Control your proxy authentication configuration

The BlazeMeter Proxy Recorder now supports port 80 as well as random ports. iOS users can now use the Proxy Recorder for recordings by choosing the random port option.

 

Debug mode UI upgraded

Now, users will see a blue “Debug Run” stripe in the Original Test Configuration tab.

 

Workspace search UI improved

Now, the workspaces navigation dropdown supports inline search for workspaces. Instead of very long scrolling, users can now search to speed/simplify the effort.

 

Smart Java version selector

The JMeter Properties section in the New Test Create will show users only the java versions that are relevant to their selected JMeter version.

New “Environment” page

The new environment page can be found in the account’s settings section, enabling users to configure a local plugins repository. At the moment, this page will be shown only for accounts with Private Locations and it includes the local JMeter repository configuration.

 

 

Navigate to the executive report directly from results email

 

We’ve added the option to view your executive summary report directly from your report notification email. 

 

Here is what’s new with the November 18th release:

• Add a test to a Multi-Test (NTC) that’s already running
• Improved JMX Converter at converter.blazemeter.com
• Enhanced TeamCity plugin (version 2.3)

 

Add a test to a Multi-Test (NTC) that’s already running

One of the features long-time BlazeMeter power users love is the ability to add additional load or entirely new test logic to a large test that’s already running. No need to stop, reconfigure and re-launch: Just launch an additional test and join it to the Multi-Test in progress.  This feature is now live in New Test Create (NTC), also known as BlazeMeter “V4”.

 

Read Add Load/Logic Mid-Test in the Knowledge Base article for Multi-Test (NTC) to learn more.

 

 

 

Improved JMX Converter at converter.blazemeter.com

The BlazeMeter Labs project for generating JMX’s from HAR, PCAP or other files just got some great upgrades.  Check it out at converter.blazemeter.com

• Massive performance improvement - a 30MB file is converted in about 15 seconds!
• Improved support for PCAP files
• Improved file type detection
• New UI with a fresh & clean look:

 

 

File formats supported by the BlazeMeter JMX Converter:

• HAR JSON - from Mozilla Firefox traffic
• XML from Internet Explorer
• Selenium Builder input
• PCAP input
• JSON from the BlazeMeter Chrome Extension, HAR and Selenium Builder

 

Enhanced TeamCity plugin (version 2.3)

 

• You'll find a separate BlazeMeter tab in build results that contains a summary of the build and link to the BlazeMeter report
• Workspace selection added to build configuration
   

Don’t miss these new features we have recently taken live:

• New Test Create (NTC) Multi-Test Is Here!
• End User Experience Monitoring: multi-step scenarios
• JMeter 5.0, Java 11 and Taurus 13.1 now supported
• New setting in NTC: delay between requests
• Usage Report CSV: “Test Ended” column added

 

New Test Create (NTC) Multi-Test Is Here!

 

The New Test Create (NTC) Multi-Test is here.  It’s never been easier to create multiple test collections that launch and report as a single test. Simply type a few characters to find the tests you want and add them.  Visualize the combined result, make local overrides and launch!

 

 

End User Experience Monitoring: multi-step scenarios

 

Need to monitor more than simple URLs - e.g. a page with login? Just upload one or more Selenium scripts recorded in Taurus YAML by the updated Chrome extension, enable End User Experience Monitoring and we’ll capture real-browser journeys throughout your load test.

 

 

JMeter 5.0, Java 11 and Taurus 13.1 now supported

 

We’ve upgraded our engine images to support:

• JMeter 5.0
• Java 11
• Taurus 13.1

 

New setting in NTC: delay between requests

 

When entering multiple URL/API requests in New Test Create (NTC), you can now add a delay between them by clicking on the “Scenario Definition” block:

 

 

Usage Report CSV: “Test Ended” column added

 

 

The Usage Report download CSV now includes a “Test Ended” column. Access the Usage Report in Settings > Account and Settings > Workspace (requires you to be an account admin or workspace manager, respectively).

Don’t miss these new features we have recently taken live:

 

• Chrome Extension: Record JMeter and Selenium Simultaneously
• Jenkins Plugin: Push Latest Test Files to BlazeMeter
• Jenkins Plugin: Push Auto-Generated Test Data to BlazeMeter

 

Chrome Extension: Record JMeter and Selenium Simultaneously

BlazeMeter’s Chrome extension now allows you to record both JMeter and Selenium scripts in a single session. You can edit and debug Selenium scripts directly in the browser, run the recorded scripts on BlazeMeter or export scripts in JMeter (JMX) or Taurus YAML formats. It’s the perfect way to create End User Experience Monitoring journeys for real-browser performance during load tests. We have even more Chrome Extension features coming soon!

 

Jenkins Plugin: Push Latest Test Files to BlazeMeter

 

Use BlazeMeter’s Jenkins plugin to automatically update your test scripts before each run from your version control system (Git, GitHub, Bitbucket,...).

 

 

Jenkins Plugin: Push Auto-Generated Test Data to BlazeMeter

Also you can use the same setup (BlazeMeter’s Jenkins plugin and version control system) to dynamically push fresh test data to your BlazeMeter tests. Just generate the data, output it to your source control system or Jenkins workspace and let the updated BlazeMeter Jenkins Plugin push the updated data into your test configuration on each run.

From real-browser end user experience metrics to the latest features rolling into the “new test create” beta, there’s lots to see this week:

• End User Experience Monitoring (Real Browser Metrics)
• Report Actions Menu Moved, Tabs Restyled
• Java Version Override, Sync Start and Transaction Details in New Test Create (beta)
• Private Location Shows Who Launched Each Test
• Proxy Recorder: Choose Where To Launch It From
• API Functional Test Now Supports Custom JMeter Plugin Uploads

 

End User Experience Monitoring (Real Browser Metrics)

 

Now you can run real browsers during your performance tests to get End User Experience metrics. Watch the animation below or jump right to the Knowledge Base topic on End User Experience Monitoring.

 

 

 

Report Actions Menu Moved, Tabs Restyled

 

To make way for exciting new reporting controls we will be adding soon, we have moved the actions menu and restyled the tabs in reports:

 

 

Java Version Override, Sync Start and Transaction Details in New Test Create (beta)

 

• Support for Java version override
• Sync start (so all engines will start the test simultaneously)
• Transaction components display: “Generate Parent Sample” will no longer be set to true by default, when uploading a JMeter script with a transaction controller.

 

Private Location Shows Who Launched Each Test

 

Private Location status now shows who launched a test rather than who created it, so it’s easier to see who is using resources.

 

Proxy Recorder: Choose Where To Launch It From

 

You can now choose which location you want to launch the Proxy Recorder from:

 

 

 

API Functional Test Now Supports Custom JMeter Plugin Uploads

 

Need a plugin to make your API Functional test happen? Now you can upload plugin JARs just as you’ve always been able to with performance tests. Here’s our shiny new Mainframe RTE Protocol plugin in an API Functional Test configuration:

 

Here’s what’s new this week:

• JMeter < 2.13 deprecated (Older tests now execute with 2.13)
• Zoom synchronized across Timeline Report, Request Stats & Errors
• Online Recorder whitelisting simplified: always uses port 8153
• Azure available in New Test Create (NTC) Beta
• BlazeMeter API V2 deprecated; “latest” now points to V4

 

JMeter < 2.13 deprecated (Older tests now execute with 2.13)

 

As of this release, we have deprecated JMeter engines with versions below 2.13. Any scripts that were created in earlier versions of JMeter will now be executed with 2.13.

 

Zoom synchronized across Timeline Report, Request Stats & Errors

 

Now when you zoom the Timeline Report graph, the sliders in Request Stats and Errors will follow the same selection. The reverse works as well: Moving the sliders will re-zoom the Timeline Report.

 

 

Online Recorder whitelisting simplified: always uses port 8153

 

The online Recorder now uses a static port number (8153), so there’s no need to whitelist a long range of ports in order to use it. We'll be changing it to port 80 soon to make it even easier. If you are new to the Recorder, have a look at BlazeMeter Proxy Recorder (Mobile and web) or just click the “Recorder” button on the Create Test screen to get started:

 

 

Azure available in New Test Create (NTC) Beta

 

Now you can run tests on Azure (26 locations) from within the New Test Create (NTC) Beta.

 

 

 

BlazeMeter API V2 deprecated; “latest” now points to V4

 

We have deprecated our V2 API and have pointed “latest” to our V4 API. This change was announced via email to all users of the V2 API in April.

 

Have a look at API Changes Effective June 10, 2018 if you need tips for migrating any remaining V2 or “latest” references in your code. Feel free to Contact Support if you have further questions.

Here’s what’s new this week:

• Next Generation “URL/API Test” is Live!
• New Relic Infrastructure Integration (RIP: Servers)

 

Next Generation “URL/API Test” is Live!

 

Do you love the ease and speed of our URL/API test feature, but wish for advanced features like assertions, variable extraction and file uploads in request bodies? Wait no longer! Most of the request editing features from our API Functional Testing UI have been added to the New Test Create (NTC) Beta. Watch the 30-second video below and read the docs for API Functional Testing to learn the finer points on variable re-use and such.

 

 

New Relic Infrastructure Integration (RIP: Servers)

 

New Relic may have shut-down the “Servers” feature in New Relic APM, but we’ve got you covered with our new integration to New Relic Infrastructure.  Overlay New Relic Infrastructure data on Timeline Reports for all test types to see what’s up on the back end. To get started, you’ll need a “Query key” set up in your New Relic Insights account.  Full details in our Knowledge Base.

 

Here’s what’s new this week:

 

1. Add a Description To Your Tests
2. Single Sign-On/SAML Enhancements
3. Dynatrace APM Now Bi-Directional (Populate Timeline Graphs)
4. API Functional Test - Swagger Import Improvements

 

Add a Description To Your Tests

 

By popular demand, test configurations now have a “description” field, where you can document the scope or purpose of your test. No more “LongTestNameTryingToTellTheWholeStory” required!

 

 

This feature is available in JMeter Test (new), Taurus and API Functional Test flows.

 

Single Sign-On/SAML Enhancements

 

We’ve listened to feedback from our single sign-on (SSO) customers who wanted greater control over new user accounts and no more “pile up” of new users in the default workspace.

 

1. Now you can turn off the “default” workspace, so users can only use BlazeMeter if they have been added to one or more workspaces by an admin. With this option, users who have not been assigned a workspace will get a splash screen asking them to contact the admin for access, instead of landing in a default workspace with full entitlements.
2. Want to add user accounts without depending on email invitations for users to read and respond to?  Check! Now you can create and activate accounts entirely from the admin side.

 

Dynatrace APM Now Bi-Directional (Populate Timeline Graphs)

 

Our integration with Dynatrace is now bi-directional!  You’ve always been able to send “red dye” (decorated headers) outbound to make test traffic easy to see in Dynatrace and now you can pull Dynatrace metrics inbound to visualize in Timeline Graphs. This is also the debut of Dynatrace support in our new test create (NTC) screens. We’ve made this new functionality available in both our legacy and new test create (NTC) screens.

 

 

API Functional Test - Swagger Import Improvements

 

Our new API Functional Test feature continues to evolve at a fast pace. This sprint we’ve enhanced the new Import swagger file feature:

 

1. Parameters are now converted to variables, so you can easily populate them with test data from a CSV file.
2. Base URL (default address) and base path (default path) are saved in global variables.
3. Now you can cancel import of swagger file mid-import if needed.

 

Look for “Import swagger file” in the (...) menu at the bottom of the Scenario list box:

 

 

Here’s what’s new this week:

1. API Functional Test: we’ve been busy :-)
2. Reminder: JMeter <2.13 will be deprecated April 29th
3. Usage Report now shows if run from UI, API, Jenkins, etc...
4. Bamboo plugin updated: New “BlazeMeter Test Report” tab

 

API Functional Test: we’ve been busy :-)

 

Have a look at API Functional Test.  Since our public release last sprint, we’ve been very busy:

• Import Swagger (Open API) files to create scenarios: import all verb + endpoint combinations or only selected ones
• Use test data from CSV files
• Dynamically pull file content into request body
• Add file attachments (binary files) to requests
• New request methods (PATCH, OPTIONS, HEAD, CONNECT)
• Text type assertions - define assertions without the need to know regular expression syntax
• JSONPath value assertions - assert the value found at the defined JSONPath
• Response time assertions for individual requests
• Common functions - generating random numbers or random strings for parameters in your test or base64 or URL encoding strings
• All private locations are available from the UI for API Functional Test
• Download test script from the UI (Taurus YAML)

 

Reminder: JMeter <2.13 will be deprecated April 29th

 

We will deprecate JMeter versions <2.13 on April 29th.  When we do, we’ll switch to executing these older scripts with the 2.13 engine.

 

Usage Report now shows if run from UI, API, Jenkins, etc...

 

Usage reports now include an “Execution Client Id” column so you can see at a glance whether test was run from UI, API, Taurus, Jenkins, etc...

 

Bamboo plugin updated: New “BlazeMeter Test Report” tab:

 

Jump to detailed BlazeMeter reports right from your Bamboo build dashboard with the new BlazeMeter Test Report tab.

 

 

Learn more about the Bamboo plugin for BlazeMeter:

• BlazeMeter Plugin to Bamboo
• BlazeMeter Bamboo Plugin on GitHub

Here’s what’s new this week:

• API Functional Test: 1,000 requests included with your account
• Unlimited accounts:  see total parallel runs across workspaces
• Report screen commands: look for new icons instead of buttons

 

API Functional Test: 1,000 requests included with your account

 

 

Use our new intuitive UI to create API Functional Tests with or without writing code. Templates for authentication, variable extraction and dozens of other use cases make it fast and easy, whether writing your first test or your 100th.

 

Prefer to write code? Toggle between the UI and code editor with a click.

 

If you already have JMeter scripts or Taurus YAML scripts, just upload and run them to get detailed functional test results. Watch the animation below or read the help topic to learn more.

 

 

Unlimited accounts: see total parallel runs across workspaces

 

If you have an unlimited plan, you can now see how many parallel runs are operating across all workspaces in your account.

 

Hover over the green circled number showing tests running in your workspace to see the count of tests running in all workspaces.

 

 

Report screen commands: look for new icons instead of buttons

 

In the report, we have converted the “Compare” and “Summary” buttons into icons, joining the Accessibility, Share, Refresh and Delete buttons which became icons a few releases back.

 

From today forward, you’ll see these icons and hover tooltips:

 

New Versions Supported: JMeter 4, Java 9, Taurus 1.10.5

 

Now you can run JMeter 4, Java 9 and Taurus 1.10.5 on BlazeMeter.

 

We will deprecate JMeter versions <2.13 in April.  When we do, we’ll execute these older scripts using the 2.13 engine.  Now is a great time to check to see if your <2.13 scripts need edits to run on 2.13.  JMeter is great at backward compatibility, but better safe than surprised :-)

 

Sandbox IP Address List Change

 

We have updated our Sandbox location to be served from the following six IP addresses.  If you have whitelisted our Sandbox location, you will want to update your whitelist to the following:

• 35.171.138.251
• 35.171.125.53
• 35.171.138.236
• 35.169.68.12
• 34.227.202.250
• 35.170.212.9

 

Chrome Recording Extension Upgraded

 

The Chrome recording extension has been upgraded:

• Create and name Transactions as you do your recording with “Edit Transaction Labels”
• Choose which requests to record with greater precision (i.e. top level requests + cookies, for instance)
• Run tests as “API Functional Tests” (single VU with enhanced reporting)

 

 

CloudWatch APM data moved to the Timeline Report

 

CloudWatch now joins our other “inbound” APM integrations on the Timeline Report. Previously CloudWatch data appeared on a separate report tab. Enjoy the streamlined experience :-)

 

 

Overlay your own data on the Timeline Report (coming soon!)

 

Ever wish you could overlay your own time-series data on the BlazeMeter Timeline Report? We’ll be releasing an API soon which lets you post JSON data to overlay on any test, even in real time. Watch for an update in the next release or drop a line to beta@blazemeter.com if you want to get started right away.

 

Summary report graphs change resolution @ 5 min mark

 

The time-series resolution in the Summary report graphs now changes at the 5-minute mark:

1. In the first five minutes of the test, the graphs show one-second resolution.
2. After five minutes, the graphs switch to one-minute resolution.

 

Taurus Tests now configured on New Test Create Screen

 

Starting today, when you press the “Taurus” test create button, you’ll go to the New Test Create (NTC) screen being rolled out as part of our New Test Create Beta.  For advanced users who have been running Taurus tests on BlazeMeter for some time, you’ll be interested to hear that the default execution framework is moving from “Taurus V1” to “Taurus V4” with this update.

 

New Test Create (NTC) Beta Updates

 

We’ve been gradually rolling out a new test create workflow and underlying test execution architecture since earlier in the new year. Here’s a peek at what we’ve added in the most recent drop.  If you have questions about the beta (including requests to join the beta and try it out so you can influence our final builds), please drop us a line at beta@blazemeter.com.

 

NTC: Load configuration enhancements

 

1. The scrolls are “exponential” so that it is easier to configure using them.
2. The test visualization graph now shows a “zoomed in” view of the ramp up period, with ⅔ of the space showing the ramp and ⅓ of the space showing duration of the post-ramp hold period.
3. We added support for the “Limit RPS” setting and “Change RPS” mid-test button.

 

 

NTC: Debug Test

 

The Debug Test button launches a quick run of your test at low scale to confirm that everything works from the cloud. Unlike the “sandbox test” feature in the previous version, with Debug Test, your settings (such as scale, location or duration) aren’t changed or reset in any way. We also write out a more detailed “trace.jtl” log for these runs to assist with troubleshooting.

 

 

NTC: File Validation

 

When you upload a file in New Test Create, we validate the uploaded file, checking for:

• Missing files that are part of configuration (referred within a yml)
• Broken JMX (XML issues)
• Invalid YML
• Taurus configuration errors

 

The validation occurs automatically on file upload and you can re-validate on demand by clicking the “Revalidate” after making corrections/uploading new files.

 

New Cloud Locations: Google Montreal and Netherlands

 

This week we’ve added two new Google locations, Canada East (Montreal) and EU West (Netherlands). You can now choose from 56 cloud locations across Amazon, Azure and Google. 

 

You asked. We listened.

 

Sometimes it’s the little things that matter the most. This week we implemented two requests that were recently posted as feature requests on the Ideas Portal:

 

Resize columns in Request Stats and Executive Summary reports

 

Long labels truncated? Just drag the column wider to see it all.

 

 

Project name navigates to project page

 

When you click on project name, it navigates you to the list of tests in your project.

 

New cloud location: AWS EU West (Paris)

 

 

Timeline tab settings now “sticky” within same report session

 

Changes made to the selected KPIs on the Timeline Report are now “sticky” within the same report viewing session.  For instance, if you switch from Timeline to Errors or Engine health and then back to Timeline, your KPI selections will remain as selected.

Time zone setting for BlazeMeter UI

 

Now you can easily override or “offset” your local browser timezone setting for all time/date displays in the BlazeMeter UI.  It’s also easy to toggle this feature on or off with a click.

 

Teams collaborating across times zones asked for this feature so they could discuss time stamps in reports without having to convert times in their heads.  We are happy to provide it!

 

Navigate to: Settings > Personal > Personal Settings to set or toggle Time Zone Override:
 

 

Locations Now Filtered By Type-Ahead

 

Find a particular location faster, or filter the list to find locations with something in common by typing in the drop-down bar.  Here we typed “lon” to quickly see which providers are supported in London:

 

 

Report Buttons Tidied Up → Icons

 

We cleaned up the menu at top right of each report where you previously saw these six buttons:

 

 

The “Compare” and “Summary” buttons are still there, but we have converted “Accessibility,” “Share,” “Refresh” and “Delete” to icons:

 

Workspace ID added to the Account Usage Report

 

Do you have many Workspaces? We’ve eliminated the need to download separate reports from each Workspace to track usage at the Workspace level.  Look for the new “Workspace ID” column in the Account level Usage Report CSV.  If you are have Owner, Admin or Billing role for your account, navigate to Settings > Account > Usage Report and click the Download CSV button:

 

In-app help, tutorials, idea submission, support tickets & more

 

Now you can view context-sensitive help, search our knowledge-base and more without ever leaving the app.  Just click the green HELP CENTER tab on the right to get started:

 

 

Have an idea? Let us know!

 

We’d like to hear your voice! Want to suggest an idea for a new feature? Just click the Feature Request button in the new Help Center sidebar.

 

 

 

Everyone can submit ideas. Paid customers can also search, vote-up and subscribe to be notified of comments and status changes from within our new ideas portal. Learn more about the Ideas portal and your opportunity to impact our roadmap here.

 

 

Filter previous tests runs in the Test History page

 

Failure Criteria filtering is now available on both the Dashboard and individual Test History pages. The default view shows “All” and you can filter by “Passed”, “Failed” or “Not Set”:

 

 

New Cloud Location: Google Sao Paulo, Brazil

 

We continue to expand our geographic diversity.  Recently we doubled our Azure locations and this week we are adding Google’s Sao Paulo, Brazil location. You can always see the full list by viewing the locations drop-down in an test create/edit screen.

 

BlazeMeter Jenkins Plugin updated

 

The Jenkins plugin for BlazeMeter is now workspace aware: select a workspace during job configuration to fetch tests specific to that workspace.  We’ve also added average throughput and 90% response time to the metrics in the aggregate report.

 

Details and previous updates in the plugin changelog on github.

Navigation bars now resizable to show long test/report names

 

Now when you display the “Show all tests” or “Show all reports” lists, you can resize them to display long names without truncation. Just drag the border on the right:

 

 

Uniquely Smart: CA APM integration auto-selects impacted metrics each time your test runs

 

The APM integration for CA APM is now bi-directional and uniquely smart. It's our first integration to import APM metrics without requiring you to specify the metrics ahead of time. CA APM identifies the systems impacted as your test runs and automatically imports the relevant metrics for you. There's no better way to keep up with an always changing environment. Just point to your CA APM instance, launch your test and we’ll take care of the rest.

 

 

Behind the scenes, BlazeMeter injects headers to your test traffic and CA APM determines which systems are impacted. CA APM then sends back the relevant metrics, which we make available in the Timeline Report.  This new feature is layered on top of the existing outbound integration mode, where BlazeMeter test labels show up as Business Transactions in CA APM.

 

Throughput RC renamed to “Change RPS”

 

We have renamed the “Throughput RC” button to “Change RPS” to make it easier to find.

 

Was:

 

 

Now:

 

 

This button appears in tests where you have checked “Limit RPS” in the test configuration. It allows you to make mid-test changes to the RPS goal.  See Limit RPS in the knowledge base for more detail. 

 

Stop Test Dialog redesigned To reduce data loss

 

We have re-designed the Stop Test dialog to make it more likely you will choose the “Graceful shutdown” option over the more destructive option, “Terminate servers”.

 

 

Workspace Alerts for all test activity

 

Workspace Alerts send alerts by email or Slack when test actions are taken and are triggered by size or duration thresholds. Now you can be notified of all test activity regardless of size or duration, by creating a Workspace Alert with duration set to "0" and concurrency set to "0".

 

To get alerts like this:

 

 

Create an alert (Settings > Workspace > Alerts) like this:

 

 

Tip: More detail on creating Slack Webhooks URLs for alerts has been added to our knowledge base.

 

Multi Location renamed to "Create CDN Test”

 

We have renamed the “Multi Location” button to “Create CDN Test”:

 

Was:

 

 

Now:

 

 

This button appears in Test Configuration screens if your account plan includes this feature. Clicking it creates a 9-location multi-test designed to meet Content Delivery Network provider recommendations for an accurate test. Contact support@blazemeter.com if you have questions about this feature.

• Support for JMeter 3.3 - we’ve updated our engines to support the newest JMeter version

 

 

• Filtering of labels in Request Stats tab

 

When viewing the test report, you can now easily filter the labels in the requests stats tab. Select the ‘settings’ icon found in the top right corner. In the pop up, under the select labels tab, select the desired labels you wish to see.  Here’s a 25-second demo:

 

 

• Azure: 13 more locations for a total of 26

 

We have doubled the number of Azure locations, adding new locations in Korea, India, Australia, Canada, US and UK. Have a look at the locations drop-down to see them all.

• The Test Booting Screen is now updated with more information for improving your testing experience.

We’ve added details about the test status, test name, script name, whether dedicated IPs are used and the status of each session - multi-location/multi-test. We’ve also enlarged the elapsed time indicator and moved links to learning resources to the bottom left.

 

 

• The New Private Location (On-premise Load) architecture enables easier installation.

Are you testing your system behind a firewall? You’ll be happy to hear that we’ve made the installation process of our on-prem testing much simpler.

 

• The Usage Report is refined with more information.

We’ve updated the Usage Report both in the UI and the CSV document. Six columns have been added:

• Charge Type
• Credits Used
• Plan Name
• Report Notes
• First Sample
• Last Sample

 

Note: You can enjoy the improved reporting abilities for data created as early as January 2017.

 

• The API Test Maker supports Open Authentication (OAuth).

​We’ve enabled adding OAuth tokens to your API tests.

 

• The API Test Maker supports model level test generation.

​We’ve added the ability to create tests for every operation in your API with the single click of button.

 

• The Quick Test in the API Test Maker supports Private Locations.

​We’ve enabled executing API Quick Tests by using Private Locations behind a firewall.

 

• The API Test Maker supports ad hoc changes to API Keys and Basic Auth.

​We’ve added the ability to make changes to the API Key or Basic Auth for your API tests without having to regenerate all of your tests. Your authentication changes are automatically applied to your tests the next time you execute them.

New geo-locations available:

• GCE EU West (Frankfurt)
• GCE EU West (London)
• GCE Australia (Sydney)

• Azure is now fully supported!

You can now run your BlazeMeter tests through Azure’s geo-locations.

 

• Functional tests now support uploading files from shared folders

Use the scripts from your shared folders while functional testing, to save time, reduce friction and improve your workflow

 

• We’ve updated our loader, hope you like the new design

We would love to hear what you think.

• SQL Injection Testing

Have you verified that your API isn't vulnerable to a SQL injection attack? The API Test Maker now lets you create SQL injection tests. Confirm that each endpoint in your API is safe.

 

• Load Report was Deprecated

You can still find all the good stuff in the Timeline Report:

 

• Choose your preferred Interval from the top left corner of the report

• The GeoMean measurement selector can be chosen for the following KPIs: Response Time, Latency and Bytes

 

• Better Test Analysis - The Engine Health tab now shows the engines’ public IPs, in tests executed from now on.
• User Management Improved - User’s last access time is now shown instead of the last login time, in Users and Members tables (Account & Workspaces)
• Dedicated IPs Revamped - Are you using our Dedicated IPs to test behind the firewall? We’ve improved our syncing mechanism for a more fluent experience.

• Introducing Functional API Testing

 

1. Reuse your existing JMeter scripts and run them as Functional API tests, with the click of a button. Test single APIs or complete business scenarios and add them to your continuous testing process. You can also schedule tests to run periodically.

 

 

Functional API testing reports include: requests, responses, pass/fail indications based on assertions, and trends of multiple test executions. Read more here.

 

 

2. We’re also introducing the first version of the Functional API Test Maker for Automated Test Case Generation. Just upload your Swagger file and API testing scenarios will be auto-generated for you. Simply choose which of the scenarios to execute, at the click of a button or through your CI/CD process. You can also manually override or create tests.

 

Are your APIs complex? The Functional API Test Maker provides full test coverage.

 

Read more here.

 

 

• Oh… and we also redesigned the test creation selection page.

 

New geo-locations available:

• GCE Asia Southeast (Singapore)
• GCE US East (Virginia)

We now support CentOS and RHEL 7.3 for private locations (aka OPL).

Jenkins Pipeline is now supported by the BlazeMeter Jenkins Plugin v.2.8.

• BlazeMeter now supports JMeter 3.2!

• Manage your invoice details

Do you need to update your company or personal details in your invoice? Now you can make the changes by yourself.

In the Billing section of your Account Settings we added a section for “Billing Details”.

You can add your Name, Email, Company Name, Phone, Address details and VAT Number.

 

• Disable Legacy API Keys Yourself

 

As announced in our March 28 release, we will be deprecating existing API keys and moving to a new model that incorporates a key + secret and support for expiration dates to make them more secure. To make the upcoming deprecation process of the legacy API keys smoother, we added a new ability. Now, each user can disable their own API key.

 

 

Disabling Legacy API Keys can also be enforced by the account Admin. Just go to “General Settings” under the account settings.

 

 

• Apache JMeter^TM Version Automatically Detected

 

We updated the Apache JMeter™ version choosing mechanism in BlazeMeter. From now on, the default version will be “Auto Detect”. This means BlazeMeter will automatically choose an Apache JMeter™ version according to your script. If you choose to, you can override that version by selecting a different version from the dropdown menu, just like before.

 

• UI Upgrades

 

As part of our continuous effort to improve user experience, we updated the button you can use to invite users to collaborate. It now looks like this:

 

 

• Easier Account Upgrade

 

If you wish to upgrade your account, it is now easier than ever:

 

• Improved API Key Provisioning!

Check out our new API Keys on your personal settings tab in the settings section. As we’re going to deprecate the old API Keys on June 4th 2017, you'll need to generate new keys beforehand in order keep your API integrations working.

 

 

 

What’s new here:

• Extended, stronger keys, with an <ID>:<Secret> structure
• Ability to define no\multiple keys per user
• Ability to define an expiration period for a specific key
• Ability to define an expiration period for all the keys in the account (available for account admins under the Account menu - General Settings)

 

Note that the API key secret is only available on key creation and we cannot restore it, so make sure you copy the secret and keep it safe!

 

• Test alerts revamped:
• Customize when to be alerted. Failed tests notifications are especially useful for monitoring.
• Slack users - you can now configure a webhook to get alerts delivered straight to your chat channels!

 

 

• JMeter 3.1 is now the default version for test runs
• Improved handling of long Soak tests

• Do you have multiple workspaces? We now support aggregated reporting. We added a consolidated Usage Report at the account level.

 

 

 

• Catch up with our most recent product changes right from within the app through the Change Log link under the Help menu.

 

• Need to upgrade your subscription? You can easily use our In-App purchase ability from the billing section in the settings.

 

• If you haven’t checked out our V4 APIs, be sure to take a look in the new, improved API explorer. We’ve enhanced descriptions and made the explorer much faster when expanding the operations list for each API.

 

• Account administrators can now add and remove workspaces in the settings screen. Please note that having additional workspaces depends on your account subscription.

• Test Failure Criteria results now shown on the dashboard, in the improved Recent Test Runs list:
  • Tests configured with Test Failure Criteria will now show a pass/fail indication
  • Added new table filters for “Passed” \ “Failed” \ “Not Set” for easier orientation
• Added user and workspace search in the settings area to speed large list management
• Added API support for scheduling recurring tests. The /api/v4/schedules endpoint uses the well-known “cron” syntax. The full list of ‘schedules API’ and how to operate them can be found in the CA BlazeMeter API Explorer
• Added workspace selector in the settings area to switch between workspaces, while remaining in the same screen context

• CA BlazeMeter adds support for JMeter 3.1!
• New geo-locations available:
  • AWS EU West (London)
  • AWS Canada (Central)
• Simplified and shorter collaboration flow: invite team members and assign their roles and workspaces in a single step

• Redesigned the dashboard to present a quick overview of your workspace updates:
  • Recent test runs
  • Recent updated tests
  • Usage report graph
• Navigation and layout changes
  • The following capbilities were moved from the Dashboard to the Settings page (see top right menu)
    • Resources (Private IPs, Private Locations)
    • APM Credentials
    • Usage Report
    • User management
    • Billing Info
  • The Projects view was removed from the Dashboard and is now accessible only through the Projects drop down menu
• 'Personal Tests' was renamed to '<Your Username’s> Workspace. 'Organization' was renamed 'Workspace'. Both can be shared with other team members
• New user roles in Workspaces
  • Manager
  • Tester (default)
  • Viewer
• New Account user roles
  • Admin
  • Standard (default)
  • Billing
• Account owners have access to all of the Account’s Workspaces
• New API version
  • New API (v 4.0) provides the ability to manage users and workspaces
  • “Latest” version still points at v 2.0 and will point at v4 on January 29th, 2017

 

Read more about the new Workspaces and Projects and about Managing an Account.

 

Learn more about the new changes from these videos:

 

 

 

CA BlazeMeter added two new geo-locations:

• AWS US East (Ohio)
• GCE Asia Northeast (Japan)

In addition to many UI improvements, the following improvements and changes have been made:

 

• Test history UI changes -
  • Running tests are displayed on top, sorted chronologically by the test initiation time with the latest test presented first, and marked with a green button
  • Subsequently, the ended tests are displayed, sorted chronologically by the time the test ended, with the latest end time presented first
  • The date and time each test began (running tests) or ended, is displayed next to the test configuration details

 

 

• Performance improvements in large scale tests:
  • Engines are now issued together, leading to shorter time to test commencement
  • Better support and performance for multiple viewers

In addition to many bug and performance fixes, the following improvements and changes have been introduced:

• Changed the default JMeter version to 3.0 & the Java version to 1.8
• Default APM credentials can now be defined at the Organization level
• Comparison reports: labels now include execution times and improved display of KPIs
• Multiple UI and naming changes. Please note that OPL (On Premise Location) has been recently renamed to Private Location
• When you add a new user to your organization via invite, we simplify their onboarding experience by omitting the ‘personal tests’ workspace. This is just the first of series of expanded team and user management capabilities rolling out in our release train.

• BlazeMeter Added Two New Geo-Locations
  • AWS India (Mumbai)
  • GCE US West (Oregon)
• Major performance improvements in viewing test results
• Multiple bug fixes in the following sections:
  • Executive Summary
  • Statistics Calculations
  • Aggregate Report
  • Error Report
  • Taurus Tests
• The Personal Settings Dialog got a facelift
   

• BlazeMeter web application is now WCAG 2.0 compatible.
• Testers can increase the number of concurrent users in running large scale tests.
• Zooming-in on a specific timeframe in the aggregate report shows calculated percentiles.

• Ability to pause ramp up, and later resume ramping users while test is running.
•  

 

• Added packet-loss ratio to network emulation controls, to better support mobile application testing:

 

 

 

• Added ability to select a specific time span for the aggregate and error reports. Drag sliders to focus on a key period or eliminate ramp-up/ramp-down periods.

 

 

 

•  Added scenario and location filters to timeline report to provide finer granularity of data on multi-test and multi-geo tests.

 

 

 

• New Relic data now appears directly on the Timeline Report to support visual correlation with test data.  This eliminates the need to switch tabs to see New Relic data during tests.
• Added ability to create Taurus tests from the Web UI:

 

 

 

 

 

• Multi-tests can now be duplicated in a single operation.
• Complete refactor of 'original test configuration' tab in the report screen, based on user feedback.
• New view for billing-info page

 

 

 

• For clients who have chosen server-hour billing, the usage report now shows consumed and remaining server-hours instead of test credits consumed. 

 

• Enhanced Organization Support
  • Organization usage report - now organization administrators can view the subscription usage of the entire organization.
  • Added support for user to manage multiple organizations.
  • Tests can now be moved between organizations.
  • Consistent organization context switching: switching organizations now updates all drop-down menus, lists and selectors to reflect the chosen organization.
  • Added 'start collaborate' button in app top header to introduce users to Organizations capability and make creating organizations easy:

 

 

 

• Adding support for Gravatar (displays your avatar image from gravatar.com if login email registered in a gravatar.com account)
• Separation of workspace settings and user settings.
  • Workspace settings are on a dedicated "Settings" tab alongside Dashboard and Project tabs:
  •  

 

 

• User settings are now an overlay dialog, launched from by choosing "My Settings" in the top-right navigation menu:

 

 

• New drop-down list in top header for 'recent projects' – chose a project or select "Show all projects" to display a full-page list.
• Many screens now have unique and descriptive '<title>' to ease navigation via browser history.
• Java 8 - which supports SSL TLS 1.2 (This is new standard for web servers. Many tests previously failed due to the lack of SSL TLS 1.2).

• BlazeMeter adds support for JMeter 3.0!

• Usage report available: Now you can clearly view your test run history on a graph and export it in CSV format for further analysis

• Updated usability on the multi-test configuration page. Now you can:

  • Easily view how many scenarios will run, their duration, geo-locations and names

  • Easily view each scenario’s name, type, geo-location, number of virtual users and duration