From real-browser end user experience metrics to the latest features rolling into the “new test create” beta, there’s lots to see this week:

• End User Experience Monitoring (Real Browser Metrics)
• Report Actions Menu Moved, Tabs Restyled
• Java Version Override, Sync Start and Transaction Details in New Test Create (beta)
• Private Location Shows Who Launched Each Test
• Proxy Recorder: Choose Where To Launch It From
• API Functional Test Now Supports Custom JMeter Plugin Uploads

 

End User Experience Monitoring (Real Browser Metrics)

 

Now you can run real browsers during your performance tests to get End User Experience metrics. Watch the animation below or jump right to the Knowledge Base topic on End User Experience Monitoring.

 

 

 

Report Actions Menu Moved, Tabs Restyled

 

To make way for exciting new reporting controls we will be adding soon, we have moved the actions menu and restyled the tabs in reports:

 

 

Java Version Override, Sync Start and Transaction Details in New Test Create (beta)

 

• Support for Java version override
• Sync start (so all engines will start the test simultaneously)
• Transaction components display: “Generate Parent Sample” will no longer be set to true by default, when uploading a JMeter script with a transaction controller.

 

Private Location Shows Who Launched Each Test

 

Private Location status now shows who launched a test rather than who created it, so it’s easier to see who is using resources.

 

Proxy Recorder: Choose Where To Launch It From

 

You can now choose which location you want to launch the Proxy Recorder from:

 

 

 

API Functional Test Now Supports Custom JMeter Plugin Uploads

 

Need a plugin to make your API Functional test happen? Now you can upload plugin JARs just as you’ve always been able to with performance tests. Here’s our shiny new Mainframe RTE Protocol plugin in an API Functional Test configuration:

[GUI Functional testing] Test Suites and Multiple Iterations available to all users

 

Now all users have access to have multiple iterations of a test, based on test data provided. You will also notice a new design for a test report.

The Test Suites feature is available for users with a Pro or customized plan. The feature allows the user to group tests in a suite and launch the whole suite instead of running each test separately.

 

[GUI Functional testing] New browser versions available

 

We’ve added new browser versions including Chrome version 81, and Firefox version 76.

Enhanced Timeline report filter results

 

We enhanced the analyzing experience in the timeline report and made it easier to focus on a group of labels. We added the options to select all or unselect all results when filtering by a label. In addition, you can always reset to default to start over even if labels are not filtered.

 

Display N/A for unknown test duration 

In some cases we can’t determine the test configuration, for example when the script includes an Ultimate Thread Group. Up until now, the test duration displayed in the test configuration showed the plan limit.. Now, we simple display “N/A” when the duration cannot be determined.

What’s new for May 2022? 

[Mock Services] Warning Indication for Outdated Mock Services  

There are new features, capabilities and improvements being added to Mock Services on a regular basis. To leverage them, it is important to run Mock Services using the latest Mock Services image. In case of Mock Services running on BlazeMeter provisioned cloud locations this is automatically done for you. But for the ones running on OPL locations it may require manual steps to be done. Mock Services screen now displays which Mocks deployed on OPLs are using  older image versions and provides a way how to upgrade them directly from the screen. This way, you will never miss a single new feature. 

[Test Data] Better Guidance for New Test Data Users 

In case you are not using the Test Data feature yet, the Data Definition panel now shows better guidance and an explanation of how you can benefit from that feature and how to start using it in your existing tests or mock services. 

[Test Data] Optimized View of Data Entities in Data Size Settings 

The Data Size screen in the Data Settings is now optimized for showing multiple data entities in the tab bar. Regardless of how many entities you have, you can scroll through your data entities in the tab bar. 

[Mock Services] Warning Indication for Outdated Mock Services  

There are new features, capabilities and improvements being added to Mock Services on a regular basis. To leverage them, it is important to run Mock Services using the latest Mock Services image. In case of Mock Services running on BlazeMeter provisioned cloud locations this is automatically done for you. But for the ones running on OPL locations it may require manual steps to be done. Mock Services screen now displays which Mocks deployed on OPLs are using  older image versions and provides a way how to upgrade them directly from the screen. This way, you will never miss a single new feature. 

We got a new booting screen!
 

Waiting for your tests to be ready? We’ve upgraded the UX in our booting screen to make it easier to customize with the information you need. 

 

Besides the new look & feel, we’ve split the screen into two parts, advanced and basic, with added functionalities. For example, you can see logs for specific sessions, filter information, see only added sessions to a current test that is running, and more!

Enhancement to the Admin view - Locations Utilization 

We’ve made it easier to see where members in your account run their tests by adding the ability for account admins to see a graph representing the locations utilization spread between all the test runs in the account.

Ship’s new status

Any Ship that hasn’t been connected to BlazeMeter for over 3 months (e.g. server was offline, no network connection etc), will be marked as detached and unable to be used in the system for future test runs. If your Ship has been “detached” you will need to re-generate it or create a new ship. 

Personal settings have moved to the top header

Check out our sleek, new design in the top header for accessing your personal setting. Navigate from the top header to personal settings, to access the settings screen where you can change things such as your name and password. 

Manage account invites directly from envelope icon in header

You can now view all your account invites directly from the header. Just click on the envelope icon, and you’ll access the notifications. You can then choose to accept or decline.

 

New Admin view filters

We added extra filters to the admin view so you can now see  results by workspace or by location.

Added Descriptions to the Projects page

We added a description column to the project page to make it easier to understand the tests created..The description is fetched from the test’s description which is added in the test creation page.

Don’t miss these new features we have recently taken live:

• New Test Create (NTC) Multi-Test Is Here!
• End User Experience Monitoring: multi-step scenarios
• JMeter 5.0, Java 11 and Taurus 13.1 now supported
• New setting in NTC: delay between requests
• Usage Report CSV: “Test Ended” column added

 

New Test Create (NTC) Multi-Test Is Here!

 

The New Test Create (NTC) Multi-Test is here.  It’s never been easier to create multiple test collections that launch and report as a single test. Simply type a few characters to find the tests you want and add them.  Visualize the combined result, make local overrides and launch!

 

 

End User Experience Monitoring: multi-step scenarios

 

Need to monitor more than simple URLs - e.g. a page with login? Just upload one or more Selenium scripts recorded in Taurus YAML by the updated Chrome extension, enable End User Experience Monitoring and we’ll capture real-browser journeys throughout your load test.

 

JMeter 5.0, Java 11 and Taurus 13.1 now supported

 

We’ve upgraded our engine images to support:

• JMeter 5.0
• Java 11
• Taurus 13.1

 

New setting in NTC: delay between requests

 

When entering multiple URL/API requests in New Test Create (NTC), you can now add a delay between them by clicking on the “Scenario Definition” block:

 

 

Usage Report CSV: “Test Ended” column added

 

The Usage Report download CSV now includes a “Test Ended” column. Access the Usage Report in Settings > Account and Settings > Workspace (requires you to be an account admin or workspace manager, respectively).

Control your proxy authentication configuration

The BlazeMeter Proxy Recorder now supports port 80 as well as random ports. iOS users can now use the Proxy Recorder for recordings by choosing the random port option.

 

Debug mode UI upgraded

Now, users will see a blue “Debug Run” stripe in the Original Test Configuration tab.

Workspace search UI improved

Now, the workspaces navigation dropdown supports inline search for workspaces. Instead of very long scrolling, users can now search to speed/simplify the effort.

 

Smart Java version selector

The JMeter Properties section in the New Test Create will show users only the java versions that are relevant to their selected JMeter version.

New “Environment” page

The new environment page can be found in the account’s settings section, enabling users to configure a local plugins repository. At the moment, this page will be shown only for accounts with Private Locations and it includes the local JMeter repository configuration.

 

Navigate to the executive report directly from results email

 

We’ve added the option to view your executive summary report directly from your report notification email. 

[Performance] Running a yaml test with Taurus pass/fail module in BlazeMeter now supported

Up until now, the pass/fail module in the yaml script was ignored by BlazeMeter, and users had to redefine it in the Failure Criteria section in the test configuration UI. With this new feature, we are translating the majority of Taurus pass/fail capabilities into BlazeMeter's Failure Criteria, so that when a yaml script is uploaded to BlazeMeter the pass/fail module in the script will automatically appear in the test UI. 

Now you can also execute a test from Taurus with cloud provisioning, and the pass/fail module will be recognized by BlazeMeter and displayed in the report. 

[Performance] Test Email Subscribers: Control and Define Multiple Recipients

Now you can control and define a list of multiple subscribers to receive the test results email once the test run ends. To add people, just search other users in the workspace by their name or email address.

Your test configuration is still in progress and you don’t want all subscribers to receive the email of this specific run? No worries, before the test starts, you can choose to send the test only to yourself:

Ship Creation: Native and Kubernetes Commands

Similar to the docker run command, the agent (ship) creation now provides an option to select the Kubernetes templates for roles and deployments used in the Kubernetes setup or the command to run the native Windows (non-docker) environment.

Note that the Kubernetes template will require input from the end-user to properly prepare the yaml for use.

Ship creation: API for Kubernetes

 

We’ve improved the Kubernetes onboarding by providing an API that returns the service YML needed to deploy BlazeMeter’s ship on Kubernetes. Simply fill in the needed parameters and run the below command:

 

Curl https://a.blazemeter.com/api/v4/private-locations//ships//k8s-command -X POST --user :'

 

Example output (YML):

---

apiVersion: apps/v1

kind: Deployment

name: bzm-crane-5f3109442eab0d38bf2e8003

metadata:

 labels:

   roles: crane

   harbor_id: 5dc2b88zc929302cc776d373

   ship_id: 5f3109442eeb3d38bf2e8003

 name: crane

spec:

 replicas: 1

 selector:

   matchLabels:

     role: crane

     harbor_id: 5dc2b88zc929302cc776d373

     ship_id: 5f3109442eeb3d38bf2e8003

 template:

   metadata:

     labels:

       role: crane

       harbor_id: 5dc2b88zc929302cc776d373

       ship_id: 5f3109442eeb3d38bf2e8003

 spec:

   containers:

   - env:

- name: AUTO_UPDATE

 value: true

- name: CONTAINER_MANAGER_TYPE

 value: KUBERNETES

- name: HARBOR_ID

 value: 5dc2b88zc929302cc776d373

- name: SHIP_ID

value: 5f3109442eeb3d38bf2e8003

- name: AUTH_TOKEN

 value: 37b1d0dbd888fb98ce826edqb5c73d9v4d8e5bd8d21e65bd6981178d7e71a425

- name: A_ENVIRONMENT

 value: https://a.blazemeter.net

     image: blazemeter/crane:latest

     imagePullPolicy: Always

     name: bzm-crane-5f3109442eab0d38bf2e8003

   restartPolicy: Always

---

kind: Role

apiVersion: rbac.authorization.k8s.io/v1

metadata:

 namespace: ***USER INPUT REQUIRED***

 name: bzm

rules: [

- apiGroups: [\"\"] # \"\" indicates the core API group

 resources: [\"pods\", \"services\", \"endpoints\", \"daemonsets\"]

 verbs: [\"get\", \"list\", \"watch\", \"create\", \"update\", \"patch\", \"delete\", \"deletecollection\", \"createcollection\"]

 

[General] Taurus-cloud image footprint reduced

We’ve reduced the size of the Taurus-cloud image from 15.8 to 6 GB and the size of the Taurus-cloud-slim from 10.3 to 4 GB.

 

CA APM Rename

 

Oops, where is the CA APM integration? It is still here! You can find it in the same place, but under a new name DX APM

Resource Consumption Alert

 

Worried about users not calibrating their tests and running big, misconfigured tests which consume too much resources in your Private Locations? We added a new alert that triggers a notification to account admins when more than X amount of engines are configured. 

 

New Way to Create Private Locations

Now you get more control on your Private Locations and Ship’s content. Our new flow lets you define the properties of the Private Location which will affect the roles and behavior of the Ships configured in it.

New UX on Private Locations page 

 

We’ve refreshed the way you disable / enable the Private Location and changed the text-based links to icons.Please note that the “Delete location” operation has moved to the edit window.

 

Upcoming Taurus upgrade

 

Stay tuned! In our next release, we will upgrade the Taurus image in our images to 1.13.9 version

 

Upcoming Deprecations

The following items will be deprecated during December:

• Python 2.7
• Java 7, Java 9
• Jmeter 2.13
• Gatling 2.1.7, Gatling 2.2.3