Reports

The reporting tools will allow you to see the quality of your project over a specific period of time. The managerial reports comprise information about the number of runs, how many were successful, which tests were running, the average test duration, and how these key performance indicators perform over time.

You can also find information about your team's activity, including:

• How many new tests were authored?
• How many tests have been updated?
• How many are active (ran)?

📘

Advanced filters are available for paying customers

To read more about the advanced report filtering options, see here

You will receive a weekly summary via email, but you can also see all the information in real-time inside the Testim Editor.

Let's start digging into it.

Where to find the reports

1. Navigate to "Insights", and then to the "Reports" tab.
2. You will get a weekly report directly to your email.

Tests run results

Passed test runs

Test run is defined as a single execution of a single test with specific parameters and a specific browser.

• Percentage of test runs that pass during the selected period.
• Number of tests that passed out of the total number of tests that were run.
• Number of executions that passed out of the total number of executions that were run.
• Percentage changed compared to the previous period.

Running tests

A running test is defined as a test that ran at least one time in the selected period.

• Number of running tests during the selected period.
• Percentage changed compared to the previous period.

Average duration

Test run duration is defined as the running time for one run of a single test.

• Average duration of a test run during the selected period.
• Percentage changed compared to the previous period.

Tag test failure

This section includes test runs that failed and tagged. To read more about failure tagging see here.

Failure types

On the left-hand side, you can see all the failure options you used, based on the time filtered. By default, you will see only tagged runs. To see the entire failed distribution, toggle the "Show untagged".

On the right-hand side, you'll be able the view the distribution of your tests either in a pie chart or a graph.

Your team activity

Here you see:

• The number of new tests authored, compared to the previous period.
• The number of tests that were updated, compared to the previous period.

Broken Tests

This section presents the 3 most failed tests in the selected period.
Clicking on each item will lead you to the test run page to see all the failed runs for that specific test.

Clicking "Show All Tests" button will display the list of all failed tests during this period, sorted according to the number of failed runs.

Note: If the test ran less than 5 times in the selected period, it will not be displayed in this list.

Advanced filters

Filter by suite / label / scheduler / plan / test

Between the 5 filters above, only one filter can be applied at a time.
For the same filter, multiple selections are allowed, for example when selecting to filter by suites, you can select multiple suites.

Filter by branch

By default, the report is only showing runs in master.
You are able to choose a specific branch, some branches, or all branches.
Reset of this filter, will put master selected back (and only master).

Filter by branch

By default, the report is only showing runs in master.
You are able to choose a specific branch, some branches, or all branches.
Reset of this filter, will put master selected back (and only master).

Include evaluating tests

By default, only running tests will appear in the report. Tests in quarantine or evaluating are not included in the report. Toggle to include evaluating tests.
To read more about test status and how they can improve your test lifecycle, see here.

Company level report

To access the report at the company level click on avatar --> Reports

Project filter

The report contains all the projects under the company. Users can select to see only specific projects (by default the report is showing all the projects).

🚧

Company level report

Only the company owner and project owners can access the company-level report (project owners will only see their owned projects).