Insights and Analytics
Tests and Runs insights and analytics guide
Currents Dashboard Insights allows you to analyze the behaviour and dynamics of your Playwright or Cypress test suite over time. You can use the insights to track the performance of your runs/build and tests over time and to identify the most problematic tests - most flaky and most failing - that are worth fixing.
See the notes below to discover how specific metrics are getting calculated.
Runs Status
Represents distribution of the outcomes of your builds/runs over time.
Overall runs - overall runs created during the selected period, regardless of their completion or the end state
Failed runs - runs that have 1 or more failed tests. Failed runs count includes cancelled and timed-out tests.
Passed runs - runs that have 0 failed tests. Passed runs count includes cancelled and timed-out tests.
Pass Rate - passed runs / overall runs
Runs Duration
Runs Duration chart represents the daily/weekly average duration of fully reported runs. A fully reported run is a run that wasn't cancelled and didn't time out.
Please note that cancelled or timed-out runs are excluded from the report.
Runs Completion
Runs Completion chart represents the distribution of runs by their completion over time.
Overall runs - overall runs created during the selected period, regardless of their completion or the end state
Fully reported runs - runs that weren't cancelled and didn't time out
Cancelled runs - see Canceling Runs
Timed out runs - see Run Timeouts
Spec / Tests Size Chart
Specs / Tests size chart represents the maximum daily/weekly amount of specs/tests for fully completed runs. A fully reported run is a run that wasn't cancelled and didn't time out.
Please note that cancelled or timed-out runs are excluded from the report.
Spec files - the maximum number of spec files detected in a run for the selected period
Tests - the maximum number of tests detected in a run for the selected period
Test Results Chart
Test Results Chart shows the distribution of tests outcome over time.
Total tests - overall tests recorded for the selected period, regardless of their outcome
Passed tests - tests that successfully completed all attempts without any exceptions or errors during its execution
Failed tests - tests that either failed or were skipped because of an error in
beforeEach/beforeAll
Ignored test - tests that weren't run e.g.
it.skip()
Success Rate -
passed / (total - pending)
Tests Flakiness Chart
Test Results Chart shows the distribution of flaky tests over time.
Flaky tests - overall flaky tests detected for the period. See Flaky Tests
Flakiness rate -
flaky tests count / passed tests count
Last updated