Test View

Structured view of tests executed within each spec file.

For each spec file, the Dashboard displays a list of executed tests along with insights into their execution. To analyze a specific test:

Select the run → Open the “Spec Files” tab → Choose a spec file from the list → Select any test from the test list.

When you select a test, you can view theTest Detailsand access advanced features such as Attempts, Console , Metrics, History, Top Errors, Annotations and Visual Diff.

Test View

Attempts

For every test attempt, the Dashboard provides the following details:

  • Error Details: For Failed tests, the details include the error message and the exact line in the source code (Spec File) where the failure occurs.

  • Screenshots: Images captured during test execution.

  • Videos: Full test run recordings.

  • Traces: Available to open directly in the Playwright Trace Viewer or download.

  • Test Steps: Detailed test-level analysis . See more at Step-Level Reporting.

  • Visual Diff: Available when enabled the Playwright Visual Testing.

  • Attachments: Any additional files associated with the test.

Test View - Attempts

For Flaky Tests, there will be at least one Failed attempt and one Passed attempt. Both show detailed information such as screenshots, videos, traces, test steps, visual diffs, and attachments. Error details are only shown for failed attempts. Passed attempts will show the message "No failures detected".

Flaky Tests - Attempts

Console

The Playwright console displays each test attempt’s result, including timestamps, expected status, and Currents recording URL, along with any error details. See more details on Console Output.

Console Output - Test View

Metrics

The Metrics tab provides a summary of the six key metrics available in the Test Explorer:

  • By Flakiness, Status: Failed Duration vs. Passed Duration and Flaky Duration vs. Non-Flaky Duration.

  • Compared to the Previous Period: Executions, Avg. Duration, Flakiness Rate and Failure Rate.

For more information on these metrics and how the performance charts work, please check Test Explorer Metrics and Performance Charts.

Test View - Metrics

History

The History tab displays a timeline of test executions, organized chronologically and filterable by branch, history range, and test status. For additional details, refer to Test History.

Test View - History

Top Errors

The top errors display the most frequent issues over the past days, with filters for 7, 14, 28, or 45 days. For every error, the Dashboard displays:

  • The error message associated with the test failure.

  • The number of previous executions where the failure was encountered.

  • Chronologically sorted list of the most recent test executions affected by this error. Affected test executions are those that have failed or flaked because of this error.

The Top Errors view also shows some metrics related to each error:

  • Failures: The number of failed test executions associated with this error. A failed test can have multiple related errors.

  • Failure Ratio: Proportion of the test failures associated with this error.

  • Flaky: The number of flaky test executions associated with this error. A flaky test can have multiple related errors.

  • Flakiness Ratio: Proportion of flaky test executions associated with this error. A flaky test can have multiple related errors.

Annotations

Display additional test-related information added through Playwright Annotations, including ownership details, metadata, links to external resources such as Jira tickets or GitHub issues, and any relevant notes.

Visual Diff

Display visual testing outputs generated by Playwright’s native visual comparison features or by third-party tools such as Argos, Applitools, or Percy. See more details at Playwright Visual Testing.

Last updated

Was this helpful?