Spec Files

API Reference - Spec Files resource

This resource represents the spec files and their performance metrics, computed based on the recorded results.

Querying this resource will fetch all the executions recorded between date_start, date_end with all the filters applied, group the results by spec file name and calculate metrics:

  • overallExecutions - overall executions included in the aggregation.

  • avgDuration - an average value of the durations for non-failed executions, measured in seconds; set includeFailedInDuration to true to include failed executions in the calculation

  • failedExecutions - count of executions with at least 1 failed test.

  • flakyExecutions - count of executions with at least 1 flaky test.

  • timeoutExecutions - count of executions that were marked as timed out.

  • fullyReported - count of executions that were fully reported - i.e. all the known tests fully completed and reported the results

  • suiteSize - maximum number of tests across all the included executions

  • failureRate - the ratio of failedExecutions / overallExecutions

  • timeoutRate - the ratio of timeoutExecutions / overallExecutions

  • flakeRate - the ratio of flakyExecutions / overallExecutions

The results will be sorted according to the order parameter. Using this query would allow to programmatically access the data that is available in Test Suite Explorer.

circle-info

This resource uses Offset Pagination as documented at Pagination

List the spec files associated to your specific organization and project

GET v1/spec-files/:projectId

Path Parameters

Name
Type
Description

projectId*

String

Your project ID

Query Parameters

Name
Type
Description

limit

Number

Pagination limit 1-50. Default: 50

page

Number

Page 0+. Default: 0. See Pagination

date_start*

ISOString

Date start - the test results included within the date range will be included.

date_end*

ISOString

Date end - the test results included within the date range will be included.

tags[]

String[]

List of tags for filtering the included test results. To provide multiple values, use tags[]=valueA&tags[]=valueB

authors[]

String[]

List of tags for filtering the included test results. To provide multiple values, use authors[]=valueA&authors[]=valueB

branches[]

String[]

List of tags for filtering the included test results. To provide multiple values, use branches[]=valueA&branches[]=valueB

includeFailedInDuration

Boolean

Include failed spec files in duration calculation. Default: false.

order

Enum

Defines the attribute to order the spec files list. Default: avgDuration.

Valid values: avgDuration, failedExecutions, failureRate, flakeRate, flakyExecutions, fullyReported, overallExecutions, suiteSize, timeoutExecutions, timeoutRate

specNameFilter

String

A string that is included in the spec file name. Default: empty.

dir

Enum

The direction of the spec files list sorting. Default: desc.

Options: asc, desc.

Last updated

Was this helpful?