description |
---|
Currents Reporting API - Data Format Reference |
Currents can accept results from arbitrary testing frameworks. This document provides detailed instructions for creating test results data compatible with Currents.
- To upload the results use currents-upload.md command.
- Refer to currents-convert.md to see how we convert the results from various popular testing framework to "Currents Format" that conforms to the specification presented below.
To upload the results to Currents create a "Results Directory" with all the necessary files. The directory will be used as the --output-dir
parameter for currents-upload.md command, for example:
npx currents convert --output-dir path-to-results-directory
Within the Results Directory the following structure of files and directories is expected.
results-dir/
├── instances/
│ ├── <instance-id-1>.json
│ ├── <instance-id-2>.json
│ └── <instance-id-n>.json
│── config.json
└── fullTestSuite.json
The output consists of two main components:
fullTestSuite.json
is the #full-test-suite JSON document that contains the tests expected to be reported. It does not contains test results.config.json
is a #configuration-file that contains the metadata like test framework name, version and moreinstances
folder contains #instance-files - JSON document that represents a spec file or a logical collection and the associated test results.
The Full Test Suite is a JSON-formatted file that contains the list of all the tests expected to be reported to the Currents platform for the current build / run.
Each element in the array of fullTestSuite.json
file represents a group of tests, organized by the name
property which defines the group name.
Note that the property "name" is showed as the "group name" in the dashboard.
{% hint style="info" %} Currents requires that all test results from the Full Test Suite be submitted before the project's specified timeout. If results are not received by the deadline, the run is marked as timed out. See run-timeouts.md. {% endhint %}
Full Test Suite file
The root of the fullTestSuite.json
file is a list of elements of the type Group
.
{% hint style="info" %}
The SuiteTest
's can be part of any Group
and may even be included in multiple Group
s.
{% endhint %}
Full Test Suite file root object: Array<Group>
[
{
"name": "Dashboard Tests",
"tags": ["e2e", "dashboard"],
"tests": [
{
"title": ["dashboard", "login"],
"spec": "__tests__/dashboard/#.spec.tsx",
"tags": ["completed"],
"testId": "a50d141accce5aaa"
}
...
],
},
{
"name": "Landing Tests",
"tags": ["e2e", "landing"],
"tests": [
{
"title": ["landing"],
"spec": "__tests__/landing/landing.spec.tsx",
"tags": ["incomplete"],
"testId": "7yyhd141aicke532sa"
}
...
],
}
...
]
{% hint style="info" %}
Starting on version 1.6.8 of @currents/cmd
package, multiple files are allowed as input, each one representing a Group
. See currents-convert.md input file flag.
{% endhint %}
Property | Type | Required | Description |
---|---|---|---|
name | string | Yes | Represents the group ID that will be visualized in the dashboard. All the tests will be organized by the group ID. |
tags | Array<string> | Yes | Run-level tags for this run / build. See playwright-tags.md. |
tests | Array< SuiteTest > | Yes | List of included tests, including test title, spec file, test tags and testId.
|
Property | Type | Required | Description |
---|---|---|---|
title |
Array<string> |
Yes | Test description plus title. |
spec |
string |
Yes | The spec file where this test is defined. |
tags |
Array<string> |
No | A list of tags or associated with the test for categorization or filtering. |
testId |
string |
Yes | A unique identifier for the test case. It is created with a hash of the spec file property and the title. See how to generate this property. |
The config.json
file contains the metadata used by Currents to properly display results in the dashboard. Example:
{
"framework": "postman",
"frameworkVersion": "1.12.12",
"frameworkConfig": {
"format": "junit"
}
}
Property: framework
Description: Name of the framework used to execute the tests. The currently accepted values are postman
, vitest
and wdio
(WebDriverIO) Support for other frameworks will be added in the future.
Type: postman | vitest | wdio
Property: frameworkVersion
Description: Testing framework version used to execute the tests.
Type: String
Property: frameworkConfig
Description: Contains information about the configuration of the framework. Currently the property format
with value junit
is allowed.
Type:
{
"format": "junit"
}
Instance File is a JSON document that represents spec file and included tests execution results.
{% hint style="info" %} Some testing frameworks are not bound to filesystem (e.g. Postman), so Instance File can be a logical collection of tests. {% endhint %}
Instance JSON file example
{
"groupId": "e2e",
"spec": "src/same-title.test.ts",
"startTime": "2024-11-21T03:47:14.963Z",
"results": {
"stats": {
"suites": 1,
"tests": 3,
"passes": 2,
"pending": 0,
"skipped": 1,
"failures": 0,
"flaky": 1,
"wallClockStartedAt": "2024-11-21T03:47:14.963Z",
"wallClockEndedAt": "2024-11-21T03:47:16.134Z",
"wallClockDuration": 1171
},
"tests": [
{
"_t": 1732160836119,
"testId": "fa8675d9f8d0a03f",
"title": ["Test cases with same title", "Test case example"],
"state": "failed",
"isFlaky": true,
"expectedStatus": "passed",
"timeout": 0,
"location": {
"column": 1,
"file": "src/same-title.test.ts",
"line": 1
},
"retries": 4,
"attempts": [
{
"_s": "failed",
"attempt": 1,
"startTime": "2024-11-21T03:47:16.119Z",
"steps": [],
"duration": 7,
"status": "failed",
"stdout": [],
"stderr": [
"Error: \u001b[2mexpect(\u001b[22m\u001b[31mreceived\u001b[39m\u001b[2m).\u001b[22mtoBe\u001b[2m(\u001b[22m\u001b[32mexpected\u001b[39m\u001b[2m) // Object.is equality\u001b[22m\n\nExpected: \u001b[32m2\u001b[39m\nReceived: \u001b[31m0\u001b[39m\n at Object.toBe (/Users/miguelangarano/Documents/GitHub/currents-reporter/examples/src/same-title.test.ts:7:17)\n at Promise.then.completed (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:298:28)\n at new Promise (<anonymous>)\n at callAsyncCircusFn (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:231:10)\n at _callCircusTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:316:40)\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at _runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:252:3)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:126:9)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:121:9)\n at run (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:71:3)\n at runAndTransformResultsToJestFormat (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapterInit.js:122:21)\n at jestAdapter (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapter.js:79:19)\n at runTestInternal (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:367:16)\n at runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:444:34)\n at Object.worker (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/testWorker.js:106:12)"
],
"errors": [
{
"message": "Error: Error: \u001b[2mexpect(\u001b[22m\u001b[31mreceived\u001b[39m\u001b[2m).\u001b[22mtoBe\u001b[2m(\u001b[22m\u001b[32mexpected\u001b[39m\u001b[2m) // Object.is equality\u001b[22m\n\nExpected: \u001b[32m2\u001b[39m\nReceived: \u001b[31m0\u001b[39m\n\n 5 |\n 6 | test('Test case example', () => {\n> 7 | expect(j++).toBe(2);\n | ^\n 8 | });\n 9 |\n 10 | test.skip('Test case example', () => {\n\n at Object.toBe (/Users/miguelangarano/Documents/GitHub/currents-reporter/examples/src/same-title.test.ts:7:17)\n at Promise.then.completed (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:298:28)\n at new Promise (<anonymous>)\n at callAsyncCircusFn (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:231:10)\n at _callCircusTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:316:40)\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at _runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:252:3)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:126:9)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:121:9)\n at run (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:71:3)\n at runAndTransformResultsToJestFormat (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapterInit.js:122:21)\n at jestAdapter (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapter.js:79:19)\n at runTestInternal (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:367:16)\n at runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:444:34)\n at Object.worker (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/testWorker.js:106:12)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:310:21\n at Array.map (<anonymous>)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:306:61\n at Array.map (<anonymous>)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:305:39\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async Promise.all (index 0)\n at CustomReporter.onTestFileResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:283:19)\n at ReporterDispatcher.onTestFileResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/@jest/core/build/ReporterDispatcher.js:30:9)\n at onResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/@jest/core/build/TestScheduler.js:154:7)",
"location": { "column": 17, "file": "../..", "line": 7 }
}
],
"error": {
"message": "Error: Error: \u001b[2mexpect(\u001b[22m\u001b[31mreceived\u001b[39m\u001b[2m).\u001b[22mtoBe\u001b[2m(\u001b[22m\u001b[32mexpected\u001b[39m\u001b[2m) // Object.is equality\u001b[22m\n\nExpected: \u001b[32m2\u001b[39m\nReceived: \u001b[31m0\u001b[39m\n\n 5 |\n 6 | test('Test case example', () => {\n> 7 | expect(j++).toBe(2);\n | ^\n 8 | });\n 9 |\n 10 | test.skip('Test case example', () => {\n\n at Object.toBe (/Users/miguelangarano/Documents/GitHub/currents-reporter/examples/src/same-title.test.ts:7:17)\n at Promise.then.completed (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:298:28)\n at new Promise (<anonymous>)\n at callAsyncCircusFn (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:231:10)\n at _callCircusTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:316:40)\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at _runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:252:3)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:126:9)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:121:9)\n at run (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:71:3)\n at runAndTransformResultsToJestFormat (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapterInit.js:122:21)\n at jestAdapter (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapter.js:79:19)\n at runTestInternal (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:367:16)\n at runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:444:34)\n at Object.worker (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/testWorker.js:106:12)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:310:21\n at Array.map (<anonymous>)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:306:61\n at Array.map (<anonymous>)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:305:39\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async Promise.all (index 0)\n at CustomReporter.onTestFileResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:283:19)\n at ReporterDispatcher.onTestFileResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/@jest/core/build/ReporterDispatcher.js:30:9)\n at onResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/@jest/core/build/TestScheduler.js:154:7)",
"location": { "column": 17, "file": "../..", "line": 7 }
}
},
{
"_s": "passed",
"attempt": 1,
"startTime": "2024-11-21T03:47:16.131Z",
"steps": [],
"duration": 0,
"status": "passed",
"stdout": [],
"stderr": [],
"errors": []
},
{
"_s": "failed",
"attempt": 2,
"startTime": "2024-11-21T03:47:16.132Z",
"steps": [],
"duration": 0,
"status": "failed",
"stdout": [],
"stderr": [
"Error: \u001b[2mexpect(\u001b[22m\u001b[31mreceived\u001b[39m\u001b[2m).\u001b[22mtoBe\u001b[2m(\u001b[22m\u001b[32mexpected\u001b[39m\u001b[2m) // Object.is equality\u001b[22m\n\nExpected: \u001b[32m2\u001b[39m\nReceived: \u001b[31m1\u001b[39m\n at Object.toBe (/Users/miguelangarano/Documents/GitHub/currents-reporter/examples/src/same-title.test.ts:7:17)\n at Promise.then.completed (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:298:28)\n at new Promise (<anonymous>)\n at callAsyncCircusFn (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:231:10)\n at _callCircusTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:316:40)\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at _runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:252:3)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:148:7)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:121:9)\n at run (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:71:3)\n at runAndTransformResultsToJestFormat (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapterInit.js:122:21)\n at jestAdapter (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapter.js:79:19)\n at runTestInternal (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:367:16)\n at runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:444:34)\n at Object.worker (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/testWorker.js:106:12)"
],
"errors": [
{
"message": "Error: Error: \u001b[2mexpect(\u001b[22m\u001b[31mreceived\u001b[39m\u001b[2m).\u001b[22mtoBe\u001b[2m(\u001b[22m\u001b[32mexpected\u001b[39m\u001b[2m) // Object.is equality\u001b[22m\n\nExpected: \u001b[32m2\u001b[39m\nReceived: \u001b[31m1\u001b[39m\n\n 5 |\n 6 | test('Test case example', () => {\n> 7 | expect(j++).toBe(2);\n | ^\n 8 | });\n 9 |\n 10 | test.skip('Test case example', () => {\n\n at Object.toBe (/Users/miguelangarano/Documents/GitHub/currents-reporter/examples/src/same-title.test.ts:7:17)\n at Promise.then.completed (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:298:28)\n at new Promise (<anonymous>)\n at callAsyncCircusFn (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:231:10)\n at _callCircusTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:316:40)\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at _runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:252:3)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:148:7)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:121:9)\n at run (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:71:3)\n at runAndTransformResultsToJestFormat (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapterInit.js:122:21)\n at jestAdapter (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapter.js:79:19)\n at runTestInternal (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:367:16)\n at runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:444:34)\n at Object.worker (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/testWorker.js:106:12)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:310:21\n at Array.map (<anonymous>)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:306:61\n at Array.map (<anonymous>)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:305:39\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async Promise.all (index 0)\n at CustomReporter.onTestFileResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:283:19)\n at ReporterDispatcher.onTestFileResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/@jest/core/build/ReporterDispatcher.js:30:9)\n at onResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/@jest/core/build/TestScheduler.js:154:7)",
"location": { "column": 17, "file": "../..", "line": 7 }
}
],
"error": {
"message": "Error: Error: \u001b[2mexpect(\u001b[22m\u001b[31mreceived\u001b[39m\u001b[2m).\u001b[22mtoBe\u001b[2m(\u001b[22m\u001b[32mexpected\u001b[39m\u001b[2m) // Object.is equality\u001b[22m\n\nExpected: \u001b[32m2\u001b[39m\nReceived: \u001b[31m1\u001b[39m\n\n 5 |\n 6 | test('Test case example', () => {\n> 7 | expect(j++).toBe(2);\n | ^\n 8 | });\n 9 |\n 10 | test.skip('Test case example', () => {\n\n at Object.toBe (/Users/miguelangarano/Documents/GitHub/currents-reporter/examples/src/same-title.test.ts:7:17)\n at Promise.then.completed (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:298:28)\n at new Promise (<anonymous>)\n at callAsyncCircusFn (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/utils.js:231:10)\n at _callCircusTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:316:40)\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at _runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:252:3)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:148:7)\n at _runTestsForDescribeBlock (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:121:9)\n at run (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/run.js:71:3)\n at runAndTransformResultsToJestFormat (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapterInit.js:122:21)\n at jestAdapter (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapter.js:79:19)\n at runTestInternal (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:367:16)\n at runTest (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/runTest.js:444:34)\n at Object.worker (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/jest-runner/build/testWorker.js:106:12)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:310:21\n at Array.map (<anonymous>)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:306:61\n at Array.map (<anonymous>)\n at /Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:305:39\n at processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async Promise.all (index 0)\n at CustomReporter.onTestFileResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/packages/jest/src/reporter.ts:283:19)\n at ReporterDispatcher.onTestFileResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/@jest/core/build/ReporterDispatcher.js:30:9)\n at onResult (/Users/miguelangarano/Documents/GitHub/currents-reporter/node_modules/@jest/core/build/TestScheduler.js:154:7)",
"location": { "column": 17, "file": "../..", "line": 7 }
}
},
{
"_s": "passed",
"attempt": 3,
"startTime": "2024-11-21T03:47:16.133Z",
"steps": [],
"duration": 0,
"status": "passed",
"stdout": [],
"stderr": [],
"errors": []
}
]
}
]
}
}
The properties that can be found in an instance file are the following:
Root Object
Property | Type | Required | Description |
groupId | string | Yes | Identifier for the test group It provides a reference of what are the tests executed about. |
spec | string | Yes | The name of the spec file or logical collection that contains the executed tests. The Example: |
startTime |
(ISO Datetime) | Yes | The timestamp indicating when the execution of the spec file started in ISO 8601 format. |
results | Array< TestResult > | Yes | Contains an array of test results. |
Property | Type | Required | Description |
stats | StatsObject | Yes | Summary statistics for the test run. |
tests | Array< Test > | Yes | Array of objects, each representing an individual test result. |
Property | Type | Required | Description |
suites | number | Yes | Number of logical grouping or collection of tests results. |
tests | number | Yes | The total number of tests executed in the current instance. |
passes | number | Yes | The number of tests that passed in the current instance. |
pending | number | Yes | The number of tests that are pending to be executed and can be reported later. |
skipped | number | Yes | The number of tests that were not executed on purpose in the current instance. |
failures | number | Yes | The number of tests that failed in the current instance. |
flaky | number | Yes | The number of tests marked as flaky by the testing framework in the current instance. |
wallClockStartedAt | string (ISO Datetime) | Yes | Time when the first test started its first attempt in ISO 8601 format. |
wallClockEndedAt | string (ISO Datetime) | Yes | Time when the last test finished its last attempt in ISO 8601 format. |
wallClockDuration | number | Yes | Total duration of the spec file tests execution in milliseconds. |
Each object in the tests
array represents the execution result of a test, possibly with multiple attempts.
Property | Type | Required | Description |
_t | number | Yes | The timestamp indicating when the execution of the spec file started, in milliseconds. |
testId | string | Yes | Unique identifier for the test. See how to generate this property. |
title | Array<string> | Yes | Array containing the specification and title of the test. Example: ["75119228-2d2d-4e59-b426-60a002b8cdce / Get Run", "Response status code is 200"] . |
state | failed | passed | skipped | Yes | Final state of the test. |
isFlaky | boolean | Yes | Indicates whether the test is flaky. |
expectedStatus | failed | passed | skipped | Yes | The expected status of the test. |
timeout | number | Yes | Time in milliseconds that the test execution lasted without having a clear state result. |
location | Location | Yes | Object containing file location details for the test. |
retries | number | Yes | Number of retries attempted for the test. |
attempts | Array< Attempt > | Yes | Array of objects representing each attempt made for the test. |
Property | Type | Required | Description |
column | number | Yes | Column number of the test in the source file. |
file | string | Yes | The file path where the test is defined. |
line | number | Yes | Line number of the test in the source file. |
Object describes an individual attempt of a test.
Property | Type | Required | Description |
_s | passed | failed | pending | Yes | Status of the test attempt. |
attempt | number | Yes | Index of the attempt. Defines the order of the attempts execution. |
startTime | string (ISO Datetime) | Yes | Timestamp when the attempt started in ISO 8601 format. |
steps | Array< Step > | Yes | Array of steps executed during the attempt. |
duration | number | Yes | Duration of the attempt in milliseconds. |
status | passed | failed | pending | Yes | Final status of the attempt. |
stdout | Array<string> | Yes | Standard output logs for the attempt. |
stderr | Array<string> | Yes | Standard error logs for the attempt. |
errors | Array< Error > | Yes | Array of error objects encountered during the attempt. |
Property | Type | Required | Description |
title | string | Yes | The title or description of the step. Example: "Validate API response schema" . |
category | string | No | The category of the step, indicating its classification. Example: "API Test" . |
duration | number | Yes | The duration of the step in milliseconds. Example: 200 . |
error | Error | No | An optional error object describing any issue encountered during the step execution. |
startTime | string (ISO Datetime) | Yes | Step start date time, in ISO 8601 format. |
Property | Type | Required | Description |
message | string | Yes | A description of the error encountered during the test attempt. Example: "expected 631 to be below 200" . |
stack | string | No | The stack trace related to the error. Example: "AssertionError: expected 631 to be below 200\n at Object.eval sandbox-script.js:2:1)." . |
value | string | No | The type or categorization of the error. Example: "AssertionFailure" . |
The testId is a hash composed by the title of the test and the spec file name. Use this function to generate it.
export function generateTestId(testTitle: string, specFileName: string): string {
const combinedString = `${testTitle}${specFileName}`;
const fullHash = crypto
.createHash('sha256')
.update(combinedString)
.digest('hex');
return fullHash.substring(0, 16);
}