Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Add support for creating a json output and additional tooling #42

Closed
rn opened this issue Apr 10, 2018 · 0 comments · Fixed by #48
Closed

Add support for creating a json output and additional tooling #42

rn opened this issue Apr 10, 2018 · 0 comments · Fixed by #48

Comments

@rn
Copy link
Member

rn commented Apr 10, 2018

When running tests either repeatedly or the same tests on different system it is often useful to compare results. Currently, we store the test results in a csv file which is a ok, but a bit tedious to post-process in particular when trying to compare different results.

The proposal is to stash all the tests results as well as the system information and test meta data (such as start/end times etc) in a single json file with a reasonably well defined schema.

Once we have that we should be able to add simple tooling to read/compare multiple json files and generate, for example, a summary csv file from it.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant