Add environment variable to force regression test harness to generate expected results #848
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The regression test harness used to automatically generate
expected results if the tests did not match. This then marked
the test as skipped. This is only desired behaiour if the developer
wants to generate test data. In normal CI we want the test to fail if
the actual does not match the expected.
Also add an extra echo to the runtests.sh script to mitigate a bug in the shippable console folding.
Also switch the order of the tests run so the test generation will function correctly (the algorithm relies on the public user being run first).