Skip to content

Conversation

ScottDugas
Copy link
Collaborator

@ScottDugas ScottDugas commented Aug 28, 2025

Without this change, if you add a new query and run the test with CORRECT_METRICS, it will update all the timings for all of the other queries. This is less important for the binp, but can make it hard to look at the metrics yaml diff, as there will be many lines to ignore.

With this change, it will keep the original info for every query that did not result in a diffence.

Here I have a demo of how this looks with this change: ScottDugas@b32570a
And here is how it looks if I run it without this change: ScottDugas@8f0778f

Without this change, if you add a new query and run the test with
CORRECT_METRICS, it will update all the timings for all of the
other queries. This is less important for the binp, but can make it
hard to look at the metrics yaml diff, as there will be many lines
to ignore.

With this change, it will keep the original info for every query
that did not result in a diffence.
@ScottDugas ScottDugas added the testing improvement Change that improves our testing label Aug 29, 2025
@ScottDugas ScottDugas requested a review from normen662 August 29, 2025 17:12
@ScottDugas ScottDugas marked this pull request as ready for review August 29, 2025 17:12
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
testing improvement Change that improves our testing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant