Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[T.2.3] Add ReBenchDB Result Comparability Analysis #181

Open
smarr opened this issue Dec 4, 2021 · 0 comments
Open

[T.2.3] Add ReBenchDB Result Comparability Analysis #181

smarr opened this issue Dec 4, 2021 · 0 comments
Labels
help-wanted We'd like help with this issue, and are happy to provide guidance Proposal Work proposed as part of a (rejected) funding application

Comments

@smarr
Copy link
Owner

smarr commented Dec 4, 2021

Expand ReBenchDB's support for data provenance by detecting environmental differences that affect the comparability of results. Operating system, software, or CPU microcode updates
can change performance and make comparison with historic data invalid.

By highlighting differences and providing confidence levels, awareness of such external variables will increase and help research to judge whether comparisons are meaningful.
@smarr smarr added help-wanted We'd like help with this issue, and are happy to provide guidance Proposal Work proposed as part of a (rejected) funding application labels Dec 4, 2021
@smarr smarr moved this to WP2. Simplifying Data Management and Provenance Tracking in ReBench for a wider community Mar 19, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
help-wanted We'd like help with this issue, and are happy to provide guidance Proposal Work proposed as part of a (rejected) funding application
Projects
ReBench for a wider community
Status: WP2. Simplifying Data Management and Provenance Tracking
Milestone
No milestone
Development

No branches or pull requests
1 participant
@smarr