Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Compare View: Better Handling of Data for Multiple Environments #202

Open
smarr opened this issue May 4, 2024 · 0 comments
Open

Compare View: Better Handling of Data for Multiple Environments #202

smarr opened this issue May 4, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@smarr
Copy link
Owner

smarr commented May 4, 2024

Currently, the compare view shows data from different environments/machines by having the same benchmark multiple times, see for instance: https://rebench.dev/RPySOM/compare/47442d40216b6240aafe9a0a01668db08441b7f9..503a3c9bc7b7a3f0e4fe37cb518e4c289978f1e8

This is not perfect, because we don't see which machine is which easily, it's also just adding clutter. While we can click on the CPU icon to get the details, it's hidden, and not sure the sorting is consistent everywhere (it might be).
It's also not clear how different environments are handled for the executor comparison and the overview plots.

Before implementing something new/different, I think it would be good to sketch options.

Possible options might be:

  • stick with multiple rows per benchmark, but make the machines more easily recognizable. Perhaps color coding the CPU icons? or showing the host name?

  • or a more condensed view, having the environments on the same inline plot, and show the time difference for both environments next to each other. so diff column per environment.

There are probably other options.

Other work arounds to the whole issue could be:

  • having separate projects for different environments
  • having different executors to signify different environments
@smarr smarr added the enhancement New feature or request label May 4, 2024
@smarr smarr moved this to Backlog ReBenchDB in ReBench Summer 2024 May 17, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request
Projects
Status: Backlog ReBenchDB
Development

No branches or pull requests

1 participant