Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[T.3.1] Integrate Computational Notebooks with ReBenchDB #183

Open
smarr opened this issue Dec 4, 2021 · 0 comments
Open

[T.3.1] Integrate Computational Notebooks with ReBenchDB #183

smarr opened this issue Dec 4, 2021 · 0 comments
Labels
help-wanted We'd like help with this issue, and are happy to provide guidance Proposal Work proposed as part of a (rejected) funding application

Comments

@smarr
Copy link
Owner

smarr commented Dec 4, 2021

The goal is to have a somewhat common UI that enables easy reuse of analyses from previous projects, or experiments.

ReBenchDB will need an API to access data, as well as a library of analyses.
The API should be general enough to be used by other scripts as well.

Use cases we would want to support are:

  • basic analyses (speedups, overhead, scaling, performance regressions, ...)
  • correlating of data (different metrics, historical data, ...)

Other than Jupyter there might be other systems that could be appropriate:
https://www.samlau.me/pubs/computational-notebooks-design-space_VLHCC-2020.pdf

Ideally, the reports are easily versioned and reproducible.

Analyses, plots, and data processing code would idea be made available as a library of reusable notebook cells, that can be combined, adapted, and shared freely.

@smarr smarr added help-wanted We'd like help with this issue, and are happy to provide guidance Proposal Work proposed as part of a (rejected) funding application labels Dec 4, 2021
@smarr smarr moved this to WP.3 Performance Analysis Notebooks and a Library of Building Blocks in ReBench for a wider community Mar 19, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
help-wanted We'd like help with this issue, and are happy to provide guidance Proposal Work proposed as part of a (rejected) funding application
Projects
Status: WP.3 Performance Analysis Notebooks and a Library of Building Blocks
Development

No branches or pull requests

1 participant