Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Performance and efficiency of data storage #77

Open
smarr opened this issue Mar 10, 2022 · 3 comments
Open

Performance and efficiency of data storage #77

smarr opened this issue Mar 10, 2022 · 3 comments

Comments

@smarr
Copy link
Owner

smarr commented Mar 10, 2022

The current form of storing all measurements in a table does not seem to work very well in practice.

It seems to take a lot of storage, and it seems to be slow to retrieve the data.

We may want to change how measurements are stored.

Initial ideas for possible options:

@smarr
Copy link
Owner Author

smarr commented May 20, 2022

For the different options, one thing to keep in mind:

https://twitter.com/Envek/status/1526922431780233218?t=l09q22EVlOSKsw41QHAXmA&s=19

Though, we don't need to worry about the cost of updates, since data is immutable.

@smarr
Copy link
Owner Author

smarr commented Aug 3, 2022

First work is done in #100.

@smarr
Copy link
Owner Author

smarr commented Aug 6, 2022

First set of benchmarks is implemented with #115.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant