Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Optimize index loading time #54

Closed
thammegowda opened this issue May 29, 2021 · 0 comments · Fixed by #55
Closed

Optimize index loading time #54

thammegowda opened this issue May 29, 2021 · 0 comments · Fixed by #55
Assignees
Labels
enhancement New feature or request

Comments

@thammegowda
Copy link
Owner

Now that index is getting big, we need to think about optimizing the loading of the index.

We can pickle dump index object for the first time and load from it for subsequent runs.
I am worried about a pickled object going out of sync with the code (hence I didn't do it at the first place)

Idea1: use version number -- if version number doesn't match, then rebuild the index.

But what do we do about the development version where the index is currently being edited?

idea2: add a CLI flag to force update index

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant