Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat: FreshDiskANN #275

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

Conversation

AveryQi115
Copy link
Contributor

TODO:

  • In memory vamana based on current segments
  • Vamana index with filtering
  • Vamana index with deletion
  • Optimize filtering algorithm

Discussions:

  • Current vamana index implementation use full precision building and searching, as current segments implementation is different from diskANN storage method, how to gradually build full-precision index stored in segments and using quantization to do the construction and searching process?

  • performance and precision

Signed-off-by: AveryQi115 <averyqi115@gmail.com>
Signed-off-by: AveryQi115 <averyqi115@gmail.com>
Signed-off-by: AveryQi115 <averyqi115@gmail.com>
Signed-off-by: AveryQi115 <averyqi115@gmail.com>
Signed-off-by: AveryQi115 <averyqi115@gmail.com>
@marcusinthesky
Copy link

Really excited to see the amazing progress here, have you seen meillisearch's Arroy rust DiskANN implementation: https://github.com/meilisearch/arroy ?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants