Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Should we enable BP reordering for the HNSW graph? #322

Open
mikemccand opened this issue Jan 6, 2025 · 0 comments
Open

Should we enable BP reordering for the HNSW graph? #322

mikemccand opened this issue Jan 6, 2025 · 0 comments

Comments

@mikemccand
Copy link
Owner

This exciting Lucene change will reorder Lucene documents to create a more compact HNSW graph while merging.

It's useful for vector-heavy Lucene indices that do not otherwise have a preference on how the documents are statically sorted.

The nightly benchy now tests KNN indexing+searching in several places: twice from nightlyBench.py for quantized and unquantized highly concurrent indexing performance, again in nightlyBench.py into the single-threaded consistent-segment-geometry search index, and again in runNightlyKnn.py which runs knnPerfTest in several configurations.

Let's try turning on this new BP reordering in some of these?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant