Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat(vdb): add HNSW vector index for TiDB vector store with TiFlash #12043

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

bowenliang123
Copy link
Contributor

@bowenliang123 bowenliang123 commented Dec 24, 2024

Summary

Screenshots

Checklist

Important

Please review the checklist below before submitting your pull request.

  • This change requires a documentation update, included: Dify Document
  • I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • I've updated the documentation accordingly.
  • I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods

@bowenliang123 bowenliang123 force-pushed the tidb-vector-index branch 7 times, most recently from 08cc63b to 1ca40ee Compare December 24, 2024 15:42
@bowenliang123 bowenliang123 changed the title [WIP] feat: use vector index in tidb vdb feat(vdb): add vector column index for TiDB vector store Dec 24, 2024
@bowenliang123 bowenliang123 marked this pull request as ready for review December 24, 2024 17:21
@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. 👻 feat:rag Embedding related issue, like qdrant, weaviate, milvus, vector database. labels Dec 24, 2024
@bowenliang123 bowenliang123 changed the title feat(vdb): add vector column index for TiDB vector store feat(vdb): add HNSW vector column index for TiDB vector store Dec 25, 2024
@bowenliang123 bowenliang123 force-pushed the tidb-vector-index branch 6 times, most recently from 8214c02 to 61d846f Compare December 25, 2024 05:47
@bowenliang123 bowenliang123 changed the title feat(vdb): add HNSW vector column index for TiDB vector store feat(vdb): add HNSW vector index for TiDB vector store with TiFlash support Dec 25, 2024
@bowenliang123 bowenliang123 changed the title feat(vdb): add HNSW vector index for TiDB vector store with TiFlash support feat(vdb): add HNSW vector index for TiDB vector store with TiFlash Dec 25, 2024
@bowenliang123 bowenliang123 force-pushed the tidb-vector-index branch 3 times, most recently from 1ce4b1e to 843a0ac Compare December 25, 2024 17:52
@laipz8200 laipz8200 requested a review from JohnJyong December 26, 2024 04:08
@bowenliang123
Copy link
Contributor Author

Hi, is there any blocking issue or advice for this PR? Feel free to ask me to follow. cc @JohnJyong @laipz8200

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
👻 feat:rag Embedding related issue, like qdrant, weaviate, milvus, vector database. size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

feat: add HNSW vector index for TiDB vector store
1 participant