Can faiss query vectors across multiple cuda streams #3745
Unanswered
guoxinghai
asked this question in
Q&A
Replies: 0 comments
# for free
to join this conversation on GitHub.
Already have an account?
# to comment
-
For faiss serving, can Cuda Stream be used to enable GPU to process multiple query requests in parallel, so as to improve GPU utilization?
Beta Was this translation helpful? Give feedback.
All reactions