Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

请问如何在0.3.1.3版本中设置使用reranker模型 #4941

Open
southkorea2013 opened this issue Sep 12, 2024 · 7 comments
Open

请问如何在0.3.1.3版本中设置使用reranker模型 #4941

southkorea2013 opened this issue Sep 12, 2024 · 7 comments
Labels
bug Something isn't working

Comments

@southkorea2013
Copy link

你好，

已经在Xinference中启动了reranker的模型，在RAG对话时查看chatchat的log看起来没有调用reranker模型。

谢谢！
@southkorea2013 southkorea2013 added the bug Something isn't working label Sep 12, 2024
@948024326
Copy link

需要打开rerank部分的代码，参考kb_chat.py的这部分代码
image

@tf18536
Copy link

tf18536 commented Sep 24, 2024

还要自己写一个 LangchainReranker类和compress_documents方法？

@948024326
Copy link

还要自己写一个 LangchainReranker类和compress_documents方法？

不用，都写在rerank.py里面了，你试一下
image

@tf18536
Copy link

tf18536 commented Sep 25, 2024

还要自己写一个 LangchainReranker类和compress_documents方法？

不用，都写在rerank.py里面了，你试一下 image

非常感谢！
好像这个没有调用xinfer的reranker，是封装了sentence_transformers单独启动了一个reranker

@github-actions GitHub Actions
Copy link

这个问题已经被标记为 stale ，因为它已经超过 30 天没有任何活动。

@github-actions github-actions bot added the stale label Oct 25, 2024
@Dax-Zhang-pxy
Copy link

问下这个问题解决了吗？

@github-actions github-actions bot removed the stale label Nov 1, 2024
@ja3592
Copy link

ja3592 commented Nov 22, 2024

需要打开rerank部分的代码，参考kb_chat.py的这部分代码 image

这个原代码上已经写了“不再适用”了

@dosubot dosubot bot mentioned this issue Dec 26, 2024
Open
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@ja3592 @southkorea2013 @948024326 @tf18536 @Dax-Zhang-pxy