New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

自研推理引擎性能问题 #1687

Open

zainlau opened this issue Feb 10, 2025 · 0 comments

zainlau commented Feb 10, 2025

我们自研的推理引擎是基于vllm做了深度优化的，但是用metagpt跑2048游戏比vllm慢了七八分钟，这是哪的问题呢，理论上讲是应该比vllm更快的

# for free to join this conversation on GitHub. Already have an account? # to comment