This repository has been archived by the owner on Dec 6, 2024. It is now read-only.

为啥qwen.cpp在A100和A10性能差距很大 #56

Open

zhangzai666 opened this issue Dec 11, 2023 · 1 comment

zhangzai666 commented Dec 11, 2023

简单测了一下qwen.cpp在A100和A10上的性能，每秒字数A100大概是A10的两倍左右。什么原因呢

Parallel-Hao commented Dec 16, 2023

因为A100带宽是A10两倍？

# for free to subscribe to this conversation on GitHub. Already have an account? #.