search

QwenLM / qwen.cpp

C++ implementation of Qwen-LM
Other
506 stars 40 forks source link

为啥qwen.cpp在A100和A10性能差距很大 #56

Open zhangzai666 opened 7 months ago

zhangzai666 commented 7 months ago

简单测了一下qwen.cpp在A100和A10上的性能，每秒字数A100大概是A10的两倍左右。什么原因呢

Parallel-Hao commented 6 months ago

因为A100带宽是A10两倍？