Open dukelyuu opened 1 year ago
TransGPT-7B 和TransGPT-MM-6B-v1 推理对GPU配置需求是多少?
24GB足够
It took around 16GB RAM on TransGPT-MM-6B-v1.
TransGPT-7B 和TransGPT-MM-6B-v1 推理对GPU配置需求是多少?