[GPU 需求] TransGPT-7B 和TransGPT-MM-6B-v1 推理GPU需求？

DUOMO / TransGPT

MIT License

713 stars 77 forks source link

Open dukelyuu opened 1 year ago

dukelyuu commented 1 year ago

TransGPT-7B 和TransGPT-MM-6B-v1 推理对GPU配置需求是多少？

threeColorFr commented 1 year ago

24GB足够

zhumorui commented 7 months ago

It took around 16GB RAM on TransGPT-MM-6B-v1.