DUOMO / TransGPT

MIT License
707 stars 77 forks source link

[GPU 需求] TransGPT-7B 和TransGPT-MM-6B-v1 推理GPU需求? #17

Open dukelyuu opened 1 year ago

dukelyuu commented 1 year ago

TransGPT-7B 和TransGPT-MM-6B-v1 推理对GPU配置需求是多少?

threeColorFr commented 1 year ago

24GB足够

zhumorui commented 7 months ago

It took around 16GB RAM on TransGPT-MM-6B-v1.