TencentARC / SmartEdit

Official code of SmartEdit [CVPR-2024 Highlight]
227 stars 6 forks source link

至少需要多少显存可以运行? #17

Closed Dongqi-Fan closed 2 months ago

Dongqi-Fan commented 2 months ago

您好!请问SmartEdit-7B和13B至少需要多少显存可以推理呢?我发现13B在V100上跑不了

yuzhou914 commented 2 months ago

Please use A100(40G) for SmartEdit-7B and H800(80G) for SmartEdit-13B when inference.