What's torch_dtype used during evaluation?

Meituan-AutoML / MobileVLM

Strong and Open Vision Language Assistant for Mobile Devices

Apache License 2.0

890 stars 64 forks source link

What's torch_dtype used during evaluation? #53

Closed EasonXiao-888 closed 3 weeks ago

EasonXiao-888 commented 4 weeks ago

Thanks for your great work! I wonder what torch_dtype (bf16, fp16 or fp32) you set for evaluation on GQA、SQA、VQA(text) and etc. benchmark since I want to reproduce your wonderful work.