Hardware requirements for using BLIP2 locally

salesforce / LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

BSD 3-Clause "New" or "Revised" License

9.8k stars 963 forks source link

Hardware requirements for using BLIP2 locally #577

Open hwxmcMST opened 11 months ago

hwxmcMST commented 11 months ago

Hi,

I am a user of the Lavis library. Now I am doing some research for the hardware requirements when using BLIP2 model. Do you know the hardware requirements for the BLIP2 model? I am looking forward to hearing from you.

Best regards, Hao

starush commented 11 months ago

I am using RTX 3070 with 8Gb for captioning with Salesforce/blip2-opt-2.7b model. It works.