Error while serving - Githubissues

microsoft / LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.

Other

1.29k stars 148 forks source link

Error while serving #23

Open vanmosti opened 7 months ago

vanmosti commented 7 months ago

Hi, I have the combined weights, yet I keep getting this error when attempting to serve: 2023-11-16 21:42:58 | ERROR | stderr | NotImplementedError: Cannot copy out of meta tensor; no data!

Any ideas? PyTorch, CUDA, GPUs, Checkpoints are in order.