search

kbressem / medAlpaca

LLM finetuned for medical question answering
GNU General Public License v3.0
491 stars 58 forks source link

Error loading 7B weights for medAlpaca #23

Closed aadiharan closed 1 year ago

aadiharan commented 1 year ago

Hi!

I've been trying to run the medAlpaca training script based on the example given in the README.md.

However, I get this error when I load the 7B model : bias is on the meta device, we need avalueto put in on 0

What might be the reason behind this error? And how do we fix this?

Thanks!

System configuration:

GPU : NVIDIA RTX 3080 Ti 24 GB RAM : 64 GB

Running medalpaca/train.py in a virtual environment; all dependencies installed using requirements.txt provided.

kbressem commented 1 year ago

Can you provide more information, what code you run exactly?