search

ypeleg / llama

User-friendly LLaMA: Train or Run the model using PyTorch. Nothing else.
330 stars 60 forks source link

llama 7b 4bit #13

Open GalloLuigi opened 1 year ago

GalloLuigi commented 1 year ago

Is possible run this code with llama 7b 4bit weight?