vicuna-tools / vicuna-installation-guide

The "vicuna-installation-guide" provides step-by-step instructions for installing and configuring Vicuna 13 and 7B
285 stars 34 forks source link

General Question #17

Closed Proper231 closed 1 year ago

Proper231 commented 1 year ago

I know other Vicuna installs require you to get the llama weight in order to run vicuna, is that also the case for this installation?

fredi-python commented 1 year ago

No, you don't need to have the llama weights for this install. This guide uses the full vicuna weights, instead of only the deltas. Normally you need to merge the vicuna deltas with the llama weights, but thanks to a user on HF(HuggingFace) who has already merged it, we can use the full vicuna weights.

Proper231 commented 1 year ago

ahhh ok, thank you for the clarification