rmihaylov / mpttune

Tune MPTs
Apache License 2.0
84 stars 16 forks source link

How to save the model after fine-tuning #13

Open FarziBuilder opened 1 year ago

FarziBuilder commented 1 year ago

You have direct cmds for inference & loading but not for saving

Einengutenmorgen commented 1 year ago

When using the standard code from the read.me, it should be saved at mpt-7b-storywriter-4bit-alpaca. The exact path depends on your directory, but code saves model as well