lamalab-org / matextract-book

http://matextract.pub/
MIT License
24 stars 1 forks source link

Suggest to chose fp16 or bf16 configuration for fine-tuning to match the same as the training of the model #124

Open MrtinoRG opened 1 month ago

kjappelbaum commented 1 month ago

closed via #137

kjappelbaum commented 1 month ago

The corresponding precisions are also logged here https://docs.google.com/spreadsheets/d/14vbBbuRMEHoqeuMHkTfw3uiZVmyXNuoSp8s-aHvfvZk/edit?gid=0#gid=0 besides the HF wiki

kjappelbaum commented 1 month ago

let's add a reference to that (so that this book also stays a useful resource for us ;))