substratusai / images

Official Substratus Container Images
1 stars 0 forks source link

trainer: Copy tokenizer model #44

Closed samos123 closed 11 months ago

samos123 commented 11 months ago

The tokenizer model is required by for conversions but missing after finetuning. This ensures the tokenizer.model file is present in the finetuned model as well.