blockentropy / ml-client

Machine Learning Clients for Open Source Infra
8 stars 3 forks source link

More genearl prompt formatting #19

Open isamu-isozaki opened 4 months ago

isamu-isozaki commented 4 months ago

This is a PR to let hugging face tokenizer handle prompt formatting and remove the need for the format_prompt scripts which we had to make for each model. I mainly tested on the phi3b model and it seemed to work