search

ProjectUnifree / unifree

MIT License
1.43k stars 75 forks source link

Fixes to HuggingfaceLLM Input Bugs #55

Closed bshikin closed 11 months ago

bshikin commented 11 months ago
  1. Using a [INST] ... [/INST] prompt template for HuggingfaceLLM
  2. Making sure there is only one instance of the LLM