wenhuchen
commented
2 months ago We tried with chat template, the performance is lower for few-shot learning. The chat template are mostly used in zero-shot for some models.
Closed eyuansu62 closed 2 months ago
wenhuchen
commented
2 months ago We tried with chat template, the performance is lower for few-shot learning. The chat template are mostly used in zero-shot for some models.
It is an uncommon approach to directly input a prompt string into a chat model without using a chat template, which may result in unexpected behavior.