TinyLlama-1.1B-Chat-v0.6 Tokenization

[phaylon]

Hello, hope I'm in the right place for this.

It seems the 0.6 Chat tune is missing the ChatML specific tokenizer configuration?

Compare:

• 0.5: https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.5/blob/main/special_tokens_map.json
• 0.6: https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.6/blob/main/special_tokens_map.json

So it seems 0.6 runs with ChatML format but without the special tokens.

Apologies if I missed something.

[jzhang38]

The V0.6 model does not follow the ChatML format. Instead, it is trained with the Zephyr's recipe and follow the Zephyr's prompt format.