search

ollama / ollama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.
https://ollama.com
MIT License
93.67k stars 7.4k forks source link

llama3.1 8b template seems to be different from that in huggingface #6310

Open fzyzcjy opened 2 months ago

fzyzcjy commented 2 months ago

What is the issue?

Hi thanks for the tool! When reading https://ollama.com/library/llama3.1:8b-instruct-q4_K_M/blobs/11ce4ee3e170, it seems different from https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct/blob/main/tokenizer_config.json#L2053. For example, it does not mention Cutting Knowledge Date: December 2023.

Therefore, I wonder whether it is expected or a bug? I have heard some people seems to say small models are sensitive to templates, so making it exactly the same as the official one may be useful.

OS

No response

GPU

No response

CPU

No response

Ollama version

No response

mxyng commented 2 months ago

template has been updated but not uploaded yet due to some technical difficulties

fzyzcjy commented 1 month ago

Hi, is there any updates? Looking forward to the fix, thanks!