intel / llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray
Apache License 2.0
99 stars 28 forks source link

try to fix evaluation problem #250

Open harborn opened 3 months ago

harborn commented 3 months ago

try to fix evaluation problem by replace END_KEY in prompt to tokenizer eos_token_id