Humaneval, use base model or instruct finetuned model?

deepseek-ai / DeepSeek-LLM

DeepSeek LLM: Let there be answers

https://chat.deepseek.com/

MIT License

1.41k stars 92 forks source link

Open jasonzliang opened 6 months ago

jasonzliang commented 6 months ago

Which one would you recommend to use to get the best possible performance?

DeepSeekPH commented 6 months ago

The finetuned model yields better Humaneval results.