What is the base context length of the model before extension to 16k?

deepseek-ai / DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself

https://coder.deepseek.com/

MIT License

5.99k stars 431 forks source link

Closed Calvinnncy97 closed 3 months ago

Calvinnncy97 commented 3 months ago

I think it is 4k if I am not wrong, but would like to clarify this. Thank you!

pkuzqh commented 3 months ago

4096