search

mistralai / platform-docs-public

Apache License 2.0
24 stars 54 forks source link

Truncated Response number or date with open-mixtral-8x7b on "la plateforme" #35

Open M-kasinski opened 6 months ago

M-kasinski commented 6 months ago

Hello, Could you do something for the open-mixtral-8x7b model to fix the truncation bug on "la plateforme".

Here they explain what they did to solve it on a vllm server (with spacing between <s> and [INST]).

On api where they are in completion I solved the bug by following the issue resolution.

https://github.com/vllm-project/vllm/issues/2464

abhibisht89 commented 6 months ago

we do see this issue