mistralai / mistral-inference

Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.49k stars 835 forks source link

Fix: no system prompt in request #75

Open michel-ds opened 9 months ago

michel-ds commented 9 months ago

Bump FastChat dependency in Dockerfile to fix system prompt bug.

Bug results in all system prompts being set to an empty string in FastChat versions prior to 0.2.32, see https://github.com/lm-sys/FastChat/pull/2581