mistralai / mistral-inference

Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.37k stars 817 forks source link

Mixtral-8X7B-Instruct-v0.1 produces the context in Answer #126

Open BadrinathMJ opened 5 months ago

BadrinathMJ commented 5 months ago

I have tried the Mixtral-8X7B-Instruct-v0.1 for named entities recognition. 15 days ago, it was giving the correct output means directly giving the output in JSON file format. But from last few days, with same prompt, it is printing the context, question and prompt with answer.