mlc-ai / binary-mlc-llm-libs

200 stars 45 forks source link

[Error] Mistral-7B-Instruct-v0.2 Model is creating garbage responses to prompts #114

Open kalyan-nakka opened 5 months ago

kalyan-nakka commented 5 months ago

I'm trying to build the MLC Chat Android app using the prebuilt models provided in this repository as per the instructions provided in https://llm.mlc.ai/docs/prebuilt_models.html#overview. All LLMs are working fine and are providing responses as expected but only Mistral-7B-Instruct-v0.2 model is generating garbage responses to the prompts as shown below.

This is happening for all kinds of prompts sending to the model.

Please help me with this error.

Screenshot_2024-04-18-16-09-21-52_39ee8d39e9d9fa2b63462cd99e6b41fe