The model did not return a valid JSON object

[yaoergogo]

The problem with using the LLAMA-2-7B-FP16 model, can someone help solve it?Thanks~~

[victordibia]

Hi,

This is a known issue tends to arise with smaller models, also mentioned in #27 We are currently running some experiments to see which small model provides decent performance #41 . Will post updates in that thread once there are promising results. -V

[yaoergogo]

你好

这是一个已知问题，较小的模型往往会出现，#27 中也提到我们目前正在进行一些实验，看看哪个小模型提供了不错的性能 #41 .一旦有希望的结果，将在该线程中发布更新。 -V Is there no suitable way to solve it at present？This can not return a valid JSON object, is it because the JSON format is not correct or other reasons？I hope to be able to use the local small model to achieve this function, currently still doing some code changes, hope to get your more detailed answers and analysis to have new ideas, thank you ~