Inference widget for chat models should send example response back

huggingface / huggingface.js

Utilities to use the Hugging Face Hub API

https://hf.co/docs/huggingface.js

MIT License

1.37k stars 213 forks source link

Closed abidlabs closed 2 months ago

abidlabs commented 3 months ago

In the inference widget for chat models e.g. https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1, we should send the example back, otherwise if a user sends a new message, they'll get this error:

julien-c commented 3 months ago

for @mishig25 maybe?

abidlabs commented 2 months ago

It looks like this has been fixed. Thanks @mishig25 and team!