I'm experiencing an issue with the Cloudflare endpoint, which seems to only work with Hugging Face models. I'd like to propose a change to make the endpoint more flexible and support other models, such as Cloudflare's models (e.g., @cf/mistral/mistral-7b-instruct-v0.1).
I think this makes sense for sure, maybe we could check if the string startswith @ and if not we add the @hf/ prefix to prevent breaking changes with existing deployments?
I'm experiencing an issue with the Cloudflare endpoint, which seems to only work with Hugging Face models. I'd like to propose a change to make the endpoint more flexible and support other models, such as Cloudflare's models (e.g., @cf/mistral/mistral-7b-instruct-v0.1).
Current code:
https://github.com/huggingface/chat-ui/blob/7692f71091e027a99195d6bcff6a2ec8c9180983/src/lib/server/endpoints/cloudflare/endpointCloudflare.ts#L19
Proposed change:
By making this change, we can enable the use of a wider range of models with the Cloudflare endpoint, including Cloudflare's own models.