Is your feature request related to a problem? Please describe.
The HuggingFace inference API is gaining popularity, and I wanted to use the HuggingFace inference API on this https://huggingface.co/docs/api-inference/en/quicktour reference, which is not OpenAI compatible.
Describe the solution you'd like
We should define a new feature for this project and overwrite the HuggingFace Inference API.
Describe alternatives you've considered
There is no alternative way.
Additional context
Add any other context or screenshots about the feature request here.
Is your feature request related to a problem? Please describe. The HuggingFace inference API is gaining popularity, and I wanted to use the HuggingFace inference API on this https://huggingface.co/docs/api-inference/en/quicktour reference, which is not OpenAI compatible.
Describe the solution you'd like We should define a new feature for this project and overwrite the HuggingFace Inference API.
Describe alternatives you've considered There is no alternative way.
Additional context Add any other context or screenshots about the feature request here.