search

Portkey-AI / gateway

A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
https://portkey.ai/features/ai-gateway
MIT License
6.09k stars 419 forks source link

[Provider] Add Deepinfra #110

Closed vrushankportkey closed 9 months ago

vrushankportkey commented 9 months ago

Docs: https://deepinfra.com/docs

Suraj-Bhandarkar-S commented 9 months ago

Hello, if this is available can I take a look at this? its something new for me but want to give it a try :).

vrushankportkey commented 9 months ago

Hi @Suraj-Bhandarkar-S yes, this is an open issue that you can work on. Thank you so much for contributing to the project!

vidurkhanal commented 9 months ago

@vrushankportkey @Suraj-Bhandarkar-S mind if I give it a try as well?

vrushankportkey commented 9 months ago

Please feel free to collaborate/contribute. I think as the project grows, the best practices on this should emerge. I'd suggest to use this thread to collaborate.

Suraj-Bhandarkar-S commented 9 months ago

@vidurkhanal Thank you :) I have started to work, will try if any thing will post in the thread. Thanks again

VisargD commented 9 months ago

Hey folks. Just checking up on this. Please let me know if there are any blockers that you are facing.

vidurkhanal commented 9 months ago

Hey @VisargD, as of today the only service offered by deepinfra is inference (emitting a models output as it is). The confusion is which action would it fall under. Would it be chat or embed!?

VisargD commented 9 months ago

Deepinfra has an OpenAI compatible API: https://deepinfra.com/docs/advanced/openai_api

You can simply map this API with /chat/completions route of gateway