search

Portkey-AI / gateway

A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
https://portkey.ai/features/ai-gateway
MIT License
6.34k stars 455 forks source link

[Provider] Support for Infermatic AI #673

Open ashirwad19 opened 1 month ago

ashirwad19 commented 1 month ago

What Would You Like to See with the Gateway?

https://infermatic.ai/for-developers/

Context for your Request

No response

Your Twitter/LinkedIn

No response

Kinshuk0 commented 1 month ago

@ashirwad19 @vrushankportkey Hey can you explain a bit more ?

vrushankportkey commented 1 month ago

@Kinshuk0 here you have to do an LLM integration similar to the ones here - https://github.com/Portkey-AI/gateway/tree/main/src/providers

What we expect is that you write the appropriate request & response transformers and other handlers to make sure that you're able to call the Infermatic API using Portkey's universal API

https://infermatic.ai/docs/overview/

Kinshuk0 commented 1 month ago

@vrushankportkey Thank you for the explanation. I would like to work on this. Can you please assign it to me?

vrushankportkey commented 1 month ago

Yes please, go ahead!

PentesterPriyanshu commented 4 weeks ago

@Kinshuk0 are you still working on it @vrushankportkey assign this issue to me

vrushankportkey commented 3 weeks ago

Please go ahead!