getomni-ai / zerox

PDF to Markdown with vision models
https://getomni.ai/ocr-demo
MIT License
6.58k stars 358 forks source link

Can we add openrouter as an API provider? #62

Open chenyuz3 opened 1 month ago

chenyuz3 commented 1 month ago

Or simply let us decide the url for api (for openai compatible apis)?

hiidemo commented 1 month ago

I am also interested in this issue

tylermaran commented 1 month ago

Hey @chenyuz3.

  1. There is a PR open to add vercel sdk (#46) to switch between different models on the node package.
  2. Totally agree on allowing a url for openai compatible apis. We've had this request a few times!

Also are you on the python or the node version right now?

chenyuz3 commented 1 month ago

Hey @chenyuz3.

  1. There is a PR open to add vercel sdk (Add Vercel SDK to node package to support multiple models #46) to switch between different models on the node package.
  2. Totally agree on allowing a url for openai compatible apis. We've had this request a few times!

Also are you on the python or the node version right now?

Hi Tyler, I am using python and I tried to use the Azure option in the demo where I tried to simply change the url there but it failed

pradhyumna85 commented 1 month ago

@chenyuz3, your use case is already supported in python SDK, you just need to set different environment variables and pass the model parameter as shown here https://docs.litellm.ai/docs/providers/openrouter