[FR] Swappable LLM Drivers

HelgeSverre / extractor

Extractor: AI-Powered Data Extraction for your Laravel application.

MIT License

136 stars 13 forks source link

[FR] Swappable LLM Drivers #6

Open HelgeSverre opened 4 months ago

HelgeSverre commented 4 months ago

Similarly to what I've previously done with Brain, add support for implementing swappable and extendable Drivers for the underlying LLM API so we can use this package along with other providers that are cheaper/faster than OpenAI.

Providers

[ ] Together.ai
[ ] Fireworks.ao
[ ] Groq
[ ] Antrophic
[ ] Ollama (via rest API)

Clone the driver-based approached used in chatflow (private repo), should not be crazy hard to do.

Jens-dev commented 3 months ago

Thanks for your hard work! If you could also integrate a way to change the OpenAI URL would be awesome, or a dedicated AzureOpenAi Provider. Working in Europe, we can not use the standard OpenAI, thanks to the GDPR and the Data Residency problem. We had the idea to switch to the M$ Azure OpenAI Plan. Would that be possible?