bentoml / OpenLLM

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
https://bentoml.com
Apache License 2.0
10.12k stars 641 forks source link

feat: OpenLLM integration with Microsoft Word #1112

Open GPTLocalhost opened 6 days ago

GPTLocalhost commented 6 days ago

Feature request

Thank you for this great repo. I have recently integrated OpenLLM with Microsoft Word through my local Word Add-in (GPTLocalhost). Would it be possible to add this integration in the following section of this repo, providing users with another reason to try OpenLLM? Appreciate your consideration.

Examples

This section provides the tutorials for a curated list of example projects to help you learn how BentoML can be used for different scenarios.

https://docs.bentoml.com/en/latest/use-cases/index.html

Motivation

Showcase the possibility of running OpenLLM locally in Microsoft Word, as an alternative to Microsoft's Colipot in Word.

Other

No response

GPTLocalhost commented 3 days ago

BTW, a demo showing the integration between OpenLLM and Microsoft Word has been uploaded to YouTube here.