search

tryAGI / LangChain

C# implementation of LangChain. We try to be as close to the original as possible in terms of abstractions, but are open to new entities.
https://tryagi.gitbook.io/langchain/
MIT License
453 stars 70 forks source link

Providers: HuggingFace #27

Open nigue3025 opened 9 months ago

nigue3025 commented 9 months ago

Hi,

I'm new to Langchain and LLM.

I've recently deployed an LLM model using the Hugging Face text-generation-inference library on my local machine.

I've successfully accessed the model using Python by following the instructions provided at https://python.langchain.com/docs/integrations/llms/huggingface_textgen_inference.

However, I would prefer to use WPF with C#. I'm delighted to discover that there is support for Langchain with .NET.

Is there a way for me to access Hugging Face text-generation-inference in Langchain using C# as well?

Since I've deployed the model on a local server machine and I want to access the model from another client machine via an intranet connection, I'm open to alternative solutions aside from using text-generation-inference in C# on the client machine.

Any advice would be greatly appreciated.

HavenDV commented 9 months ago

Hi. Unfortunately there is still a lot missing from this project and currently HuggingFace support is quite limited and doesn't allow you to do what you described