search

tryAGI / LangChain.Providers

Part of the LangChain.NET project. Has separate abstractions, does not contain dependencies on the main project and can be used independently
https://tryagi.github.io/LangChain.Providers/
MIT License
7 stars 5 forks source link

Providers: HuggingFace #8

Open nigue3025 opened 1 year ago

nigue3025 commented 1 year ago

Hi,

I'm new to Langchain and LLM.

I've recently deployed an LLM model using the Hugging Face text-generation-inference library on my local machine.

I've successfully accessed the model using Python by following the instructions provided at https://python.langchain.com/docs/integrations/llms/huggingface_textgen_inference.

However, I would prefer to use WPF with C#. I'm delighted to discover that there is support for Langchain with .NET.

Is there a way for me to access Hugging Face text-generation-inference in Langchain using C# as well?

Since I've deployed the model on a local server machine and I want to access the model from another client machine via an intranet connection, I'm open to alternative solutions aside from using text-generation-inference in C# on the client machine.

Any advice would be greatly appreciated.

HavenDV commented 1 year ago

Hi. Unfortunately there is still a lot missing from this project and currently HuggingFace support is quite limited and doesn't allow you to do what you described