[Feature Request] HuggingFace Agents as a service

[danny-avila]

https://huggingface.co/docs/transformers/transformers_agents

[deepankarm]

@danny-avila do you want to use transformers agents with the model hosted via huggingface inference endpoint, or are looking for langchain-serve to host the model in addition to the agent?

[danny-avila]

The former. HF Agents has a unique way of chaining that I think would be awesome to have the option to serve. Also I’ve tested langchain with HF inference models and seems there’s a lack of support for a lot of it

[deepankarm]

We'll look into implementing this next week @danny-avila

[danny-avila]

Amazing, thanks for the quick reply and great work with this project!