search

zou-group / textgrad

TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.
http://textgrad.com/
MIT License
1.6k stars 129 forks source link

Support for HuggingFace models? #3

Open gubowen2 opened 3 months ago

gubowen2 commented 3 months ago

Hello, I think this is a great project and I would love to see it progress. Just wondering if there are plans to add support for HF models so that the optimization can happen locally. As a worker for hospitals, most data I am work with is PHI data, which is not allowed to leave the internet network. So the support for HF models will be greatly appreciated

mertyg commented 3 months ago

Hey @gubowen2 — thank you for the kind words! Yes for sure, making things work with HF / Open Source models is a big priority for us!

saisurajkarra commented 3 months ago

I did try to create my own HF engine and try to make gradient on the response but it fails

HelloWorldLTY commented 2 months ago

Thanks, it wll be a great enhancement.

LengyanReader commented 2 months ago

can I ask how long the support for opensource models can come up?

vinid commented 2 months ago

Hello! Support for open-source is already here! we have quite a few engines that cover most of open-source models. We don't yet have a hugging-face-specific implementation. See also this implementation