search

mem0ai / mem0

The Memory layer for your AI apps
https://mem0.ai
Apache License 2.0
21.6k stars 1.97k forks source link

Does the llm not support models on hugging face (open source)? #1734

Open bank010 opened 3 weeks ago

bank010 commented 3 weeks ago

🚀 The feature

Does the llm not support models on hugging face (open source)?

Motivation, pitch

Does the llm not support models on hugging face (open source)?

roshanr11 commented 2 weeks ago

tldr - yes, huggingface models are now supported with LiteLLM integration.

Based on the docs right now, looks like there's support for embedding models: https://docs.mem0.ai/components/embedders/models/huggingface#hugging-face.

However, from twitter: https://x.com/taranjeetio/status/1824113002641326245 I saw that LiteLLM support was added last week. Combine this with LiteLLM's docs: https://docs.litellm.ai/docs/providers/huggingface.

Basically, you can do this as follows:

image

but replace "model":___ with "huggingface/" such as "huggingface/facebook/blenderbot-400M-distill".