search

joaomdmoura / crewAI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
https://crewai.com
MIT License
16.83k stars 2.27k forks source link

Vllm or Huggingface for local LLMs for CrewAI #388

Open rajeshkochi444 opened 3 months ago

rajeshkochi444 commented 3 months ago

Would it be possible for us to use Huggingface or vLLM for loading models locally. Ollama implantation bit more challenging

tridungduong-unsw commented 1 month ago

I have the same request features.

ITZRei commented 2 weeks ago

I have the same request features.