crewAIInc / crewAI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
https://crewai.com
MIT License
18.97k stars 2.61k forks source link

Possible to add RAG and small GUI? #18

Closed fxtoofaan closed 1 month ago

fxtoofaan commented 8 months ago

Would love to see some kind of RAG and UI implemented. Thank you

hugofreire commented 8 months ago

RAG will be awesome

fxtoofaan commented 8 months ago

local RAG and local ollama llm model(s) example code please :)

joaomdmoura commented 8 months ago

Nice, okay I hear you, I'll look into a specific simple RAG default tool maybe and add more ollama examples

okoliechykwuka commented 8 months ago

Thanks, @joaomdmoura , I noticed you implemented RAG in the financial analyst example.

https://youtu.be/e0Uj4yWdaAg

mindwellsolutions commented 7 months ago

@joaomdmoura Thank you for working on adding RAG, this will be huge. The ability for CrewAI to read through a whole folder of documents, pdfs (potentially spreadsheets, ebooks, datasets) as its research source, in place of DuckDuckGoSearch using the internet for research. This would allow people to point the agent towards larger bodies of documents, knowledge, pdfs and ebooks, to help agents tap into local sources for research and responses. This could be incredibly powerful :)

Support for API Embedding to VectorDBs (ChromaDB or Pinecone) using Gemini/ChatGPT API and Local Embedding (Like Instructor-XL) would be great. Although API is likely the preferred option for ease of scalability and speed.

ewebgh33 commented 7 months ago

+1

I would really, really like to be able to a) give agents bodies of specific knowledge via RAG

And b) also give them examples of their expected output as docs they can reference.

Maybe (b) can be achieved in prompt, but this would be clunky I feel. Or (b) maybe if we're using ChatGPT4.x, we can feed it a document and hope it understands the format enough to mimic on output.

But definitely (a) giving them specific knowledge would be the next logical step to empowering the agents to do different jobs?

joaomdmoura commented 7 months ago

This is getting prioritized to be worked on next

ewebgh33 commented 7 months ago

Excellent news! Very excited.

I think this would really supercharge crewAI and give it the best of both worlds that Autogen (agents) and taskweaver (code-first) have. One of the main things I would love to try is mixing general knowledge with coding ability, and with Autogen/Taskweaver I feel you get one or the other - not both!

WismutHansen commented 7 months ago

Would this help with implementing RAG: https://github.com/KillianLucas/aifs

scaruslooner commented 7 months ago

excited

slavakurilyak commented 7 months ago

AI File System can be used as a tool for crewAI that would unlock RAG-pipelines for local search (file or folder search)

slavakurilyak commented 6 months ago

RAG is now part of the crewai-tools library

slavakurilyak commented 6 months ago

Excited to see the new UI

bhargav-11 commented 5 months ago

bump!!!

airtonix commented 5 months ago

don't waste time on a UI. it's orthogonal to the purpose of this library.

joaomdmoura commented 5 months ago

Yup UI us coming, we kept on pushing it to build the backbones of the lib but we will also need it ourselves, so expected it sooner than later

joaomdmoura commented 5 months ago

https://github.com/joaomdmoura/crewAI/issues/18#issuecomment-1955750679 About RAG ^

magedhelmy1 commented 4 months ago

Dear @joaomdmoura, sorry to bother you on this. What is the ETA? PS, keep the good work up!

joaomdmoura commented 4 months ago

UI is in the works and scheduled to drop in the next 30d :) Rag is now supported over tools :D

João Moura @joaomdmoura http://twitter.com/joaomdmoura

Em ter., 30 de abr. de 2024 às 18:19, Maged Helmy @.***> escreveu:

Dear @joaomdmoura https://github.com/joaomdmoura, sorry to bother you on this. What is the ETA? PS, keep the good work up!

— Reply to this email directly, view it on GitHub https://github.com/joaomdmoura/crewAI/issues/18#issuecomment-2087360532, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFC3N6JZQS4MDOVERYFNS3ZAADGXAVCNFSM6AAAAABBE2PH6CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBXGM3DANJTGI . You are receiving this because you were mentioned.Message ID: @.***>

shawnholt commented 3 months ago

A lot of people have been drawn to autogen because it's much more comfortable to work with a GUI , rather than code. I see a lot of abandoned attempts and "coming soon", but based on this thread alone it does not seem like it is a priority, please help us understand where it fits into the roadmap. Thank you!

YohanReddy commented 2 months ago

UI is in the works and scheduled to drop in the next 30d :) Rag is now supported over tools :D -- João Moura @joaomdmoura http://twitter.com/joaomdmoura Em ter., 30 de abr. de 2024 às 18:19, Maged Helmy @.> escreveu: Dear @joaomdmoura https://github.com/joaomdmoura, sorry to bother you on this. What is the ETA? PS, keep the good work up! — Reply to this email directly, view it on GitHub <#18 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFC3N6JZQS4MDOVERYFNS3ZAADGXAVCNFSM6AAAAABBE2PH6CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBXGM3DANJTGI . You are receiving this because you were mentioned.Message ID: @.>

Any update on the UI? Can't wait to get hands-on

cbarkinozer commented 2 months ago

Is there any news or an ETA from UI?