crewAIInc / crewAI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
https://crewai.com
MIT License
21.38k stars 2.97k forks source link

Feature Request: End-to-End Logging Including Intermediate Steps in crewAI #146

Closed Shivanandroy closed 3 months ago

Shivanandroy commented 10 months ago

Hello crewA Team,

Thank you for this awesome project!

I was wondering if there is a possibility of enhancing the logging capabilities of the crewAI. Currently, I am able to log the output of tasks, but an integrated feature for end-to-end logging, capturing all intermediate steps, would significantly improve the utility and debugging capabilities of the package.

greysonlalonde commented 10 months ago

@joaomdmoura I like this - I think a well-implemented auditing feature is needed for prod environments. Options for writing to various data stores, etc

joaomdmoura commented 10 months ago

Indeed, log is a must, right now you can it with LangSmight and other but we should have an native option, marking as feature accepted

JaDenis commented 10 months ago

I agree, i'd like to send everything that is printed in console via WebSockets to a web client. I can't make everyone i work with install VSCode and work with code, they need some kind of web app.

mdfederici commented 9 months ago

I also really need this feature to go to production using crewAI. I would like to store this information in a separate data store. Ideally I would be able to easily tell for each agent, each step in their thought process - what task they were trying to solve, what tool they used, what the input and output of the tool was, etc.

x-technik commented 8 months ago

This feature would be very nice to have.- Thanks for this awesome product.

JasonCoBA commented 7 months ago

Please implement this . An option in the agent that yields or streams its thoughts, actions is required.

I’m trying to implement this with websocket myself, but it’s challenging and should be done lower down.

sbhadana commented 5 months ago

what are other frameworks other than langsmith supported?

gadgethome commented 5 months ago

what are other frameworks other than langsmith supported?

You can try langtrace, langfuse and AgentOps.

sbhadana commented 5 months ago

what are other frameworks other than langsmith supported?

You can try langtrace, langfuse and AgentOps.

langfuse is giving object not calleable error. Langsmith works out of the box. Any workaround to get it by langfuse as well?

gadgethome commented 5 months ago

Maybe contact langfuse support and see if they have any known issues. thanks

ashokgit commented 4 months ago

Any open source tools for logging?