search

crewAIInc / crewAI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
https://crewai.com
MIT License
18.54k stars 2.55k forks source link

How do I get the input and output of each LLM call #890

Open Frog863 opened 1 month ago

Frog863 commented 1 month ago

How do I get the input and output of each LLM call

theCyberTech commented 1 month ago

You can us agent ops, which is integrated within crewai, please install latest version of crewai which is version 0.36.0

Frog863 commented 1 month ago

I updated to version 0.36.1 and then how do I see the LLM input and output at each step

freddyvega commented 1 month ago

After you install crewai[tools] you set your API key and initilizize agent ops. One of the first things that will then happen when you start your crew is a line will be printed on your terminal with a URL. Click that.

AGENTOPS_API_KEY = "yourkey"
agentops.init()
Frog863 commented 1 month ago

Thank you,but what database is agentops in and how is it used

freddyvega commented 1 month ago

What do you mean which database? I don't understand. When you added the two lines to your python script and ran it, you didn't see in the terminal a line that looked like this: https://app.agentops.ai/drilldown?session_id=

Frog863 commented 1 month ago

Thank you bro,I succeeded through your guidance！