search

jxnl / instructor

structured outputs for llms
https://python.useinstructor.com/
MIT License
6.52k stars 514 forks source link

Would be great if logging.INFO should show all LLM api calls, including ones made for validation #767

Open ShravanSunder opened 2 weeks ago

ShravanSunder commented 2 weeks ago

Is your feature request related to a problem? Please describe. Would be great if logging.INFO should show all LLM api calls, including ones made for validation. There is too much info in debug mode (like tcp calls), and info does not show llm_validator calls

Describe the solution you'd like llm_validator calls show in logging = INFO

Describe alternatives you've considered using debug logging (but its hard with too much info

I think INFO can have more information about request/response. DEBUG is a bit too low level and hard to process due to tcp call details.

rdvelazquez commented 8 hours ago

I second this. Visibility into the function/tool message (you normally already have access to the system and user messages) , without the noise of debug level logging, would be very helpful.