search

Arize-ai / phoenix

AI Observability & Evaluation
https://docs.arize.com/phoenix
Other
3.12k stars 233 forks source link

[ENHANCEMENT] Add visibility into tool output #2031

Open mikeldking opened 6 months ago

mikeldking commented 6 months ago

see issue here: https://github.com/Arize-ai/open-inference-spec/issues/37#issue-2061156395

mikeldking commented 6 months ago

@axiomofjoy look into what's available in the callbacks. If it doesn't exist, we will have to rely on opentelemetry manual span creation

tslmy commented 5 months ago

Just FYI, Llama Index uses function_call_response for this matter:

https://github.com/run-llama/llama_index/blob/e3a169b93b9e6014cb2c5bd731fc1f7467e3312e/llama_index/callbacks/schema.py#L61