Agenta-AI / agenta

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
http://www.agenta.ai
MIT License
1.21k stars 182 forks source link

Add Exception handling in Agenta Observability #1847

Open jp-agenta opened 3 months ago

jp-agenta commented 3 months ago

Is your feature request related to a problem? Please describe. Exceptions are currently not handled as per OpenTelemetry specifications.

Describe the solution you'd like This feature would require changes in the SDK (for instance self.tracing.add_event() and self.tracing.record_exception(), at least, if the solution uses Events as per OTel specs), as well as changes in the UI to handle events (again, if the solution uses Events). Also, Exceptions would not be part of the trace outputsanymore.

Describe alternatives you've considered

  1. Implementing Events (proper solution but with more moving parts)
  2. Adding exceptions as another span attribute (non-standard solution but with fewer moving parts)

Additional context https://github.com/open-telemetry/opentelemetry-specification/blob/v1.33.0/specification/trace/api.md https://github.com/open-telemetry/opentelemetry-specification/blob/v1.33.0/specification/trace/exceptions.md https://opentelemetry.io/docs/specs/semconv/exceptions/exceptions-spans/ https://opentelemetry.io/docs/concepts/signals/traces/

jp-agenta commented 3 months ago

Related to AGE-389