wejick / gchain

Composable LLM Application framework inspired by langchain
Apache License 2.0
12 stars 2 forks source link

Debugger / tracer #3

Open wejick opened 1 year ago

wejick commented 1 year ago

In LangChain there's tracing functionality where we can see all the LLM invocation and use it to debug the implementation.

This functionality will be useful to have, however the API of langchain-server is opaque. I don't know where to get the source of it or any possibility to reuse it. I would love to reuse any available tracer and UI, one idea is probably to use OpenTelemetry. I don't think it has proper UI for development need.

For implementation detail, we can use callback.