Arize-ai / openinference

OpenTelemetry Instrumentation for AI Observability
https://arize-ai.github.io/openinference/
Apache License 2.0
210 stars 32 forks source link

[bug] python CI failing on async langchain-latest #184

Closed RogerHYang closed 8 months ago

RogerHYang commented 8 months ago

failing on stuff document chain parent id

assert (sd_span := spans_by_name.pop("StuffDocumentsChain")) is not None
        assert sd_span.parent is not None
>       assert sd_span.parent.span_id == rqa_span.context.span_id
E       assert 1585446675937841368 == 3960482443532127989
dosubot[bot] commented 8 months ago

🤖

Hey there, @RogerHYang! Long time no see in the digital realm of issues and bugs. What's cooking in the Python CI world today? 🐍🔍

The Python CI is failing on langchain-latest due to an assertion error in the StuffDocumentsChain parent id because the parent id of the StuffDocumentsChain span is not matching the expected parent id.

In the test code, the parent id of the StuffDocumentsChain span is asserted to be equal to the span id of the RetrievalQA span:

assert sd_span.parent.span_id == rqa_span.context.span_id

If this assertion is failing, it means that the parent id of the StuffDocumentsChain span is not equal to the span id of the RetrievalQA span. This could be due to a bug in the code that sets the parent id of the StuffDocumentsChain span, or it could be due to an issue with the test setup.

Without more information about the specific error message and the state of the system when the error occurs, it's hard to say exactly why this is happening. However, this is the line of code that is causing the CI to fail.

As for the purpose of the StuffDocumentsChain span and how its parent id is typically set in the OpenInference codebase, I wasn't able to find specific information within the repository. It would be helpful if you could provide more details about the error message and the state of the system when the error occurs. This would help in identifying the root cause of the issue.

For more information, you can refer to the test code in the openinference-instrumentation-langchain directory.

Sources


This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.