search

langchain-ai / langsmith-sdk

LangSmith Client SDK Implementations
https://smith.langchain.com/
MIT License
346 stars 59 forks source link

Issue: Data not showing up in UI #755

Open janitaportrait opened 1 month ago

janitaportrait commented 1 month ago

I created traces for a project, logging both the nested llm call and the inputs / outputs of the function. I saw the data appear in the dashboard, but when I checked the next day, all of the traces appeared empty and there was no longer any data. Here's an example run ID from the project in question: 8b45061a-1221-42d0-88a3-6ef170fd564b

This is pretty concerning as I'm not sure I can rely on my data being accessible / viewable. Please let me know how this can be addressed. Appreciate the help, thank you!

Suggestion:

using my run ID, please clarify if there is a rendering issue preventing the data from showing up, or if it is a data loss issue

hinthornw commented 1 month ago

Hi @janitaportrait could you confirm a couple things for us:

  1. So you logged a run on day 1 and then revisited it on day 2 (so 24 hours difference), and the run is no longer there. Are any other runs there that would have made it scroll out of view?
  2. Is the time filter set in this project? image
  3. Are you checking the same project as before (rather than a different one)?
  4. Did another member of your team delete the project?

Just checked and can confirm that a run with id 8b45061a-1221-42d0-88a3-6ef170fd564b exists in the DB. We haven't experienced a data loss event

janitaportrait commented 1 month ago

When I said "all of the traces appeared empty", I meant that I can still see the names of the traces, but there is no data attached to them. I am suspecting it is a UI issue because when I retrieved the same traces with the SDK, I could see their data. Please see attached screenshot. The input and output fields are empty, whereas on the previous day the input and output fields were displaying my logged data as well as the nested LLM calls. image

janitaportrait commented 1 month ago

This is from another run using the same tracing code, ie this is what I would expect the traces to look like: image

hinthornw commented 4 weeks ago

Thanks for clarifying - if you pick "Raw Input" by clicking the dropdown there, does it still show as empty? Or is there content present in the raw payload that is being mis-typed by our frontend?

image

janitaportrait commented 4 weeks ago

The raw input and raw output also appear empty

image
hinthornw commented 2 weeks ago

@janitaportrait was trying to debug this. I may have pushed a fix for it in the latest SDK release. LMK if you still run into issues