Setting data security on after turning it off doesn't actually set it on again

[anthony2261]

Picture below shows "Data secure" icon but the response actually contains info from the table

[anthony2261]

OK, false alarm, I checked the langsmith logs, it is actually secure. This is a question that people wrote about on the internet using this sample db, so the LLM probably memorized the result. We can also see that the LLM says 231.57 while the table says 231.73

[RamiAwar]

Yes I've seen similar results before, specially with other models like 4o