Pinecone tests failing in nightly builds

[geoand]

See https://github.com/quarkiverse/quarkus-langchain4j/actions/runs/8531342671

[jmartisk]

Oh man not again... I'll look into it soon, hopefully, but I am starting to hate Pinecone. From the logs, it seems that our hacky way for deleting embeddings has stopped working.

[geoand]

😢

[geoand]

@jmartisk have you find anything related to this?

If not, I am probably going to disable these tests completely as they are making the nightly builds useless

[jmartisk]

I have been too busy, but I promise I'm going to look into it soon™ But yeah if you want just disable them and I'll re-enable it if I figure it out.

[geoand]

👍🏼

[jmartisk]

It seems they have various kinds of intermittent instabilities - the nightly tests sometimes fail because from time to time, the 20-second delay for deleting embeddings isn't enough, because subsequent queries still return some embeddings (or maybe the problem is something else, but the response for the delete operation always shows success).

I tried reproducing it locally, but instead of hitting that problem, I am hitting intermittent 401 Unauthorized in the middle of a test, the first half passes, the second half doesn't. This seems to be a current problem on their side per https://status.pinecone.io

I am starting to think that without a paid account (if it's any better at all) it makes no sense to have regularly executed tests.

[jmartisk]

We should later investigate their new offering based on serverless deployments, but that is in preview and isn't possible without adding a credit card, which I'm quite reluctant to do just to get nightly tests running..

[geoand]

Agreed