Open chhotii-alex opened 11 months ago
Also there is a supposed security vulnerability in ray older than version 2.8.1. The ray folks say that this is basically baloney; but, this is not a good look for us.
I think that this would force us to upgrade the minimum version of Python to 3.9. However, Python 3.8 is end-of-life this year, so, no loss.
Should update the test grid to include the newest versions of Python (now up to 3.13).
Current dependency is ray version 2.2.0. Ray version 2.3.0 is supposed to have fixed a memory leak bug: see https://discuss.ray.io/t/object-store-spilling-terabytes-of-data/8699/5
I don't know if that particular bug has the potential to impact similarity calculations, but it seems important.
I am using ray version 2.6.3 and working to avoid object spillage. Current version of ray is 2.8.1.