ArnaoutLab / diversity

Partitioned frequency- and similarity-sensitive diversity in Python
MIT License
6 stars 1 forks source link

update ray version in dependency? #60

Open chhotii-alex opened 11 months ago

chhotii-alex commented 11 months ago

Current dependency is ray version 2.2.0. Ray version 2.3.0 is supposed to have fixed a memory leak bug: see https://discuss.ray.io/t/object-store-spilling-terabytes-of-data/8699/5

I don't know if that particular bug has the potential to impact similarity calculations, but it seems important.

I am using ray version 2.6.3 and working to avoid object spillage. Current version of ray is 2.8.1.

chhotii-alex commented 10 months ago

Also there is a supposed security vulnerability in ray older than version 2.8.1. The ray folks say that this is basically baloney; but, this is not a good look for us.

I think that this would force us to upgrade the minimum version of Python to 3.9. However, Python 3.8 is end-of-life this year, so, no loss.

Should update the test grid to include the newest versions of Python (now up to 3.13).