Open shadeofblue opened 8 months ago
Let's talk @shadeofblue - with Kamil we didn't know about this VOLUMES enough
okay, so there are three facets to this issue:
so, it all boils down to the fact that we need to rework the images so that they use VOLUMES appropriately to alleviate the above issues...
steps to reproduce:
ray up golem-cluster.dev.yaml
ray attach golem-cluster.dev.yaml
pip install numba
suggested solution: we should change the VM image to use a VOLUME and ensure that pip is configured to keep at least the temporary files but preferably all the installed packages on an external volume