JIT compilation on serverless (i.e. Modal Labs)

AmenRa / ranx

⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍

https://amenra.github.io/ranx

MIT License

427 stars 23 forks source link

JIT compilation on serverless (i.e. Modal Labs) #64

Open andersonbcdefg opened 5 months ago

andersonbcdefg commented 5 months ago

I'm noticing that it takes a really long time to start up anything with ranx in a serverless setting, e.g. Modal Labs. I tried adding a step during the build process where I call the functions that need to be cached, but it doesn't seem to help. This is true even if I explicitly set the NUMBA_CACHE_DIR to a directory that will persist from build -> deployment. Do you have advice on how to avoid the JIT slow start in this setting?

AmenRa commented 1 month ago

Hi and sorry for the delay. Unfortunately, I cannot help with this. If you find a solution, please post it here for others. Thanks.