Closed prokopevaleksey closed 7 years ago
No, there is no easy way to do it.
On that note, is it possible to use memory-mapped file handling instead of loading into RAM at all (as an option)? Or does performance degrade so much that keeping everything in RAM is mandatory?
Thank you a lot for this awesome project!
However I have a minor concern about the efficiency of RAM usage for workers. As far as I understood each worker load the model into the memory for itself each time evoked.
I am just wondering is there an easy way to load the model into RAM once and make workers share it?
Thank you.