Enable mmap during multiprocessing model transfers

aphp / edsnlp

Modular, fast NLP framework, compatible with Pytorch and spaCy, offering tailored support for French clinical notes.

https://aphp.github.io/edsnlp/

BSD 3-Clause "New" or "Revised" License

112 stars 29 forks source link

Closed percevalw closed 9 months ago

percevalw commented 9 months ago

Torch 2.1.2 allowed us to detect that we didn't use mmap when loading the model to run in multiprocessing. This PR fixes this.