replace `torch.multiprocessing` with `multiprocess` - Githubissues

tunib-ai / parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment

https://tunib-ai.github.io/parallelformers

Apache License 2.0

776 stars 61 forks source link

replace `torch.multiprocessing` with `multiprocess` #21

Closed Oaklight closed 2 years ago

Oaklight commented 2 years ago

Title

replace torch.multiprocessing with multiprocess

Description

spawn in multiprocessing and torch,multiprocessing is not properly handled by IPython, which is the backend for popular Jupyter. Fixed by replacing torch.multiprocessing with multiprocess in parallelformers/parallelize.py

Linked Issues

resolved #20