search

tunib-ai / parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
https://tunib-ai.github.io/parallelformers
Apache License 2.0
776 stars 61 forks source link

torch no_grad #40

Open zelcookie opened 1 year ago

zelcookie commented 1 year ago

Hello Do I need to use the no_grad context manager or is it already inside?

hyunwoongko commented 1 year ago

you don't need to do it.