NVIDIA / NeMo-Aligner

Scalable toolkit for efficient model alignment
Apache License 2.0
419 stars 45 forks source link

make num workers all 0 by default #213

Closed gshennvm closed 2 weeks ago

gshennvm commented 2 weeks ago

make num workers all 0 by default. Num workers > 0 calls a process fork/spawn underneath the hood, which causes many surprising problems for users that are trying to do things like quantization. The error is also insanely hard to debug, so I think it's better to set the default to 0.