Open karthikprasad opened 1 year ago
Poisson sampling in DP DataLoader results variable batch sizes. This has been a source of confusion for many and has resulted in at least two questions on the forum (https://discuss.pytorch.org/t/arbitrary-batch-sizes-after-passing-dataloader-through-privacy-engine/161632 and https://discuss.pytorch.org/t/the-samping-of-rdp/158322)
While this has been documented in the docstrings of DPDataLoader (at https://opacus.ai/api/data_loader.html), this is not easily accessible. It might be worth adding this into Opacus FAQ (at https://opacus.ai/docs/faq)
📚 Documentation
Poisson sampling in DP DataLoader results variable batch sizes. This has been a source of confusion for many and has resulted in at least two questions on the forum (https://discuss.pytorch.org/t/arbitrary-batch-sizes-after-passing-dataloader-through-privacy-engine/161632 and https://discuss.pytorch.org/t/the-samping-of-rdp/158322)
While this has been documented in the docstrings of DPDataLoader (at https://opacus.ai/api/data_loader.html), this is not easily accessible. It might be worth adding this into Opacus FAQ (at https://opacus.ai/docs/faq)