NVIDIA / DALI

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
https://docs.nvidia.com/deeplearning/dali/user-guide/docs/index.html
Apache License 2.0
5.15k stars 621 forks source link

Multiple image simultaneously #5639

Open rachelglenn opened 1 month ago

rachelglenn commented 1 month ago

Describe the question.

Hi. I am using the Dali loader pipeline. How do I pull two different samples from the same ops.readers.Numpy reader? I have tried pulling two images for each step in the epoch and I get an error with the reader. I have tried creating two ops.readers.Numpy instances and I get the same images.

Thanks,

Rachel

Check for duplicates

JanuszL commented 1 month ago

Hi @rachelglenn,

Thank you for reaching out. It depends on what exactly you want to achieve. You can pass a different seed to each reader, but they are still sampling from the same data set. You can use files to provide a different list of files to each reader, so there will be samples that won't repeat. Is that something you are looking for?