Is your feature request related to a problem? Please describe.
Currently, ShardDataset loads a chunk and only after it exhausts it, it loads the next one. It would be great to hide the latency by implementing some sort of prefetching.
Describe the solution you'd like
I have no clue on how to attain it but would love to hear other's thoughts.
Is your feature request related to a problem? Please describe. Currently, ShardDataset loads a chunk and only after it exhausts it, it loads the next one. It would be great to hide the latency by implementing some sort of prefetching.
Describe the solution you'd like I have no clue on how to attain it but would love to hear other's thoughts.