libffcv / ffcv

FFCV: Fast Forward Computer Vision (and other ML workloads!)
https://ffcv.io
Apache License 2.0
2.79k stars 180 forks source link

Loader pause at the begining after increasing page_size in the dataset writer #286

Open realliyifei opened 1 year ago

realliyifei commented 1 year ago

After I define the page_size in the dataest writer (by #135) and generate the beton data, the loader will stop in the middle. 

Is there any corresponding stuff to add in the pipeline after I changed the page_size of the dataset writer?