Clarifications about RAM usages under different ordering options

libffcv / ffcv

FFCV: Fast Forward Computer Vision (and other ML workloads!)

https://ffcv.io

Apache License 2.0

2.83k stars 178 forks source link

Clarifications about RAM usages under different ordering options #79

Closed elicassion closed 2 years ago

elicassion commented 2 years ago

Added clarification note in the Dataset ordering section, explaining how each ordering option affects the amount of RAM needed. Added a sentence in Scenario: large scale dataset to clarify RANDOM option is not feasible even os_cache is set False.

GuillaumeLeclerc commented 2 years ago

It looks great thank you very much for the contribution!

elicassion commented 2 years ago

Thank you for this great project and your active communication with users!