visual-layer / fastdup

fastdup is a powerful free tool designed to rapidly extract valuable insights from your image & video datasets. Assisting you to increase your dataset images & labels quality and reduce your data operations costs at an unparalleled scale.
Other
1.57k stars 76 forks source link

support for list of s3 tar files #119

Closed Tompil3r closed 1 year ago

Tompil3r commented 1 year ago

example: input_dir = ['s3://.../tar1.tar', 's3://.../tar2.tar', ...]