search

Imageomics / cautious-robot

Simple images from CSV downloader that runs and records checksums on downloaded image folder.
MIT License
2 stars 0 forks source link

Add an option for ending index or number of items #4

Open egrace479 opened 3 months ago

egrace479 commented 3 months ago

This [starting_index option] seems helpful for resuming a download given the last successful index. Perhaps in the future you could add an option for ending index or number of items. That way a user could download chunks of a CSV in multiple processes.

_Originally posted by @johnbradley in https://github.com/Imageomics/cautious-robot/pull/1#discussion_r1627695112_

egrace479 commented 3 months ago

This would go nicely with a default that checks the provided image folder (if it exists) to see the contents and automatically determine starting index (or just filenames to remove since we force it to be unique).