Add iterative runner - Githubissues

catalystneuro / dandi_s3_log_parser

S3 log parsing for the DANDI Archive.

BSD 3-Clause "New" or "Revised" License

1 stars 2 forks source link

Closed CodyCBakerPhD closed 4 months ago

CodyCBakerPhD commented 4 months ago

Adding an iterative runner that would act on the top-level folder and parse all historical logs (not the current day as a CRON)

CodyCBakerPhD commented 4 months ago

Working well except for some of the largest log files it seems I will have to implement file buffering after all