Implement reducer loop on files in parallel

elkir / iccs23-hacakthon-delorean-datasets

MIT License

2 stars 1 forks source link

Implement reducer loop on files in parallel #5

Open ElliottKasoar opened 1 year ago

ElliottKasoar commented 1 year ago

Distributed Processing: Implement a loop similar to #3 that processes files in parallel on up to 76 cores and combines them into a final dataset. [Medium]