Initial run: all processes download datasets

aidecentralized / sonar

SONAR - Self-Organizing Network of Aggregated Representations

MIT License

13 stars 34 forks source link

Initial run: all processes download datasets #101

Open rishi-s8 opened 1 month ago

rishi-s8 commented 1 month ago

For the first run, each user (process) on each machine tries to download the dataset. This can cause corruption issues for dataset. Enforce that only one process on each machine downloads the dataset.