stanford-futuredata / gavel

Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020
MIT License
124 stars 31 forks source link

Question about the datasets #245

Open Abida16 opened 1 year ago

Abida16 commented 1 year ago

Hi,

Can I know from where the listed datasets of artifact_evaluation.trace are downloaded? It would save me the effort of debugging the data-processing part. For example, I downloaded Monet2Photo from Kaggle datasets. I am getting the following issue while running Gavel in a physical cluster: Traceback (most recent call last): File "cyclegan.py", line 111, in dataloader = DataLoader( File "/home/ubuntu/.local/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 213, in init sampler = RandomSampler(dataset) File "/home/ubuntu/.local/lib/python3.8/site-packages/torch/utils/data/sampler.py", line 93, in init raise ValueError("num_samples should be a positive integer " ValueError: num_samples should be a positive integer value, but got num_samples=0