Open ffund opened 6 months ago
The DeepSpeech experiment became too complicated. The librispeech data needs to be preprocessed from .flac file to .csv, which in itself becomes a very complicated task.
Switched to Imagenet experiment using Resnet-50. The notebook uploaded currently has not been run in its entirety. Also, missing an explanation of steps
Comments -
normalize = transforms.Normalize(mean=[0.485, 0.456, 0.406], std=[0.229, 0.224, 0.225])
pynvml
to set power limitsn_max_iter
(clarify how long it will take to generate each point)The imagenet data is too huge for the node. When extracting the downloaded .tar files, the system gives a "Disk Full Error"
Compresses .tar files have the size: 137GB (Train) and 7GB (Test). These when uncompressed give error.
Continuing the experiment with a subset of data present here
The imagenet data is too huge for the node. When extracting the downloaded .tar files, the system gives a "Disk Full Error"
Compresses .tar files have the size: 137GB (Train) and 7GB (Test). These when uncompressed give error.
Continuing the experiment with a subset of data present here
Refer to #6
As a starting point for #4 let's write a notebook that reproduces one point in that figure.