krisrs1128 / clouds_dist

Simulation of low-clouds, from weather measures.
4 stars 1 forks source link

getstats is slow #40

Closed vict0rsch closed 5 years ago

vict0rsch commented 5 years ago

can we do something about this? I've only got 500 images and it's taking minutes...

mustafaghali commented 5 years ago

I have added two extra config params "get_stats_n_in_mem": 20, "get_stats_num_workers": 12 for the get_stats dataloader and switch the computation to the gpu it has slightly improved to less than 2 mins