polimi-ispl / deep_prior_interpolation

Interpolation of seismic data through Deep Priors
http://ispl.deib.polimi.it/research/geophysics/
33 stars 13 forks source link

Add Parallelism #1

Open fpicetti opened 3 years ago

fpicetti commented 3 years ago

As the network size is proportional to the dataset size, and the GPU memory is limited, some parallelism has to be implemented.

A naive approach is to split the dataset into possibly-overlapped windows to be processed separately and then the results are merged. This can be done sequentially (as in this repo) or with a DataParallel strategy.

On the other hand, in order to process all the data at once, one might want to adopt a ModelParallel strategy.

frailty-cyber commented 3 years ago

data里面为什么没有hyperbolic3d_irregular_066.npy?

fpicetti commented 3 years ago

Hi @frailty-cyber,

Thanks for your comment! Indeed, the README needs to be updated, sorry for the delay. You can find that file in datasets/hyperbolic3d/. We provide you with the original data volume, and two different decimations.

Let me know if you need any help. I would ask you to open a new issue, as this thread is dedicated to the parallelism.