Closed jmoldon closed 7 years ago
Short version: don't use setToCasaOrder, it makes things even slower!
We discussed some time ago if we should apply setToCasaOrder just after importfitsidi in order to make the rest of the steps faster.
I have conducted some calibration starting from fits files and running
importfitsidi setToCasaOrder fixvis flag autocorrelations Hanning smoothing aoflagger + a-priori flags split etc...
The test was conducted on richards (12 CPU @ 3.50GHz, 64 GB of RAM). The data set if 184 GB in the original fits format.
Times to run different steps with setToCasaOrder:
Times to run different steps with NO setToCasaOrder:
Conclusions:
I will update the code to take out that option. Maybe leave if it there as an option.
Solved in e95e32fbd64b02431e6a4e08ab401e3dcbd09eb2
Now the default behaviour is not to apply setToCasaOrder in importfitsidi.
setToCasaOrder
importfitsidi
Short version: don't use setToCasaOrder, it makes things even slower!
We discussed some time ago if we should apply setToCasaOrder just after importfitsidi in order to make the rest of the steps faster.
I have conducted some calibration starting from fits files and running
The test was conducted on richards (12 CPU @ 3.50GHz, 64 GB of RAM). The data set if 184 GB in the original fits format.
Times to run different steps with setToCasaOrder:
Times to run different steps with NO setToCasaOrder:
Conclusions:
I will update the code to take out that option. Maybe leave if it there as an option.