search

nlesc-dirac / sagecal

SAGECal is a fast, memory efficient and GPU accelerated radio interferometric calibration program. It supports all source models including points, Gaussians and Shapelets. Distributed calibration using MPI and consensus optimization is enabled. Both spectral and spatial priors can be used as constraints. Tools to build/restore sky models are included.
http://sagecal.sourceforge.net
GNU General Public License v2.0
12 stars 8 forks source link

Test directory is too big #78

Closed fdiblen closed 4 years ago

fdiblen commented 5 years ago

The code itself is ~3mb but the size of the files in test directory are about 55 mb. Maybe we can store test and example data in a separate repository.

HannoSpreeuw commented 5 years ago

We could make sm.ms.tar available through a Surfdrive link.

fdiblen commented 5 years ago

We should have a separate repo for data. Also need to refer to the repo in documentation, make changes in the code so that it can fetch the data from that repository.

fdiblen commented 5 years ago

As it is only a test data and it is not so big, that should be OK.

HannoSpreeuw commented 5 years ago

Do you mean a separate GH repo?

HannoSpreeuw commented 5 years ago

I added sm.ms.tar to the new repo https://github.com/nlesc-dirac/data So sm.ms.tar may be removed from all SAGECal branches.

However, GH recommends https://git-lfs.github.com/ for files larger than 50 MB.

fdiblen commented 5 years ago

I added sm.ms.tar to the new repo https://github.com/nlesc-dirac/data So sm.ms.tar may be removed from all SAGECal branches.

However, GH recommends https://git-lfs.github.com/ for files larger than 50 MB.

Can you remove the data file from the repo and modify the code/scripts which are using this data?

LFS is not needed. It will just make things more complicated.