OSOceanAcoustics / echopype

Enabling interoperability and scalability in ocean sonar data analysis
https://echopype.readthedocs.io/
Apache License 2.0
89 stars 70 forks source link

Upgrade handling of test data files to use GitHub Release Assets #1263

Open leewujung opened 4 months ago

leewujung commented 4 months ago

Right now test data files are stored in a private google drive folder and copied to the virtual machine when running tests. This is somewhat brittle and makes this project less open to contributions.

@ocefpaf suggested the option to use GitHub Release Assets to store test data files, which keeps the data in the same repo but does not contaminate the code, with the additional advantage that the test data can then be versioned. Since none of our test data files >2G so will not cause problem with the assets, this should work pretty well. We can use pooch to fetch these files, as suggested in https://github.com/OSOceanAcoustics/echopype/pull/1111#issuecomment-1662722878.

@lsetiawan has given this a try here here, so seems indeed we can go this route to handle our test data files.

dextrot commented 4 months ago

Hi @leewujung I want to work on this issue, can you please assign it to me?

HQ786 commented 3 months ago

Hi @leewujung I am interested to work on this issue, can you please assign this to me?