search

usgs / groundmotion-processing

Parsing and processing ground motion data
Other
54 stars 42 forks source link

Clean up tests/data directory to reduce size #1005

Closed baagaard-usgs closed 1 year ago

baagaard-usgs commented 1 year ago

The tests/data directory could be significantly smaller in size with a little housekeeping. For example, the tests/data/import directory is 94 MB and includes an uncompressed tar file and the contents of the tar file.

emthompson-usgs commented 1 year ago

Good point. It is a mess, and I think there is event some data in there that we don't use anymore as we've updated unit tests.

emthompson-usgs commented 1 year ago

Note: we have never tracked the mapping between specific unit tests and the data that they use. We should add a README in tests/data to track this mapping so that when a unit test is removed we can easily tell if we should remove the data it is using. Similarly, we can modify unit tests to reuse more of the data in many cases.