pysat / pysatCDAAC

pysat support for CDAAC instruments
BSD 3-Clause "New" or "Revised" License
2 stars 2 forks source link

BUG: non-unique cosmic files #9

Closed jklenzing closed 4 years ago

jklenzing commented 4 years ago

Addresses #2.

The scnlv1 files were generating a "non-unique" file error when attempting to load the object. This was only occurring locally on one system where I've downloaded ~2 years of scintillation data, which translates to ~2e5 files. The code previously added a fudge factor of up to 0.01 s to the index datetime stamps to keep times unique. Presumably this becomes an issue again once the volume of files hits a critical mass. This reduces the fudge factor to less than 0.0001 s to stave off this problem. There's probably a more robust way of dealing with this.