DOI-USGS / national-flow-observations

This repository pulls national flow data from NWIS
Other
4 stars 8 forks source link

May 2023 build + saml2aws #30

Closed lindsayplatt closed 1 year ago

lindsayplatt commented 1 year ago

There are three outcomes in this PR:

  1. The main part of this PR pertains to a rebuild based on May 2023 inventory/download.
  2. dssecrets is no longer in use, so this also includes the instructions for using saml2aws to authenticate to AWS S3 storage. Unfortunately, you will likely need to build, then authenticate, then build again since saml2aws times out after 8 hrs.
  3. The last part was a tiny fix for getting passed an empty table (as described in #29). Not sure if we should bring into the main repo or not, but I suppose I don't see a downside other than the error was an indication that something was funky.

@jesse-ross requesting your review for my saml2aws instructions in the README.md @limnoliver requesting your review on the build/*.yml and *.ind files. Please let me know if you want to identify someone else for these reviews, though, I hope that Jesse and I can get this running automatically soon and we won't need to do this same process.