This particular commit handles fetching and uploading of mseed data in .wav format (for now) to "dev-streaming-orcasound-net" bucket which can be checked out here in the karan_test node
Upload handled using the same upload_s3.py script
How the gaps will be handled?
In the ooipy_pull.py I have used dates 27 Apr 2021 - 30 Apr 2021 (these are randomly chosen dates where data seems to be consistent i.e. without gaps). These highlighted texts should explain how the gaps will be handled.
For large gaps, the download will be skipped and latest.txt will be made to point to the most recently downloaded audio segment. Possibly, we can work on improving ooipy library to handle gaps more efficiently.
What's left to do?
Convert .wav to .ts before uploading. I will use pydub for the same.
Add logic for writing and updating latest.txt currently it just uploads an empty txt file.
This pull request is intended to close #30
What this PR will achieve?
This particular commit handles fetching and uploading of mseed data in .wav format (for now) to "dev-streaming-orcasound-net" bucket which can be checked out here in the karan_test node Upload handled using the same upload_s3.py script
How the gaps will be handled?
In the ooipy_pull.py I have used dates 27 Apr 2021 - 30 Apr 2021 (these are randomly chosen dates where data seems to be consistent i.e. without gaps). These highlighted texts should explain how the gaps will be handled.
For large gaps, the download will be skipped and latest.txt will be made to point to the most recently downloaded audio segment. Possibly, we can work on improving ooipy library to handle gaps more efficiently.
What's left to do?
Convert .wav to .ts before uploading. I will use pydub for the same.
Add logic for writing and updating latest.txt currently it just uploads an empty txt file.