Gather Winston data in chunks rather than all at once

uafgeotools / waveform_collection

Collect seismic/infrasound waveforms and metadata from IRIS/WATC/AVO servers, local miniSEED files, etc.

https://uaf-waveform-collection.readthedocs.io/

MIT License

11 stars 6 forks source link

Gather Winston data in chunks rather than all at once #18

Open liamtoney opened 4 years ago

liamtoney commented 4 years ago

Anecdotally, Winston (source='AVO') takes forever to grab chunks of data longer than ~1 hour in duration. For example, the data collection command in example_regional.py in the RTM repo, which requests 220 minutes of data, is really slow.

We might be able to alleviate this by quietly breaking the data request into smaller chunks that Winston can more easily handle, and then merging those chunks to create the final returned Stream.

liamtoney commented 2 years ago

AVO Winston has super annoying timeout issues on slower connections.

We should make Winston optional for gather_waveforms_bulk()