Add scan job for streaming uploads

QutEcoacoustics / baw-server

The acoustic workbench server for storing and managing ecoacoustic data. Manages the structure and audio data. Provides an API for clients access.

Apache License 2.0

9 stars 4 forks source link

Closed atruskie closed 2 years ago

atruskie commented 2 years ago

Streaming uploads rely on webhooks to be notified of new files that were uploaded.

When the webhooks fail we have no idea of the state of new files.

[x] Run a scan job at the end up a streaming job (when we transition from uploading to complete to again check for any stragglers

atruskie commented 2 years ago

Related to #596