Open franTarkenton opened 1 year ago
working on this however is time consuming and difficult to debug due to infrequency that events are emitted for the data we are monitoring for.
Have resolves some timeout issues, but still haven't managed to observe an event from the stream we are attempting to monitor.
Branch with the work for this ticket: feat/event_listener
link to doc on how to setup the other side (github action) for remote trigger: https://dev.to/rikurouvila/how-to-trigger-a-github-action-with-an-htt-request-545
Created the PR: https://github.com/bcgov/nr-rfc-grib-copy/pull/14 which contains code showing how to setup an event listener process.
Currently all the script does is listen for events and log them to the log that is emitted to STDOUT. Breaking this task up into smaller pieces described below
Next steps is to create tickets for the following tasks.
In order to speed up the processing of the cmc grib data, this task will do the following:
Focus of this work is to speed up the downloading / processing of the cmc grib data to enable hourly processing.
Task relates to: https://github.com/bcgov/nr-rfc-admin/issues/21 and https://github.com/bcgov/nr-rfc-grib-copy/issues/7