Closed smpiano closed 2 years ago
After applying @andres-arana's changes: Create Port Visits: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-16_08_24_22-993121888725945578?project=world-fishing-827 Output:
scratch_matias_ttl_60_days.port_visits_*
from 2012
- now
scratch_matias_ttl_60_days.proto_port_visits
Create Port Events: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-16_08_39_52-15649841229488053454?project=world-fishing-827 Output:
scratch_matias_ttl_60_days.proto_raw_port_events_20120101
scratch_matias_ttl_60_days.proto_port_state_20120101
Comparison same as original.
pipe-tools
tov4.0.0
, so fixes name classes.2.35
usespyyaml==6
requires Loader parameter when makes yaml.load() deprecation link. Scheduler also need this, +requirements-scheduler.txt
, used in tests.DRAFT:
job: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-10_19_39_26-5403262428179266717?project=world-fishing-827
Related with> https://globalfishingwatch.atlassian.net/browse/PIPELINE-809