This adds a scripts directory to treniformis. All the filter lists can now be updated from BQ by running.
scripts/update_filter_lists.py
bqtools is used to perform all of the queries in parallel, so that it typically runs in about 3 minutes.
bqtools must therefore be installed for this to work!
This adds a new list GFW\FISHING_MMSI/KNOWN_AND_LIKELY as well.
scripts\test_versus_vessel_lists.py tests against the contents of the vessel list repo. That repo
must be installed alongside and the various bash scripts run for this to work correctly. This file
is only around for the transition to make sure I don't mess up running the queries.
This adds a scripts directory to treniformis. All the filter lists can now be updated from BQ by running.
bqtoolsis used to perform all of the queries in parallel, so that it typically runs in about 3 minutes.bqtoolsmust therefore be installed for this to work!GFW\FISHING_MMSI/KNOWN_AND_LIKELYas well.scripts\test_versus_vessel_lists.pytests against the contents of the vessel list repo. That repo must be installed alongside and the various bash scripts run for this to work correctly. This file is only around for the transition to make sure I don't mess up running the queries.