Closed thekaveman closed 5 years ago
Whether or not ON CONFLICT UPDATE is doing anything, incoming duplicate records can cause problems.
ON CONFLICT UPDATE
This change adds an additional per-processing step to both load_status_changes and load_trips helpers in ProviderDataLoader.
load_status_changes
load_trips
ProviderDataLoader
Duplicate status_changes are identified using (provider_id, device_id, event_time).
status_changes
(provider_id, device_id, event_time)
Duplicate trips are identified using (provider_id, trip_id).
trips
(provider_id, trip_id)
Whether or not
ON CONFLICT UPDATEis doing anything, incoming duplicate records can cause problems.This change adds an additional per-processing step to both
load_status_changesandload_tripshelpers inProviderDataLoader.Duplicate
status_changesare identified using(provider_id, device_id, event_time).Duplicate
tripsare identified using(provider_id, trip_id).