hasadna / open-bus

:bus: Analysing Israel's public transport data
93 stars 29 forks source link

Drop duplicates in create_siri_csv_splunk #302

Closed cjer closed 4 years ago

cjer commented 4 years ago

To save storage and increase efficiency - from now on duplicates are dropped from siri_logs when creating the csv for splunk. A field named num_duplicates is added instead which contains an int with the number of duplicates the record originally had.

codecov-io commented 4 years ago

Codecov Report

Merging #302 into master will not change coverage. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #302   +/-   ##
=======================================
  Coverage   93.96%   93.96%           
=======================================
  Files           3        3           
  Lines         116      116           
=======================================
  Hits          109      109           
  Misses          7        7

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 4001ca4...d1e1e54. Read the comment docs.