OneBusAway / onebusaway-gtfs-modules

A Java-based library for reading, writing, and transforming public transit data in the GTFS format, including database support.
Other
129 stars 106 forks source link

MOTP-1432 -- Transformation to recognize unusual numbers of trips #133

Closed CaylaSavitzky closed 4 years ago

CaylaSavitzky commented 5 years ago

Problem: We currently have no way to systematically recognize when an agency's number of trips is varying wildly (which normally suggests faulty-data)

Solution: This method recognizes when an agency's number of trips on a given day has changed significantly from expected values for that day of the week (or for a holiday). If the new value is not within 10% of the normal value for that day, and is not on an exempt list, a message is sent. In addition: Each day has the number of trips taken logged There is a suggested update to the current expected values for each day (that is set to approach the average number of trips on a given day when run each hour over the course of 3-5 months). In future iterations, the plan is to have this suggested update be written to the file from which it is read as part of this transformation.

CaylaSavitzky commented 4 years ago

This request now also contains changes made for replacing email alerts with cloudwatch metrics-- MOTP-1481.