e-mission / e-mission-docs

Repository for docs and issues. If you need help, please file an issue here. Public conversations are better for open source projects than private email.
https://e-mission.readthedocs.io/en/latest
BSD 3-Clause "New" or "Revised" License
15 stars 34 forks source link

Walk trip is sometimes incorrectly classified as "untracked" #622

Open shankari opened 3 years ago

shankari commented 3 years ago

Reported by a user

...to Colorado Blvd first. Then I waited for a bus. When that bus passed by me because it was full, I walked too the intersection of Colfax and colorado. From there I caught a bus to Colorado and 40th Ave.

The resulting points are shown below. There is a big gap between Colorado and 8th and Colorado and Colfax. The geofence exit is supposed to happen ~100m after stopping, but in this case, it didn’t happen until 1.2 km.

So one trip ended at 13:41 and the other started at 14:29

2021-02-23 21:06:40,105:INFO:4526927296:Found trip end at 2021-02-21T13:41:47-07:00
2021-02-23 21:06:40,106:DEBUG:4526927296:---------------------------2021-02-21T14:29:32.164000-07:00------------------------------
2021-02-23 21:06:40,106:DEBUG:4526927296:Setting new trip start point

Normally, we would have extended the trip starting at 14:29 backwards to Colorado and 8th. But because the distance traveled was large we checked for untracked time. And because of the waits on both ends, the speed was too slow, so we detected it as "stopped" and marked it as untracked time?

2021-02-23 20:35:08,979:DEBUG:4631424448:while determining new_start_place, transition_distance = 1277.9346259126346
2021-02-23 20:35:08,979:DEBUG:4631424448:while determining new_start_place, time_delta = 2865.1640000343323, transition_speed = 0.4460249486232975
2021-02-23 20:35:08,979:DEBUG:4631424448:transition_speed 0.4460249486232975 <= 0.8333333333333334, 'stopped', returning True

Inserting entry Entry({'metadata': {'key': 'segmentation/raw_untracked'}, 'data': {'start_fmt_time': '2021-02-21T13:41:47-07:00', 'end_fmt_time': '2021-02-21T14:29:32.164000-07:00', 'duration': 2860.1640000343323, 'distance': 1277.9346259126346})}) into timeseries

And we don’t show untracked time in the rest of the analyses.

Overall 13:41 end 14:29 start
Screen Shot 2021-02-24 at 7 34 04 AM Screen Shot 2021-02-24 at 7 37 59 AM Screen Shot 2021-02-24 at 9 38 47 AM

We need to think about the best way to solve this without breaking the main reason why we needed untracked time (https://github.com/e-mission/e-mission-docs/issues/205)

shankari commented 3 years ago

Another report from the same user:

I am missing a few trips on 03/12/2021 starting at 2:15 and ending before 3pm. 1 starting from 40th and Colorado Blvd going to 29th and Columbine. Then from there to 29th and Colorado and back to 29th and Columbine.

On checking the server details, the entire time from 12:35 to 3:30 was detected as untracked time. 2021-03-12T12:35:44.160000-07:00 -> 2021-03-12T15:26:18.127000-07:00

Need to investigate further and fix.