search

BayAreaMetro / clpr

R package with analysis utilities and approaches for a data set of obscured and anonymized Clipper smart card transactions.
https://bayareametro.github.io/clpr/
2 stars 1 forks source link

move drop_tagons work to database #9

Open tbdv opened 6 years ago

tbdv commented 6 years ago

in theory we can probably move this processing to the database side.

currently it happens on the client side and takes a long time.

https://github.com/BayAreaMetro/clpr/blob/master/R/complete_trip.R#L30-L36

tbdv commented 6 years ago

attempt at this on the branch above.

dplyr to sql translation gets stuck at the lag:

https://github.com/BayAreaMetro/clpr/blob/5757b9f955f858a6842901c109708f037f340b3b/R/complete_trip.R#L34

tbdv commented 6 years ago

right now this takes about 7 mins