zhengqunkoo / taxibros

Instantly query taxi arrival times
0 stars 1 forks source link

Transition from SQLite to PostgreSQL #99

Open zhengqunkoo opened 6 years ago

zhengqunkoo commented 6 years ago
zhengqunkoo commented 6 years ago

SQLite does not allow concurrent reads while writing to database. Combined with slow disk I/O, this makes the now service almost impossible to fulfill. By the time the writing connection to SQLite drops, it will likely be more than 5 minutes (i.e. now service will not have real-time data). Raising priority.

zhengqunkoo commented 6 years ago

MVCC likely prevents reading latest real-time data. Could isolate latest timestamps for now service from other timestamps for later service so now timestamps can be written quickly (making read data as recent as possible).