See your Location History in IITC

Script to convert Location History file from Google for IITC. The objective is to be able to optimize your Ingress Explorer statistics.

Example

Prerequisites

Android Phone with Google Maps History activated (https://support.google.com/accounts/answer/3118687?hl=en)
Export your Location History with Google Takeout in KML format (https://takeout.google.com/settings/takeout/custom/location_history?hl=en&gl=US&expflags)
Able to run PHP script to convert the file (HHVM highly recommended for performance)
PostGIS (http://postgis.net/), GDAL (http://www.gdal.org/) and GeoServer (http://geoserver.org/) for IITC vizualisation

Setup

Download all the files and put them in the same folder
Create the following folders
- finished (will keep the final result and the number of lines of the full conversion)
- process (original file to convert)
- templates (to store full conversion result for update mode)

Full Conversion

Run

php convertfull.php <XML LocationHistory file name>
cp -f "finished/<XML LocationHistory file name>" "templates/<XML LocationHistory file name>"

hhvm convertfull.php <XML LocationHistory file>
cp -f "finished/<XML LocationHistory file name>" "templates/<XML LocationHistory file name>"

For 700 000 points, it tooks 4 hours with HHVM. (Simple benchmarking with Paris for major zone of datas).

The full conversion use a mechanism to split into 2 zones the complete world for performance (typical zone where you have a lot of points and often the same, and the rest of the world).

Update Conversion

Run

php convertupdate.php <XML LocationHistory file>

hhvm convertupdate.php <XML LocationHistory file>

The update mode will take the information from the full conversion to know which datas are new and add to the template file (template is the full file after conversion). Update will fail if a full was not done before.

Import into PostGIS database

Run

ogr2ogr -f "PostgreSQL" PG:"dbname=<PostGIS Database> user=<PostGIS User> password=<PostGIS User password>" "finished/<XML LocationHistory file name>"

Publish PostGIS database into GeoServer

http://docs.geoserver.org/latest/en/user/gettingstarted/postgis-quickstart/index.html

IITC Plugin

Import the file iitc-plugin-overlay-mapshistory.js into IITC and change the 2 followings parameters:

You will find a new layer called "Maps History" into IITC layers

Limitations

Update mode will not compare points with the Full generated file to remove too close points.
The whole file is converted, not possible to filter by date
It takes into account you played Ingress in all places you visited

jonthekiller / LocationHistoryIngress

readme