Tracking next actions

[arunasank]

Script checklist

• [x] Set up a stack that triggers the mbtiles-update script at a certain time everyday - @arunasank
  • [x] Stack will scale up at a certain time everyday.
  • [x] Stack will scale back down after the script has finished running.
• Country extracts - @ramyaragupathy
  • [x] Check to see if the country extracts are getting generated
  • [x] Integrate this with the rest of the script.

Unresolved items

• Daily updated planet.osm.pbf: The input to the mbtiles-update.sh is a planet.osm.pbf that's generated daily. We should either use Mapbox's infrastructure that already generates this daily, or build our own. Let's get this checked with Mikel on Friday.
• Cycling and maintaining latest tilesets: Once we have the daily PBF issue sorted, we need to figure out maintaining the LATEST tilesets. Currently, the code for this commented out in the mbtiles-update.sh script, and we can take a call after our conversation with Mikel.

TODO

• [ ] Write a devlog about this - @ramyaragupathy @arunasank

cc/ @hotosm/tech-staff

[ramyaragupathy]

• Daily planet pbf generation
• Old files maintenance

Other than the items outlined above, we should also check if there are other supporting scripts - like there is a line to generate individual country geojsons out of the main json file. Our script has this part commented and we use a single json file with feature collection for all countries.

[ramyaragupathy]

Dropping notes from our call w/ Mikel last week: https://docs.google.com/document/d/1kqrEgwHXyCRLMMaInafOkKFWvHi6SGFskGJui7IK6Gc/edit.

Key Takeaways

• Mapbox needs time to stabilise their pipeline before open sourcing the code.
• Minjur will be deprecated soon, so the team is replacing Minjur with osmium-export. osmium-export offers multipolygon support, but unsure of support for other relation types like TRs, bus routes.
• For now, we will support the maintenance and keep the process running on Mapbox infrastructure. Our long term goal is to set up an independent stack, but that will be more like a backup option that gets triggered whenever the tiles are not up to date in Mapbox's set up. Aruna suggests setting up a monitoring bot that sends slack notifications & triggers our Auto Scaling Group for QA Tiles generation. More coming up in a ticket.
• Further updates will be from Mapbox's end. No follow ups required from HOT

[arunasank]

Another next action:

• Create a README around creating, updating, deleting a new QA tiles stack.