search

timrobertson100 / map-spark-sql

Exploring a better map batch process for GBIF
0 stars 0 forks source link

Reuse the input across projections #4

Open timrobertson100 opened 11 months ago

timrobertson100 commented 11 months ago

The current tile pyramid recreates the input each time at a cost of 7mins or so. We should reuse this, and filter to hemisphere for the polar ones.