Performance benchmark

[sigmafelix]

Benchmark design: one case, two functions

Case: Crop type summary

• Hardware setting
  • HPC (core-per-task: 1 vs 50-150 [depending on memory footprint]) via SLURM
• Data
  • USDA Cropland data (spatial resolution: 30 meters, 2020)
• [x] Test 1: distribute across grids, crop type summary
  • [x] Generate -- Points: 8+ millions points in mainland US
  • Buffer: 10 kilometers
• [x] Test 2: distribute through hierarchy
  • Polygons: 238+K block groups in the US (2020)
  • Hierarchy: county
• [x] Test 3: nearest road join to point
  • 8+ millions points -> 1.7 millions
  • Level-2 road from the Census Bureau North American Roads from Department of Transportation

[sigmafelix]

Experiments were done while making the poster for Science Day. The materials will be used in the manuscript as well.