search

WikiWatershed / mmw-geoprocessing

A Spark Job Server job for Model My Watershed geoprocessing.
Apache License 2.0
6 stars 6 forks source link

WIP: Raster Vector Join #29

Closed rajadain closed 8 years ago

rajadain commented 8 years ago

Space to work out a solution for raster vector joining. Currently with a decently sized Area of Interest (1,115 km2), with about 25,000 streams in the DRB dataset, the most recent implementation just barely scrapes through the 10s timeout when run inside the worker VM:

vagrant@worker:~$ time curl --silent --data-binary @DRB_Large_MapshedJob.json 'http://localhost:8090/jobs?sync=true&context=geoprocessing-context&appName=geoprocessing-0.4.0&classPath=org.wikiwatershed.mmw.geoprocessing.MapshedJob'
{
  "result": {
    "23": 39960,
    "11": 2282,
    "90": 24158,
    "22": 45118,
    "24": 25494,
    "21": 34415,
    "43": 841,
    "71": 597,
    "82": 2708,
    "31": 101,
    "95": 3332,
    "42": 58,
    "81": 1282,
    "41": 13336,
    "52": 1562
  }
}
real    0m10.650s
user    0m0.008s
sys    0m0.042s

Connects #28

rajadain commented 8 years ago

Closing in favor of the cleaned up #31.