azavea / osmesa

OSMesa is an OpenStreetMap processing stack based on GeoTrellis and Apache Spark
Apache License 2.0
79 stars 26 forks source link

Large augmented diff causes infinite loop #217

Open jpolchlo opened 3 years ago

jpolchlo commented 3 years ago

We observed the following log behavior:

21/04/29 21:07:19 DEBUG sources.AugmentedDiffSource: Fetching sequence 4529538
21/04/29 21:07:21 ERROR sources.AugmentedDiffSource: sequence 4529538 caused an error
java.lang.OutOfMemoryError: Java heap space

The augmented diff was larger than usual, but the problem is that the failure mode was to retry the download infinitely. We need to allow this failure to percolate up and kill the application so that other alerts might be triggered.