azavea / osmesa

OSMesa is an OpenStreetMap processing stack based on GeoTrellis and Apache Spark
Apache License 2.0
79 stars 26 forks source link

Handle changeset metadata tags with quoted strings #219

Closed jpolchlo closed 2 years ago

jpolchlo commented 2 years ago

We encountered tags in the changeset metadata collection that buggered the ChangesetMetadataCreator batch job. This was because we had values with commas for the first time, and we had not configured the Spark CSV reader to handle these properly. Adding "quote" -> "\"" and "escape" -> "\"" to the reader options as described here fixes the problem.