update documentMapper to allow easier extension via external mappers - Githubissues

pelias / openaddresses

Pelias import pipeline for OpenAddresses.

MIT License

51 stars 43 forks source link

update documentMapper to allow easier extension via external mappers #500

Closed missinglink closed 2 years ago

missinglink commented 2 years ago

following on from https://github.com/pelias/openaddresses/pull/490 this PR refactors the document mapper stream:

move GNAF functionality to separate mapper and test independently
generalise the country_code detection and make the property available via meta
store a pointer to the original OA row in meta to allow external mappers to access properties later in the pipeline

the benefits are that its easier (and cleaner) to add additional mappers as we have done in pelias/openstreetmap.

missinglink commented 2 years ago

these commits were merged as part of https://github.com/pelias/openaddresses/pull/502