ngageoint / hootenanny

Hootenanny conflates multiple maps into a single seamless map.
GNU General Public License v3.0
358 stars 74 forks source link

Conflation error caused by poi/poly address parser #1577

Closed brianhatchl closed 5 years ago

brianhatchl commented 7 years ago

Error when conflating the rafah data. @bwitham Does this stack trace mean anything to you?

2017-05-24 20:40:54,056 ERROR ExternalCommandRunnerImpl:144 - FAILURE of: CommandResult{command=["hoot" "conflate" "--error" "-C" "RemoveReview2Pre.conf" "-D" "osm2ogr.ops=hoot::DecomposeBuildingRelationsVisitor" "-D" "writer.include.conflate.score.tags=true" "-D" "hootapi.db.writer.overwrite.map=true" "-D" "hootapi.db.writer.create.user=true" "-D" "writer.text.status=true" "-D" "api.db.email=test@test.com" "-D" "convert.bounding.box=34.0576171814,31.2034049459,34.1015624939,31.2409872412702" "-D" "reader.conflate.use.data.source.ids.1=true" "-D" "reader.conflate.use.data.source.ids.2=false" "-D" "id.generator=hoot::PositiveIdGenerator" "-D" "osm.map.writer.factory.writer=hoot::NonIdRemappingHootApiDbWriter" "-D" "preserve.unknown1.element.id.when.modifying.features=true" "-D" "map.cleaner.transforms=hoot::ReprojectToPlanarOp;hoot::DuplicateWayRemover;hoot::SuperfluousWayRemover;hoot::IntersectionSplitter;hoot::UnlikelyIntersectionRemover;hoot::DualWaySplitter;hoot::ImpliedDividedMarker;hoot::DuplicateNameRemover;hoot::SmallWayMerger;hoot::RemoveEmptyAreasVisitor;hoot::RemoveDuplicateAreaVisitor;hoot::NoInformationElementRemover" "-D" "small.way.merger.threshold=15" "-D" "match.creators=hoot::PoiPolygonMatchCreator;hoot::HighwayMatchCreator;hoot::BuildingMatchCreator;hoot::ScriptMatchCreator,PoiGeneric.js;hoot::ScriptMatchCreator,LinearWaterway.js" "-D" "merger.creators=hoot::PoiPolygonMergerCreator;hoot::HighwaySnapMergerCreator;hoot::BuildingMergerCreator;hoot::ScriptMergerCreator" "-D" "unify.optimizer.time.limit=60" "-D" "ogr.split.o2s=false" "-D" "ogr.tds.add.fcsubtype=true" "-D" "ogr.tds.structure=true" "-D" "duplicate.name.case.sensitive=true" "-D" "element.cache.size.node=2000000" "-D" "element.cache.size.relation=200000" "-D" "element.cache.size.way=200000" "-D" "conflate.match.highway.classifier=hoot::HighwayRfClassifier" "-D" "search.radius.highway=-1" "-D" "highway.matcher.heading.delta=5.0" "-D" "highway.matcher.max.angle=60" "-D" "way.merger.min.split.size=5" "-D" "conflate.enable.old.roads=false" "-D" "waterway.subline.matcher=hoot::MaximalSublineMatcher" "-D" "waterway.angle.sample.distance=20.0" "-D" "waterway.matcher.heading.delta=150.0" "-D" "waterway.auto.calc.search.radius=true" "-D" "search.radius.waterway=-1" "-D" "waterway.rubber.sheet.minimum.ties=5" "-D" "waterway.rubber.sheet.ref=true" "-D" "writer.include.debug.tags=false" "osmapidb://${OSMAPI_DB_USER}:${OSMAPI_DB_PASSWORD}@${OSMAPI_DB_HOST}:${OSMAPI_DB_PORT}/${OSMAPI_DB_NAME}" "hootapidb://${HOOTAPI_DB_USER}:${HOOTAPI_DB_PASSWORD}@${HOOTAPI_DB_HOST}:${HOOTAPI_DB_PORT}/${HOOTAPI_DB_NAME}/290" "hootapidb://${HOOTAPI_DB_USER}:${HOOTAPI_DB_PASSWORD}@${HOOTAPI_DB_HOST}:${HOOTAPI_DB_PORT}/${HOOTAPI_DB_NAME}/openstreetmap_Rafah_task27" "--stats"], jobId=[28324876-b24c-4f63-9331-a51e08a25bc4], command_id=[448], caller=[hoot.services.controllers.conflation.ConflateResource], workingDir=[/home/vagrant/hoot/userfiles/tmp], start=[2017-05-24T20:39:02.890], finish=[2017-05-24T20:40:54.053], duration=[PT-1M-51.163S], exitCode=[-1], stdout=[], stderr=[Error: signal 11: stack trace: hoot::SignalCatcher::default_handler(int) +0x2d /lib/x86_64-linux-gnu/libc.so.6 : ()+0x36cb0 hoot::PoiPolygonAddressScoreExtractor::_collectAddressesFromRelationMembers(boost::shared_ptr, QSet&, hoot::OsmMap const&) const +0x196 hoot::PoiPolygonAddressScoreExtractor::extract(hoot::OsmMap const&, boost::shared_ptr const&, boost::shared_ptr const&) const +0x17b3 hoot::PoiPolygonMatch::_getAddressEvidence(boost::shared_ptr, boost::shared_ptr) +0x3c hoot::PoiPolygonMatch::_calculateEvidence(boost::shared_ptr, boost::shared_ptr) +0x1eb hoot::PoiPolygonMatch::calculateMatch(hoot::ElementId const&, hoot::ElementId const&) +0x152 hoot::PoiPolygonMatchVisitor::checkForMatch(boost::shared_ptr const&) +0x285 hoot::PoiPolygonMatchVisitor::visit(boost::shared_ptr const&) +0xd2 hoot::OsmMap::visitNodesRo(hoot::ElementVisitor&) const +0xe9 hoot::OsmMap::visitRo(hoot::ElementVisitor&) const +0x11 hoot::PoiPolygonMatchCreator::createMatches(boost::shared_ptr const&, std::vector<hoot::Match const, std::allocator<hoot::Match const> >&, boost::shared_ptr) +0xc05 hoot::MatchFactory::createMatches(boost::shared_ptr const&, std::vector<hoot::Match const, std::allocator<hoot::Match const> >&, geos::geom::Envelope const&, boost::shared_ptr) const +0x1c5 hoot::UnifyingConflator::apply(boost::shared_ptr&) +0x344c hoot::ConflateCmd::runSimple(QStringList) +0x230e hoot::BaseCommand::run(char**, int) +0x18e /vagrant/hoot/bin/hoot.bin : main()+0x28d /lib/x86_64-linux-gnu/libc.so.6 : __libc_start_main()+0xf5 /vagrant/hoot/bin/hoot.bin() [0x4054b4] ]}

bwitham commented 7 years ago

not off the top of my head...but something's not right with the poi poly address parser. i'll take a look.

bwitham commented 7 years ago

I downloaded the OSM ref for this but can't seem to find the secondary data anywhere. Could you send it to me? thanks.