ngageoint / hootenanny

Hootenanny conflates multiple maps into a single seamless map.
GNU General Public License v3.0
356 stars 74 forks source link

Ingest datasets using TDS4 translation results in failed export #311

Closed mikejeffe closed 8 years ago

mikejeffe commented 8 years ago

After working on https://github.com/ngageoint/hootenanny/issues/299, it looks like when I try to export the merged conflation output of the TDS4 ingested .gdb datasets, it fails. Not getting much in the log except below. Using the MAAX and Roads_113 gdb input files (from email) but ingesting as TDS4 instead of TDS6.

2016-02-09 10:49:28,561 ERROR JobExecutionManager:225 - Job with ID: ex_82a404a6577741048f14acd56ba1e8f3 failed: Failed to execute.Error running osm2ogr: Unable to open: postgresql://hoot:hoottest@localhost:5432/hoot/Merged_fgdb make: *** [step1] Error 255

mattjdnv commented 8 years ago

From the command line, I can import the data, conflate it and then export it without error:

#!/bin/bash
set -e

TDS_DATA=$HOOT_HOME/test-files/NFDD_TDSv4
TDS61_DATA=$HOOT_HOME/test-files/NFDD_TDSv61
MGCP_DATA=$HOOT_HOME/test-files/MGCPv3

TRANS40=$HOOT_HOME/translations/TDSv40.js
TRANS61=$HOOT_HOME/translations/TDSv61.js
TRANS_MGCP=$HOOT_HOME/translations/MGCP_TRD4.js

HOOT_OPT="-D ogr.debug.dumptags=true -D ogr.debug.lookupcolumn=true -D ogr.debug.lookupclash=true -D ogr.debug.dumpvalidate=true"

echo
echo "MAXX to OSM"
time hoot ogr2osm $HOOT_OPT $TRANS40 test_maax.osm MAAX_gdb_TDS4.gdb > in_maax.txt

echo
echo "Streets to OSM"
time hoot ogr2osm $HOOT_OPT $TRANS40 test_street.osm Roads_shp_113.gdb > in_street.txt

echo
echo "Conflate"
hoot unify test_maax.osm test_street.osm mrg.osm > c_unify.txt

echo
echo "Export TDS4"
hoot osm2ogr $HOOT_OPT $TRANS40 mrg.osm out_tds4.gdb > x_tds4.txt

echo
echo "Export TDS4"
hoot osm2ogr $HOOT_OPT $TRANS61 mrg.osm out_tds6.gdb > x_tds6.txt

Questions:

mikejeffe commented 8 years ago

@mattjdnv I actually could not reproduce this error with the latest develop. It's entirely possible something was corrupted with the original ingest when the error occurred so I'm fine with closing as not reproduce-able.