search

kcigeospatial / MDOT-SHA-NPDES-Next-Gen

Code and issues related to the MDOT SHA NPDES Project. Project codes: Config = 31, Management = 32.
0 stars 0 forks source link

Global ID not removed from blank record in flattened attributes #283

Closed KCI-Ablowers closed 5 years ago

KCI-Ablowers commented 5 years ago

While performing updates/QAQC using the pre-submittal/upgrade ETL Issues (that i exported from the query widget), we noticed an issue with a flattened table guid.

Structure# 1201291.002 - I changed the type from an EH to MH. The ETL issue - sc1

Attribute tables - sc2 sc3

The GlobalID is still present in the EH record even though the attributes were removed. Both an End/Headwall and a Connection record are present in production. It looks like the COM_EH was backed out, but didn't show up as Null. image

I think the web app doesn't let you select "Null" specifically as Collector and ArcMap do. @johnshiu is there anyway we could treat an empty cell or space as null in the ETL? Or does it already do that and this was just a one off?

johnshiu commented 5 years ago

@KCI-Ablowers, I updated the script so that it should ignore whitespaces now; please try it again and let me know if it's resolved.

KCI-Ablowers commented 5 years ago

Thanks, @johnshiu. Next time we validate I will confirm the change is working.