Data discrepancy - markings_specialty_points

cityofaustin / atd-data-tech

Austin Transportation Data & Technology Services

17 stars 2 forks source link

Data discrepancy - markings_specialty_points #1429

Open SurbhiBakshi opened 4 years ago

SurbhiBakshi commented 4 years ago

SPECIALTY POINT and SPECIALTY POINT SUB TYPE are shown as numbers instead of text On AGOL, SPECIALTY POINT has text but SPECIALTY POINT SUB TYPE only lists numbers so it might be an issue that has something to do with ESRI not the data portal but I’m not sure.

Austin Data Portal list 36784 features while AGOL lists 37784 features. It is strange that exactly 1000 features are missing in Austin Data Portal

SurbhiBakshi commented 4 years ago

The coded domain issue exists for other GIS datasets as well, not sure why it comes across in one field and not another though.

SurbhiBakshi commented 4 years ago

Downloaded copy of dataset from Open Data Portal, number of records - 38,171 AGOL dataset - 38,171 records

will check on this again to see if number of records change, perhaps the time the two datasets are refreshed is different and there is a time lag?

SurbhiBakshi commented 4 years ago

Downloaded copy of dataset from Open Data Portal, number of records - 38,171

AGOL dataset - 38,171 records

amenity commented 4 years ago

@SurbhiBakshi - a few questions:

Does this have to do with the Signs and Markings Knack app?
What team should this be assigned to for resolution? Or does this issue represent tracking down the discrepancy and you'll make a new issue for the fix?

Wondering if maybe it would be helpful to make you a template and/or label for these open data quality issues. 🤔 Here's a similar one: https://github.com/cityofaustin/atd-data-tech/issues/1180

SurbhiBakshi commented 4 years ago

@amenity - a template or label would be great, this is probably the first one of it's kind I have had to address, but probably won't be the last.

This is an Open Data issue, not really related to the app, more of a GIS/ Socrata lost in translation issue. There were to issues here -

[x] There was a difference in numbers between the same dataset on AGOL and on Socrata. That doesnt seem to be the case anymore.
[ ] The other issue is with coded domains appearing differently, it's not readily apparant why that is happening, so I will send in a ticket to CTM to look into that.

amenity commented 4 years ago

@SurbhiBakshi cool. I'll add the Apps label to this since you're taking care of it? I like to make sure all issues have a Service:label so they show up in a Sprint Planning/Backlog Grooming.

amenity commented 4 years ago

@jaime-mckeown - Surbhi will sync with you on this after ~SxSW~ Spring Festivals. :)

jaime-mckeown commented 3 years ago

@SurbhiBakshi I've seen this in my backlog. Is there something I need to do with the Markings data? Thanks

SurbhiBakshi commented 3 years ago

@jaime-mckeown - not sure, let me revisit this issue. It's been some time.