search

cityofaustin / atd-data-tech

Austin Transportation Data & Technology Services
17 stars 2 forks source link

Clean up bike facility data in the open data portal #8172

Open alan-deanda opened 2 years ago

alan-deanda commented 2 years ago

Performing a search on Socrata for "bike facilities" yields the following results:

image.png

Austin Bike Facilities contains links to the REST end point and AGOL download page.

TRANSPORTATION_bicycle_facilities contains a map/table view that allows users to export the data in multiple formats from Socrata.

The online bike map currently includes a link to the TRANSPORTATION_bicycle_facilities result.

Both results seem to lead to the same data, it just lives in different places. However, this is not indicated anywhere on the links above, and each link has a different "last update" date. This is confusing for users, as it requires comparing multiple segments and a fair amount of familiarity with the data to ascertain its quality/freshness.

The data was recently updated through tickets submitted to CTM; it used to be much more stale and difficult to access. However, ensuring you're looking at the right data is still not an easy task for a user (especially one that is not familiar with internal COA GIS data naming conventions/maintenance practices).

Do we need 2 results in Socrata? Is it possible to combine the 2 result types into one? For example, can we add an 'export in desired format' button below the REST/AGOL buttons?

Ideally, we'd have a single data source with a single date for last update, and we would be able to give it a user-friendly name and a user-friendly description.

alan-deanda commented 2 years ago

@andrewshensky this is the issue about how the bike facilities data is presented in Socrata

amenity commented 2 years ago

CTM has not been responsive when @alan-deanda reaches out to them about fixing this data.

amenity commented 2 years ago

We should either handle with GIMOB or bring up with our CTM BRM.

dianamartin commented 2 years ago

@alan-deanda is the dataset TRANSPORTATION_bicycle_facilities being updated automatically or are we having a manual request to CTM?

dianamartin commented 2 years ago

Looking at these two datasets the:

Type: External Link

Type: Map

image

Type: Dataset

image

alan-deanda commented 2 years ago

@dianamartin thanks for looking into this.

Is it possible to:

  1. Turn Transportation_bicycle_facilities from a map type to a dataset type?
  2. Rename it Austin Bicycle Facilities, and add other tags so that it can be found more easily? I can provide a list of keywords
  3. Delete the old Austin Bicycle Facilities page?
  4. Add an option in the download submenu that links to the AGOL Online Details and/or REST page? This one is definitely more optional, and perhaps not as useful if CTM doesn't add a download button to to AGOL layer.
dianamartin commented 2 years ago

Need to figure out if this update request impacts anything.

alan-deanda commented 2 years ago

@alan-deanda is the dataset TRANSPORTATION_bicycle_facilities being updated automatically or are we having a manual request to CTM?

@dianamartin This is an automatic update. We have a geodatapusher job that grabs the bike facilities from MAINT to DM, and CTM automatically updates the AGOL and Socrata versions.

dianamartin commented 2 years ago

@alan-deanda thanks, for that explanation. How do we want the users to download the data from Open Data Portal then?

dianamartin commented 2 years ago

8/17

Synced with Marbenn (CTM) and we talked about reaching out to Tyler about search relevancy and what we can do to optimize the search for this dataset.

Updated

dianamartin commented 2 years ago

8/18

Marbenn wrote to Tyler Tech on 8/17, 4:08 pm

Howdy! My excellent colleague Diana and I were reviewing a couple of their datasets in Open Data and we have questions on how they are ordered by search results as one came up as the top one,

https://data.austintexas.gov/dataset/Austin-Bicycle-Facilities/kfe9-st9c while another was listed on the second page (both related to searching "bicycle"). https://data.austintexas.gov/Transportation-and-Mobility/TRANSPORTATION_bicycle_facilities/uwbq-ycek

Their preference is that the latter dataset would come up in the top results as well. Currently the search criteria is defaulted to "Most Relevant". How can they help datasets move up the result list? Is there a prioritization of search words within the title, tags, etc. . .? And on a somewhat related effort, they would like to update the title and metadata of this map dataset hoping to help this searching. But wanted to confirm that this would not affect it's current automation which was created using the ESRI Connector (looks like the older map version prior to the new table and map combo). I'm pretty confident that it should not be affected but to put all of us at ease, confirm with y'all.

Tyler Tech replied

Hey Marbenn, Thank you for reaching out. I will look into the issue around search priority.

  • On the topic of metadata, those values are determined by what comes from the ESRI asset and the changes on the Data & Insights asset will be overwritten when the asset next syncs.
dianamartin commented 2 years ago

9/7 - Reach out to Marbenn to see if he got a reply from Tyler Tech.

dianamartin commented 8 months ago

@andrewshensky I think was a long lost issue.. not sure if you guys are still pursing this dataset to be shared and downloaded.

andrewshensky commented 8 months ago

@dianamartin Thanks for digging this one up, ill take a closer look at it. We should be able to push a view of the bike facilities data from the CTN to the odp on our own nowadays.

dianamartin commented 8 months ago

[like] Martin, Diana reacted to your message:

From: andrewshensky @.> Sent: Friday, February 23, 2024 10:28:00 PM To: cityofaustin/atd-data-tech @.> Cc: Martin, Diana @.>; Mention @.> Subject: Re: [cityofaustin/atd-data-tech] Clean up bike facility data in the open data portal (Issue #8172)

External Email - Exercise Caution

@dianamartinhttps://github.com/dianamartin Thanks for digging this one up, ill take a closer look at it. We should be able to push a view of the bike facilities data from the CTN to the odp on our own nowadays.

— Reply to this email directly, view it on GitHubhttps://github.com/cityofaustin/atd-data-tech/issues/8172#issuecomment-1962084266, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AFBCRDY6B2MTEA7HLPJOHG3YVEJXBAVCNFSM5L5DV562U5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOJWGIYDQNBSGY3A. You are receiving this because you were mentioned.Message ID: @.***>

CAUTION: This is an EXTERNAL email. Please use caution when clicking links or opening attachments. If you believe this to be a malicious or phishing email, please report it using the "Report Message" button in Outlook or forward to @.***