Publish school beacon data from Data Tracker to ArcGIS Online

[johnclary]

Todo:

• Review existing school beacon layer on AGOL (link?) [apps]
• Decide if we want to update that schema, or create a new layer [apps, geo]
• Review existing API view for beacons. Update it as needed. [apps]
• Setup knack services and ariflow scripts [dev]

[dianamartin]

Started comparing the AGOL feature layer and new Knack school beacon object table

• School Zone Beacons - feature layer
• atd_school_flashers_production - point layer

In AMD Asset Map

• Web Map: Traffic Signal Assets
• Web App: Assets - Austin Transportation Arterial Management

Created Data Comparison spreadsheet

[dianamartin]

@johnclary

It's looking like the data fields are more closely aligned with the data collection SZB layer than the existing one. I've synced with Allyson on 1/3 to see if she could tell if the MMC staff were using all the fields in the new SZB add/edit forms.

• [x] Will need to evaluate the existing SZB API table
  • this API view is associated to the school_beacon_OLD
  • A new API view would need to be created for the new school_beacon object

The existing GIS layer has the following fields that appear on the pop-up

• Location
• Direction
• ATD Location ID
• AM Start
• AM End
• PM Start
• PM End
• PM Start 2
• PM End 2

Open Data Portal

• I checked the Open Data Portal and the existing API seems to be the source of the School Zone Beacons data set
• Weird thing is the description of the data set says that "this product has been produced by CTM". The AGOL Layer is actually owned by the ATD Publisher. I'm kind of confused by this..

[dianamartin]

Create new data set for this effort

• [ ] Update API - using new school_beacons object
• [ ] Create new AGOL layer
• [ ] Add layer to AMD asset web map

[dianamartin]

Sync'd with Jorge, Ed and Billy and we were talking about something SZB related, I was able to ask them what they wanted to see on the GIS pop-up box

• DISPLAY NAME?
• ZONE NAME
• ZONE ID
• CLOCK
• BEACON
• DIRECTION
• SCHOOL NAME
• START TIMES
• END TIMES
• WEB IO

[amenity]

Discussed in planning:

• Can delete existing API view and do a fresh one on the same page; view # is what matters
• Use same page
• [x] Rename page "School Flasher" to "School Beacon"
• [x] Create new school_beacons API table
• [ ] Delete old school_flashers API table -
  • [x] created a backup copy in network drive - BACKUP_school_beacons_API_20220112

[dianamartin]

I check w/ John yesterday - 1/12,

For the SZB API table, do I need to change the field names on the table or leave them as is?

he replied

• you can leave the field names as-is. changing them on the table will have zero effect
• yep, and the field names on the AGOL layer need to match the field names on the knack object: except spaces can be underscores and upper/lower case does not matter

[dianamartin]

Ear marked fields to be deleted due to the fact they're not being used in the Details page or Add/Edit forms.

• [x] OBJECTID - Number
• [x] Zone Number - Number, comes from SZ table
  • [x] Need to create new field SZ ID
• [x] Beacon ID - Number, Beacon ID Short is sufficient bc it requires 2 digits like (ex. 00)
• [x] SZ Beacon ID - Short Text, new field School Zone Beacon ID is txt formula that comes from SZ table
• [x] Zone Name, Short, new field School Zone Name is txt formula that comes from SZ table
• [x] Zone Status - Multi-choice, new field SZ Status Name` is txt formula that comes from SZ table
• [x] School Name - Short, new field School Name is txt formula that comes from SZ table
• [x] AM Start Time - Date/Time, references SZ table on main table
• [x] AM End Time - Date/Time, references SZ table on main table
• [x] PM Start Time - Date/Time, references SZ table on main table
• [x] PM End Time - Date/Time, references SZ table on main table
• [x] PM 2nd Start Time - Date/Time, references SZ table on main table
• [x] PM 2nd End Time - Date/Time, references SZ table on main table
• [x] AM Plan - Short, references SZ table on main table
• [x] PM Plan - Short, references SZ table on main table
• [x] PM Plan 2 Display - Short, references SZ table on main table
• [x] Web-IO Name - Short, references SZ table on main table
• [x] Creator - Short, comes from AGOL
• [x] Editor - Short, comes from AGOL
• [x] GlobalID- Short, comes from AGOL

[dianamartin]

I asked John on 1/14

Should I just have Jaime set up the same fields for Location Name and Lat/Long?

John said

we only need location_name. the lat/lon columns have been deprecated

[dianamartin]

@jaime-mckeown Here is a spreadsheet that you can use to build out that empty layer in AGOL. I have it separated by Alias, AGOL field headings, KNACK field headings and the type. Use the AGOL headings to create it, let me know if you have any questions school_beacons_API_new_20220113.csv

[jaime-mckeown]

• Created new point layer under working FGDB for SZB using csv from Diana, and published to AGOL under the ATD Scripts Publisher account.
• Overview: https://austin.maps.arcgis.com/home/item.html?id=ebde70df086942c286dcf9f3f3449f2f
• REST: https://services.arcgis.com/0L95CJ0VTaxqcmED/arcgis/rest/services/School_Zone_Beacons/FeatureServer

[dianamartin]

@johnclary I confirmed the new empty feature class matches what I have in the new API table. This is ready for dev team to integrate Knack to AGOL.

[chiaberry]

I'm getting this error when I try upserting to agol: ValueError: {'code': 1000, 'description': 'String or binary data would be truncated.\r\nThe statement has been terminated.'}

@jaime-mckeown Could this be republished with longer field lengths? thanks in advance

[alan-deanda]

@chiaberry all text fields are now 1000 characters long.

[jaime-mckeown]

Thank you @alan-deanda for getting that done!

[amenity]

Thanks, @chiaberry @jaime-mckeown @alan-deanda

Should we remove these older datasets?

Also, how often should the data be updating? The description says daily but it's been 5 days. 🤔

[dianamartin]

@amenity Chia told me it's updating daily bc she asked me what frequency it should be and I said daily sounds about right.

[chiaberry]

I haven't merged the script to update daily yet. It's been approved so I will this afternoon.

[amenity]

Aha, that makes sense. Thanks, @dianamartin @chiaberry.

[dianamartin]

Will email stakeholders tomorrow 2/24, will wait until ETL is finalized. @jaime-mckeown did the new school beacons layer get added to the AMD asset map yet?

[jaime-mckeown]

@dianamartin this is the first I've heard that the new layer went live. I will get the maps updated.

[amenity]

@jaime-mckeown - will you drop a link to the AGOL map here when you're done, please? I was confused which one it is.

[jaime-mckeown]

@amenity there are multiple maps that have SZB data in them, I assume that you are looking for the main AMD assets map that Diana mentioned.

[amenity]

@jaime-mckeown - Aha, wrong terminology: I meant a link to the AGOL page for the feature layer. I assume it is this one and that the other two are obsolete?

[jaime-mckeown]

@amenity below is the new one, it's easier to tell now as all feature layers created via scripts from Knack are owned by the ATD Publisher Script account. https://austin.maps.arcgis.com/home/item.html?id=ebde70df086942c286dcf9f3f3449f2f

I will mark the other layers as deprecated, then remove them once I have updated the Web Maps.

[amenity]

@jaime-mckeown - super, thanks!

[dianamartin]

Just checked out the new SZB Layer that Jaime linked and spot checked known new records - Overton and Norman. They show up spatially.

Checking the AMD Asset map this morning, looks like it's still the old SZB layers. I'm going to wait for @jaime-mckeown to update the map and then I'll send that email to stakeholders today.

[jaime-mckeown]

Sorry @dianamartin I'm juggling a ton right now. I will ask Andrew to update so it gets done.

[jaime-mckeown]

@dianamartin the Assets Web Map has been updated. I will any other maps that have the SZBs as well today. https://austin.maps.arcgis.com/apps/webappviewer/index.html?id=c9bda776b1934e439285570b29d3259c

[jaime-mckeown]

Set the new School Zone Beacons layer as Authoritative in AGOL.

[johnclary]

@dianamartin plz update and close. thank you @jaime-mckeown !

[dianamartin]

I emailed stakeholders on 2/24

Hi all, The process to update the “school beacon zones” layer in GIS from Knack should be updating on a daily frequency now. Just letting everyone know so they can check the asset map to review and QA/QC the new changes.

• You’ll noticed that you have more fields to reference in the pop-up box. Let us know if there are any other changes/bugs you find.