Mapping turn lanes for navigation in 30 cities in US

[abhisheksaikia]

Objective: Map missing turn lanes from secondary and up in 30 US cities.

Team: @mapbox/team-data

Features to map: Turn lanes (motorway, trunk, primary and secondary) from satellite imagery

Focus Area: 30 top cities in US as per population

Available data sources

Source	Description	Quality	Coverage	License
Mapbox Satellite	Imagery	Intermediate	Good	:white_check_mark:
Bing Imagery	Imagery	High	Good	:white_check_mark:
USGS large scale imagery	Imagery	High	limited	:white_check_mark:

Tasks

Location	Start	End(ETA)	Validation
San Francisco	05/5/2016	05/11/2016	Done
Portland	05/16/2016	05/17/2016	Done
Dallas & Fort Worth	05/18/2016	5/23/2016	Done
New York	05/23/2016	05/30/2016	Done
Detroit	05/30/2016	06/02/2016	Done
Houston	06/03/2016	06/09/2016	Done
Philadelphia	06/08/2016	06/15/2016	Done
Baltimore	06/15/2016	06/16/2016	Done
Oklahoma	06/22/2016	06/22/2016	Done
Boston	06/22/2016	06/27/2016	Done
Denver	06/28/2016	06/29/2016	Done
Seattle	06/29/2016	07/01/2016	Done
Chicago	07/01/2016	08/05/2016	Done
San Diego	08/08/2016	08/10/2016	Done
Austin	08/10/2016	08/11/2016	Done
Phoenix	08/11/2016	08/18/2016	Done
DC	23/01/2017	30/01/2017	Done
LA_exterior	13/02/2017

JOSM Workflow

Setup

• Activate the following in from JOSM preferences > Map Settings
  • Map Paint Styles: Lanes and road attributes
  • Tagging Presets: lane attributes
• Filter out non road features with boundary: | leisure: | landuse: | waterway: | amenity: | natural: | building:
• Add inverse filter: highway=motorway|trunk|primary|secondary|*link|motorway_link or untagged
• Read http://wiki.openstreetmap.org/wiki/Key:turn:lanes
• Read https://github.com/mapbox/mapping/wiki/Mapping-guide-for-turn-lanes-from-imagery
• Install the 🔪 tool in JOSM to easily split the roads: https://wiki.openstreetmap.org/wiki/JOSM/Plugins/Knife-tool

Mapping

• Check the roads for turn lanes at exits and entry points
• Split the road into segments based on the total number of lanes for the segment
• For each road segment tag the turn lanes based on the road markings in the direction of the way. Eg. turn:lanes=left|through|right. See OSM turn:lanes
• For bi-directional segments, use turn:lanes:backward= and turn:lanes:forward= to specify turn lanes in each direction.
• Verify correct tagging using the Lane attributes style

  Issues to keep in mind:

• For QA and edge cases in turn lanes mapping and how to handle them(parking lanes, splitting roads for start and end of turn lanes, handling of dual carriageways, etc) look into the QA for turn lane data document.

Changeset Comment: Add missing turn lanes from satellite imagery https://github.com/mapbox/mapping/issues/180

Source: Bing/Mapbox/USGS Large Scale Imagery

Turn lane mapping tickets: #144, #153

[planemad]

@drkludge @Andygol @samely @rickmastfan67 lets move the broken relation conversation to https://github.com/mapbox/mapping/issues/224

[jothirnadh]

Recently Mapbox satellite imagery in DC is rendered with 3-inch recent ortho imagery which will be a great spot to resume our turn lane mapping effort which we paused in August 2016. Created a turn lane mapping task for DC which we can target to hit next week. There is a total of 361 mapped turn lanes in DC.

Points to be noted:

• Let's make sure to add missing streets at the junctions where we map turn lanes if we come across any 🙏.
• Make sure the relation of the road is not broken before splitting the road for adding a turn lane
• Let's stick to the same workflow which we followed to map turn lanes in Phoenix apart from adding missing streets at junctions.

cc:// @RichRico @maning @abhisheksaikia

[Andygol]

There is data set with Intersection Points on opendata.dc.gov with 18,276 features - http://opendata.dc.gov/datasets/4b4155ee7bb443aa9a37a3f8e22a8abc_35

There is a possibility to mark turn:lanes on the roads around ☝️ these points. For this purpose it is good to use https://osmlab.github.io/to-fix/.

@Rub21, is it possible to make to-fix task for one of DC neighborhoods for trial run?

[Andygol]

Doing turn lane mapping task for DC please pay attention on such cases 👇 and apply right oneway=yes tagging and direction for the way

[maning]

is it possible to make to-fix task for one of DC neighborhoods for trial run?

@Andygol before we do this, some clarifications;

• The way to-fix works is that a mapper will be assigned a random intersection to work for every task. We lose context on the area.
• We may introduce conflicts when several people were assigned to an intersection that is part of a long road.
• We don't map turn lanes on residential roads, the intersection you linked include all intersections regardless of highway type. How do we filter this out?

@jothirnadh @Rub21 @samely

[Andygol]

@maning

• The way to-fix works is that a mapper will be assigned a random intersection to work for every task. We lose context on the area.

Only in case if we add not only turn:lanes but we add lanes=* tagging along the way between intersection

• We may introduce conflicts when several people were assigned to an intersection that is part of a long road.

The same may happened even in standard workflow when way goes across two tasks

• We don't map turn lanes on residential roads, the intersection you linked include all intersections regardless of highway type. How do we filter this out?

There is possible just to skip it as we do it in to-fix usually or before creating task in to-fix find nodes that is near Major roads

cc @jothirnadh @Rub21 @samely

[Rub21]

@Andygol @maning :hand:

There is possible just to skip it as we do it in to-fix usually or before creating task in to-fix find nodes that is near Major roads

I can help you filtering this data for Major Roads, 18,276 is a lot of items to do a skip.

[jothirnadh]

@RichRico @Rub21 @samely it would be great if @mapbox/peru-office can take up this DC turn lane mapping task and target to complete it as soon as possible 🚀

[Rub21]

@Andygol @maning , I just filtered the point for major roads, it reduces to 10,198 items. find all here, https://gist.github.com/anonymous/268daa5bd7f747c21d45a4cd1253a4f6.

[micahcochran]

The knife tool is now part of the auto_tools plugin, which can easily be installed through the default plugin installation. No "activation" needed. See http://wiki.openstreetmap.org/wiki/JOSM/Plugins/Knife-tool

[RichRico]

@jothirnadh @Andygol Today the ayacucho office began to work on the task of turn lanes in Washington DC

[jothirnadh]

While validating turn lanes in DC, I found that the base data of DC is not aligning with new Mapbox 2015 imagery. Mostly in case of Major highways which are constructed recently.

This might be because the existing data is traced from outdated Bing imagery (2011) which drastically changed in time.

Mapbox-2015, bing-2011

It would be great if we can have a separate task to align major roads in DC city with Mapbox 2015 imagery to update the base map.

cc:// @maning @planemad @abhisheksaikia @RichRico @shvrm

[RichRico]

Washingtong DC task completion summary:

Great work @mapbox/team-data on adding and reviewing turn lanes in Washington DC 🎉 . Our team reviewed and added turn lanes based on the new 3-inch recent orthoimagery in DC. Do check it out.

During the course of this task, our team added ~2548 turn lanes in DC during a course of 3 mapping days with a total of 8 mappers working on the task. The total count of turn lanes in DC now is ~3200.

Final Statistics in Washington DC turn lanes mapping sprint (including validation):

• Total number of working days: 3
• Existing turn lanes before sprint: 806
• Total number of turn lanes mapped durg sprint: 2548
• Total area covered: 755.399 square kilometers
• Turn lanes density: ~3 turn lanes/ square kilometer

Findings from the current task:

• The major highways are not aligned with Mapbox imagery in core city area which should be fixed to improve base map in DC.
• The existing road classification in DC looks a bit odd, should be cross verified once.
• In general, the road with physical separation is mapped as a dual carriageway in OSM. While mapping turn lanes if we come across any roads mapped as single carriageway instead of dual carriageways we make sure to split the road. But if that road is having an existing relation, then we skip the road to make sure we don't break the relation. We are coming across such cases more often and it is good to get a solution for this problem. @andygol and @samely and ideas on how we can solve this issue.
• Turn lanes in tertiary roads are not being mapped as a part of the current workflow but found a couple of them existing in tertiary roads. Continuing from next task lets make sure to cross verify the ratio of turn lanes on tertiary roads before starting the task.
• In this particular task turn lanes were mapped using Mapbox imagery for core city area and Bing imagery at city outskirts, going forward the task can be limited so the people don't need to cross verify with varying sources.

Please feel free to contribute and give feedback on our mapping processes on our mapping repo where we track all our ongoing mapping projects.

[jothirnadh]

Great work in mapping turn lanes in DC 👏 . Continuing turn lane mapping quest, let's hit missing turn lanes in outskirts of LA covering Pomona, San Bernardino, and Redlands. Created a mapping task for this region which has ~582 existing turn lanes.

Major blockers:

• There are a lot of roads mapped as bi-directional roads, which are supposed to be mapped as dual carriageways, due to the presence of physical barrier in between them. Please make sure to split them into dual carriageways before mapping.
• Don't split the roads having route relations as there is no proper workflow to fix them. Need help from local community members for fixing this issue.

Ex:

Road mapped as bi-directional road with an existing relation

cc:// @mapbox/team-data

[Andygol]

You can find the description of the workflow "How to split a bidirectional road to the road with separate ways in each direction" here - https://gist.github.com/Andygol/a2ff609bb4d71274245d51b1c253b832

dealing with relations ☝️

[Andygol]

@mapbox/team-data if you are faced relation for a Public Transport route, ping me with links to it for extending workflow on such case.

[jothirnadh]

Thanks for sharing the ^^ workflow @Andygol, @chtnha and I will do a trial run and post our findings soon before including it into our regular workflow 🙇 .

Major findings from validation so far:

• We are not mapping turn lanes/ splitting the road as dual carriageways if the road has an existingRoute relations, but finding roads not touched even if it is tagged with turn restrictions. Let's make sure the roads with turn restrictions are not skipped.
• Don't touch roads with route relation for now, don't even map turn lanes in that roads.
• In few blocks the bi-directional roads with physical separation are not mapped as dual carriageways even if they are not a part of any route relation.

@mapbox/team-data do invalidate the blocks which fail to fulfill the above criteria and let the mapper fix them.

[ridixcr]

Guys when I was validating turn lanes on # 81 - Turn Lanes in Los Angeles outskirts- Chino, San Bernardino & Redlands found this error and solved it, as follow, according to the turn restriction rules.

@Andygol @jothirnadh @RichRico

[maning]

When we create dual-carriageways, make sure to update lanes count for the created ways and not just in the way which has turn-lanes.

[Yurasi]

@mapbox/team-data do invalidate the blocks which fail to fulfill the above criteria and let the mapper fix them.

@mapbox/peru-office thinks that instead to invalidate the blocks, we shlould correct them, in this way we could reduce the time in finishing the task, because we aren't going to take extra time in reviewing by one person and validating again by another person. Also, instead to invalidate we could left a comment on the block with the kind of mistake we have corrected during the validation.

Some findings from validation so far:

• The number of lanes not coincide with number of carriles. This because of that some aren't using the turnlanes plugin.
• Some make a mistake of identify merge_to with slight.

@jothirnadh @maning @karitotp @RichRico @poornibadrinath

[RichRico]

Turn Lane LA exterior task completion summary:

Great work @mapbox/team-data on adding and reviewing turn lanes in LA Exterior 🎉 . that were missing turn lanes in outskirts of LA covering Pomona, San Bernardino, and Redlands.

During the course of this task, our team added ~9,075 turn lanes in LA Exterior during a course of 5 mapping days with a total of 22 mappers working on the task. The total count of turn lanes in LA exterior now is ~9,657.

Final Statistics in LA turn lanes mapping sprint (including validation):

• Total number of working days: 5
• Existing turn lanes before sprint: 582
• Total number of turn lanes mapped during sprint: 9,075

Findings from the current task:

• In the process we find the way to solve relations of turn restriction https://github.com/mapbox/mapping/issues/180#issuecomment-280469986
• The best way to validate the blocks is not to invalidate them but to leave a note and finish the correction of the block, in this way it will reduce the validation time, and some people aren't using the turn lanes plugin https://github.com/mapbox/mapping/issues/180#issuecomment-280664795

[maning]

Paused. Wil revisit later.