[The USA] Mapping missing streets

vladaboitsik commented 3 years ago

Background As a part of on-going work to improve the quality of OpenStreetMap Mapbox SDKs collect anonymous data and device location to continuously update data. Link to the OSM Wiki page. More information about telemetry is here.

We are now looking at mapping missing roads across several states. The current list of the states is California, Nevada, Arizona, Utah, and New Mexico. There may be more to come.

What we are going to map?

It will be different types of motorable roads (**highway=*** ) according to OSM Wiki. Mostly will map only geometry without names and ref (excluding cases where we prolonging existing road), and not going to map different types of restrictions only in cases where it's obvious and easy to confirm by ground truth sources.

How do we confirm it’s an actual street? Location data is used to identify possible new streets, hiking trails, and bike paths. We then confirm its existence with street level images (as Mapillary or Bing Streetside) and satellite imagery, and only then do we map the road.

What does telemetry data look like? More examples here

Example of using telemetry in To-Fix:

Example of mapping:

Here you can see a telemetry represented as bundle of ways (in blue color). Below screen OSM without a mapped road but we can clarify it with the satellite image and map it.

Contact person: We welcome feedback, suggestions, and insights from local mappers. If you have questions about this work, or a specific edit by our team, please reach out to Vlada at vlada.boitsik@mapbox.com or post a comment in a changeset.

A unique hashtag We will use the hashtag #mbx_missingstr_usa

Goal of the activity To improve map quality by adding roads.

Timeframe We are going to start till the end of the week.

Any non-standard tools and data sources used, and their usage conditions We used some internal tools for processing driver’s feedback and collecting telemetry. And for OSM edits we use only OSM iD and ground truth sources (Bing, Esri, Maxar satellite imagery and street level sources such as Mapilary ).

@legain @Andygol @abrohood @shvrm @lukasmartinelli @mikelmaron

blackboxlogic commented 3 years ago

Please consider updating your public documentation to include a list of tags you will (or won't) use. That would address community questions like "will speed data be tagged?" or "will you add street names to roads?" or "which highway and access tags will you use" (alluding to issues we've recently had with other paid editors)

Also, is your telemetry data publicly available? Under what license? How old is the data?

vladaboitsik commented 3 years ago

Hi @blackboxlogic! I'll add info about tagging. In general we map all types of motorable roads, without names and any specifications, can add some types of restrictions if it will be obvious according to ground truth sources.
Telemetry doesn't available publicly. Data was uploaded for the last month, so we can be sure that it's up to date.

vladaboitsik commented 3 years ago

Team finished reviewing Missing streets with the great results. The whole amount of mapped/fixed roads is 7883 (in 1 item could be several roads.) Example of our edit.

So, for now this project is finished.

vladaboitsik commented 3 years ago

The team is going to continue to review Missing streets in the same geographies with newer data download for March approximately for the next 2 weeks.

vladaboitsik commented 3 years ago

We decided to review Missing streets monthly, so below results of review data for the March.

During the 1st review week:

During the 2nd review week:

In total team reviewed 3328 items and fixed 2440 of them!

Now team started to review April data in the same localities.

wwunjo commented 3 years ago

Update of last two months review April review report 115231315-1480ac80-a11e-11eb-8817-80dedcfdb095 May review report 120001590-9d6feb00-bfdc-11eb-8364-c86fcb5649d5 (1) In total we reviewed 6117 items and fixed 3627 of them! Now team started review new data in the same locations.