osmlab / labuildings

Los Angeles County building import
BSD 3-Clause "New" or "Revised" License
45 stars 14 forks source link

Preparing the Tasking Manager project #29

Closed maning closed 8 years ago

maning commented 8 years ago

The initial plan is to manage this import using the Tasking Manager. Ideally, using the osm.us instance.

We started developing the feature of being able to download the data in the TM. See this demo.

To be able to run this in osm.us instance, we need to merge this feature in TM's main code. As per conversation with my colleagues (@batpad and @geohacker), this may not be possible if we want to get this rolling ASAP for two reasons:

Given the above scenario. I see two options:

  1. Deploy a separate TM instance with the download data feature just for this import. We can maintain this instance during the import process and for a limited time after the import. I made a sample running TM project here: http://52.74.49.58:6543/project/15
  2. Use the osm.us instance without this feature. We can prepare a document like a spreadsheet or wiki where importers can download the data in their respective task. This adds an overhead for those participating in the import, but I don't think its too much of hassle provided we give clear instructions in the import guidelines.

Lets use this ticket to discuss the pros/cons of the outlined options or, if there are other ways.

@almccon @jschleuss @cityhubla @planemad

maning commented 8 years ago

I prepared filtered blockgroups here: https://github.com/osmlab/labuildings/tree/master/task_blocks

We agreed to prepare the first import for LA city but loading all of LA city in one TM porject may slowdown the TM site.

I propose we split LA City into several projects. For example: downtown LA, north section, south section.

Other ideas?

screen shot 2016-02-26 at 15 22 39

almccon commented 8 years ago

Or maybe split into four: north section (The Valley), Westside, Eastside (central section including DTLA), and south section.

I suggest this mainly because Westside/Eastside is a common psychogeographic concept for most Angelenos.

maning commented 8 years ago

@almccon, I found this resource from LA Times it draws boundaries of 16 neighborhoods for the whole LA County. Should we use this?

screen shot 2016-02-29 at 14 23 20

planemad commented 8 years ago

@maning ^ that looks like a great reference, we should go with this.

maning commented 8 years ago

@planemad, generated geojsons.

almccon commented 8 years ago

@maning looks great. Those regions don't line up with the LA City boundary, so are you thinking that we intersect those regions with the LA City boundary to get our first set of projects?

maning commented 8 years ago

For LA City only, here's the block groupings:

screen shot 2016-03-01 at 14 58 45

Note that there are holes because according to LA County city boundaries, they are not part of LA City such as Beverly Hills and San Fernando City.

@almccon

almccon commented 8 years ago

Nice! Is the Eastside group small enough (with 1,322 blocks)? We could subdivide it further if necessary. Or maybe move the blocks that are in the South LA subregion from our Eastside into our Southside.

cityhubla commented 8 years ago

Can the groups be tasked? I'm wondering if the Southside can be our test for JOSM training and the Eastside for the mapathon. Are the blocks outside of LA City being included? The black dotted line on this image shows the boundaries for LA City.

image

maning commented 8 years ago

@almccon Moved blocks from eastside to southside. All groupings are now under 1k.

screen shot 2016-03-02 at 12 55 49

@cityhubla,

Can the groups be tasked?

Yes, I'm just waiting for @iandees to migrate the current osm.us TM instance to have this download import data feature. We are preparing a backup instance in case osm.us is not ready for the training and mapathon.

Are the blocks outside of LA City being included? The black dotted line on this image shows the boundaries for LA City.

Not yet, we focus on LA City for initial import stage.

iandees commented 8 years ago

As far as I know the feature to load OSM data into the task via the geojson has not been merged into the tasking manager repo. I don't feel comfortable maintaining a fork that hacks the feature in and am waiting for it to be merged before doing anything to tasks.openstreetmap.us.

almccon commented 8 years ago

@maning the new groupings look great to me!

@cityhubla,

I'm wondering if the Southside can be our test for JOSM training and the Eastside for the mapathon.

We could do this, or we could use the same grouping for both... since we don't know yet how long this will take, maybe we just try to funnel all the attention into just one of the groupings until it's mostly finished? I could go either way.

maning commented 8 years ago

Tasking Manager better slightly better URL: http://labuildingsimport.com/ Ideally we want it in the US TM instance, but the enhancement PR is not yet merged. I agree with @iandees on not merging this feature to US TM unless its in master. But since we have a mapathon this week, we wnet ahead to deploy a custom instance.

Let's discuss later how long we want to maintain this after the import.