search

andrewxhill / MOL

The Map of Life
mol.colorado.edu/
19 stars 4 forks source link

Merge PostgreSQL metadata, geometry and Google App Engine metadata exports #122

Closed gaurav closed 12 years ago

gaurav commented 12 years ago

We're going to clean up our bulkloading process and set it up as:

  1. For each shapefile:
    1. Create metadata CSV (for ALL rows in this shapefile)
    2. Bulkload to PostgreSQL (by doing a COPY FROM CSV ...). This will give the rows unique 'id's.
    3. Bulkload to Google App Engine (by doing a single COPY TO CSV .. WHERE prov=p, coll=c, filename=f)
      1. Run shp2pgis.sql on shapefile -> temp table
    4. Update layers table using nested select magic (INSERT INTO layers WHERE .... FROM (SELECT geom FROM TempTable ...))

This issue is just to document the process we're aiming for and for naming the branch :).

gaurav commented 12 years ago

Moved to https://github.com/MapofLife/MOL/issues/1