import pipeline v1 (alpha) to-do list

[max-mapper]

I think we should try to split this up into as many pieces as possible, similar to how the pipelines here are represented https://github.com/bionode/bionode-example-dat-gasket/blob/master/package.json#L26

Also would be nice if all of the components that have nasty dependencies were dockerized and had command-line APIs

Parts we need:

• [ ] put the stripe 82 wise catalog data into a dat (https://github.com/maxogden/dat-wise-stripe-82)
• [ ] dat cat and filter out only the properties we care about (e.g. not all 300 properties but the ~15 we want)
• [x] calculate the healpix pixel for a given ra/dec pair
• [ ] create the trixel db for this healpix region if it does not exist
• [ ] write the data to the trixel postgres db

[max-mapper]

for filtering we can use jsonfilter and jsonmap if we convert the catalog data from csv into json first

[max-mapper]

for the ra/dec -> healpix, it would be nice to have it as a docker transform:

echo '{"ra": "50.54", "dec": "0.35"}' | docker run yuhong/ra-dec-to-healpix
// prints out {"ipix": 238383282838, "nside": 38842747327}

[pkafei]

Perhaps we can use pg-connection-string module to connect a dat datastore to a PostGres database https://www.npmjs.org/package/pg-connection-string

var parse = require('pg-connection-string').parse;
var config = parse('postgres://someuser:somepassword@somehost:381/sometable')