Create manifest index of MSL products

[open768]

To be able to do a random image

[open768]

Will need an admin option

[open768]

Needs to be a batch process. Must remember state to be able to pick up if script is killed.

Already have reading functions, just need to be able to store in a new table

Last 5 sols should always be reprocessed as products are added.

[open768]

Table needs to have in plain text

• mission
• sol
• instr
• product

And those fields form a unique index

[open768]

code written :-) seems to work, just need to run to completion

[open768]

should use the last updated to reindex

    {
      "sol": 125,
      "num_images": 245,
      "catalog_url": "http://mars.jpl.nasa.gov/msl-raw-images/image/images_sol125.json",
      "last_updated": "2014-08-14T01:08:31Z"
    },

[open768]

last updated comment moved to #4 and parked. dont need to do that now

[open768]

runs in production

[open768]

added function to delete contents from indexing - reindexed sols

[open768]

so the json files contains thumbnails which need to be stripped out

[open768]

fixed code in commit d3c68613d3a148993d9865cbd4c60f0bbe7ddced

[open768]

made indexing super fast by only checking for cache expiry in last 10 sols 98dfa23ede99f29733028e061e56c6e253d7fe2e