search

spacetelescope / acsql

The Advanced Camera for Surveys Quicklook Project
BSD 3-Clause "New" or "Revised" License
6 stars 1 forks source link

Develop ingestion script #8

Closed bourque closed 7 years ago

bourque commented 7 years ago

We need to build software to ingest (new) data into the acsql database.

bourque commented 7 years ago

@SaraOgaz For reference, the WFC3/Quicklook ingestion script is here and supporting pyql library is here.

bourque commented 7 years ago

@SaraOgaz FYI I've pushed a build-ingest branch where we can do this work.

bourque commented 7 years ago

The ingestion script should also create a system of quicklook JPEG images. These images will eventually be served on the acsql website. I'll get working on that.

bourque commented 7 years ago

Things left to do (in somewhat order of importance) for the COSC-657 project:

  1. ~Get @bourque a password to ACS database~
  2. ~Perform ingestion of data into ACS database~
  3. ~Build some queries~
  4. ~Test the queries~
  5. Complete report
  6. Complete presentation

Optional

  1. ~Implement insert_or_update~
  2. ~Implement datasets table~
  3. ~Separate out instrument-specific ingestion from ingest.py (i.e. create ingest_production.py script that imports from ingest.py and feeds it rootnames to ingest.~
bourque commented 7 years ago

13 has been merged.