Decals catalog limited to key columns

zooniverse / decals

Morphological classifications for the Galaxy Zoo-DECaLS collaboration

MIT License

7 stars 3 forks source link

Decals catalog limited to key columns #26

Closed mwalmsley closed 6 years ago

mwalmsley commented 6 years ago

Only the following columns are saved by download_decals:

include_names = [

'iauname',
'nsa_id',
'ra',
'dec',
'petrotheta',
'petroth50',
'petroth90',
'z'
]

This is to limit the resource cost of the full many-column table.

Later components (e.g. the uploader) will need to add other columns (e.g. a/b ratio) back in as needed. Perhaps the long term solution is a mongodb database of the full catalog, which is accessed by each component in setup.

mwalmsley commented 6 years ago

This has been resolved by caching and merging the full NSA catalog at the start of the upload process