search

ImagingDataCommons / ETL

(CORE REPO)
Apache License 2.0
0 stars 1 forks source link

[clinical] table prefix should use idc_webapp_collection_id from original_collections_metadata #19

Closed fedorov closed 2 years ago

fedorov commented 2 years ago

Currently, those prefixes are based on a heuristic applied to the wiki collection IDs.

image

This can be done using join of the table in clinical_notes.json on tcia_wiki_collection_id with bigquery-public-data:idc_current.original_collections_metadata

fedorov commented 2 years ago

also, column collection in per-collection clinical table, should instead be collection_id, and should point to the idc_webapp_collection_id version of collection_id.

G-White-ISB commented 2 years ago

The tables are now named using the idc_webapp_collecion_id in the idc-dev-etl.clinical dataset