search

ACED-IDP / aced_etl_pod

etl worker pod
MIT License
1 stars 1 forks source link

Add option to `delete all` in project #23

Open bwalsh opened 5 months ago

bwalsh commented 5 months ago

Add --delete-content flag to put job.

If selected, issue the following commands:

for table_name in reverse_dependency__order:
   delete from {table_name}  where _props->>'project_id' = '{project_id}' ;

See https://github.com/bmeg/iceberg-schema-tools/blob/1c354e2de6868f3f0d27421a7093e10d6bc81298/config.yaml#L6

matthewpeterkort commented 4 months ago

This seems to have been added here: https://github.com/ACED-IDP/submission/blob/feature/empty-project/aced_submission/meta_graph_load.py#L361

Just not in reverse order.