cp4cds / cmip6_handle_checks

Checks run on CMIP6 handle registry records
BSD 2-Clause "Simplified" License
0 stars 0 forks source link

CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.tas.gn .. contains esm-hist data #3

Open martinjuckes opened 4 years ago

martinjuckes commented 4 years ago

There is an error in the handle record:

http://hdl.handle.net/21.14100/4530c050-b2d6-3c31-952c-7785746783ed CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.tas.gn

The file level records contain data from both historical and esm-hist experiments. e.g. https://handle-esgf.dkrz.de/lp/21.14100/97fe0a7c-ac24-4bfb-b0c9-bc2279a6b7a2

Also:

hdl:21.14100/1822b3d4-af3b-3ae9-85b3-8744bdfd7d00 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.evspsbl.gn hdl:21.14100/a1dfa4fb-c7fd-398e-a999-66c2509395de | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.va.gn http://hdl.handle.net/21.14100/fbe14160-58c6-3c2a-9d72-c56118ba3e64 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rlus.gn hdl:21.14100/4006c7cc-de64-3c41-8900-b10034f13e85 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rsdt.gn hdl:21.14100/0865e35f-0829-342f-8839-a84da8835bc4 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.tauu.gn hdl:21.14100/7a62ff9a-d4de-3f4f-a371-a5acee5d56de | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.ta.gn hdl:21.14100/f8756b13-4558-3800-93b5-fede2b52d8b7 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.psl.gn hdl:21.14100/efa898e9-0e1d-31e0-b5d9-53b7130266b3 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.huss.gn hdl:21.14100/11a36a7b-9cfa-31be-a107-257373c956cd | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rlut.gn hdl:21.14100/e4656ba6-bbcf-34be-80cb-8e0ba1c77880 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.zg.gn hdl:21.14100/9a40a184-7673-38cb-8109-623ec3e7c7b3 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.pr.gn hdl:21.14100/c7fabb1f-e775-3955-99d2-8262cc3bf703 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.tasmax.gn hdl:21.14100/cb8243c7-967b-3480-bbb8-0a2798ca200d | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.hus.gn hdl:21.14100/5e3709d6-0eec-3b66-8f04-b44ee02018e0 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.ts.gn hdl:21.14100/02cf9c92-e9eb-3b11-8966-54601b20da46 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.hfls.gn hdl:21.14100/e5edb100-2d21-3ac7-bb4c-39af50b68ce9 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rsut.gn hdl:21.14100/85737dc7-ce9a-3659-a5cc-5c3999bedb88 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rlds.gn hdl:21.14100/338d8225-05f6-3bd9-9a9d-18ef17a4d024 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.tauv.gn hdl:21.14100/b2be999e-b3e9-32c2-8f22-a8ee13d154bc | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rtmt.gn hdl:21.14100/302f5bbd-33bd-3f81-9def-1c76c80d590c | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.ua.gn hdl:21.14100/6e3aa3ef-8048-3304-b4ac-bc33a2a30c6c | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rlutcs.gn hdl:21.14100/d947af7f-e330-3fb1-ba49-bd6c93f81c89 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.hfss.gn hdl:21.14100/69edfe3f-bca3-3699-9a86-9d67f016fd10 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rsds.gn hdl:21.14100/4be01701-9c2e-3fde-af1b-208487ba2cad | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.hurs.gn hdl:21.14100/8c7eb740-b69b-3aae-821e-b188cd475ebe | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.clt.gn hdl:21.14100/2c3b4497-afd9-3ad0-b4eb-3c660b366b53 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rsus.gn hdl:21.14100/06b9d6b7-caa1-3583-aa40-ab6459276a1a | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.rsutcs.gn hdl:21.14100/84aad8f6-88fd-3a3a-89c3-75e186c7c7fa | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.prw.gn hdl:21.14100/ec1adbce-65fa-3d6c-956f-a45124533346 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.ps.gn hdl:21.14100/70614fe0-569f-3d4c-a930-4a08333179d0 | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.tasmin.gn hdl:21.14100/7ef58a25-58dc-33a6-9cb3-00a3c1c2687e | CMIP6.CMIP.NASA-GISS.GISS-E2-1-G-CC.historical.r1i1p1f1.Amon.prsn.gn

Contact: Kenneth Lo (cdkkl@giss.nasa.gov) (contacted via email).

martinjuckes commented 4 years ago

These datasets are no longer available on ESGF the GISS-E2-1-G-CC model has run the esm-hist experiment, but not the historical experiment. Something must have gone wrong with the retraction.

martinjuckes commented 4 years ago

From NASA-GISS:

When migrating all published datasets from our old data node (esgf.nccs.nasa.gov) to our new datanode (dpesgf03.nccs.nasa.gov) we used the same published catalogs to have them published to LLNL. This process was more efficient on our side, also had less impact on users than to have them all unpublish and republish (the process we only use to deal with data errors). What happened to this case ? Because this was published on an old node, and when Ken asked me to have them removed, I did it on the index using these published catalogs. The handle record process was embedded into CMIP6 publication (a very poorly designed process to force data publishers to go through).

I did the following today

esgunpublish --project cmip6 ../CMIP6.dpesgf01/CMIP/NASA-GISS/GISS-E2-1-G-CC/historical/r1i1p1f1/ --database-delete --retract

Hopefully it will go away.

martinjuckes commented 4 years ago

Check with Tobias ....