search

iobis / obis-issues

Repository for all OBIS related issues and feature requests
7 stars 3 forks source link

suspicious DwC-A URL https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2002 found https://api.obis.org/v3/dataset referenced dataset [b856037f-bbdf-45da-9b43-c7ac1a6c74d3] #213

Closed jhpoelen closed 5 months ago

jhpoelen commented 5 months ago

on 2024-04-01T09:24:18.303Z 

<https://api.obis.org/v3/dataset> <http://purl.org/pav/hasVersion> <hash://sha256/863c5ea40ac047c35f9ad2fa5931992234b228a431bd6f0c9b39e13deefb94c6> <urn:uuid:6b5fbcb4-3045-48f2-8a90-8dfe9b27fa30> .

referenced

{
  "id": "b856037f-bbdf-45da-9b43-c7ac1a6c74d3",
  "url": "https://ipt-obis.gbif.us/resource?r=crempdrytortugas2002",
  "archive": "https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2002",
  "published": "2020-09-21T22:03:12.000Z",
  "created": "2020-09-22T00:04:03.319Z",
  "updated": "2023-05-18T12:01:26.853Z",
  "core": "event",
...
}

but https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2002 returned a 200 OK code and a html page instead , not a 404 (not found) or a DwC-A.

However, in https://ipt-obis.gbif.us/rss.do the following is mentioned - 

<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2002> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:68fee14c-2305-4d59-855d-f631ca2f48dc> .

which points to an html page (see https://linker.bio/hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc and attached.

unexpected.html.txt

<item>
<title>Coral Reef Evaluation and Monitoring Project Dry Tortugas 2002 - Version 1.0</title>
<link>https://ipt-obis.gbif.us/resource?r=crempdrytortugas2002</link>
<!--  shows what changed in this version, or shows the resource description if change summary was empty  -->
<description>[The purpose of the Coral Reef Evaluation and Monitoring Project (CREMP) is to monitor the status and trends of selected reefs in the Florida Keys National Marine Sanctuary(FKNMS). CREMP assessments have been conducted annually at fixed sites since 1996 and data collected provides information on the temporal changes in benthic cover and diversity of stony corals and associated marine flora and fauna. The core field methods continue to be underwater videography and timed coral species inventories. Findings presented in this report include data from 109 stations at 37 sites sampled from 1996 through 2008 in the Florida Keys and 1999 through 2008 in the Dry Tortugas. The report describes the annual differences (between 2007 and 2008) in the percent cover of major benthic taxa (stony corals, octocorals, sponges, and macroalgae), mean coral species richness and the incidence of stony coral conditions. Additionally, it examines the long-term trends of the major benthic taxa, five coral complex, Montastraea cavernosa, Colpophyllia natans, Siderastrea siderea, and Porites astreoides) and the clionaid sponge, Cliona delitrix. It is one of the longest running coral reef monitoring projects in south Florida and has been extremely important in documenting the temporal changes that have occurred in recent years.]</description>
<author>albenson@usgs.gov (Abigail Benson)</author>
<ipt:eml>https://ipt-obis.gbif.us/eml.do?r=crempdrytortugas2002</ipt:eml>
<ipt:dwca>https://ipt-obis.gbif.us/archive.do?r=crempdrytortugas2002</ipt:dwca>
<pubDate>Mon, 21 Sep 2020 22:03:12 +0000</pubDate>
<guid isPermaLink="false">5b5af180-599c-44e7-bd3b-6f5d53bbb55d/v1.0</guid>
</item>

Can you please confirm that the referenced URL is not working?

Also, please let me know if I need to use a different method to get a list of all datasets registered with OBIS.

Thanks for all your hard work.

jhpoelen commented 5 months ago

possibly related to https://github.com/gbif/ipt/issues/1427 .

jhpoelen commented 5 months ago

There's 100 references to the same html page in response to different DwC-A, suggesting that the issue is related to some kind of configuration/migration error.

<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ncrmp_nspc_fish_pacific> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:06a4e742-0e25-4acd-b62e-63d44accb3ad> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=nefsc_bottom_trawl_surveys_coml> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:5d5872dc-1dbf-4567-beff-cc1f4642038e> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=sefsc_logbook> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:23edea2b-0093-4337-be6b-ba066d23c3af> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=afsc_northpacificgroundfishobserver> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:ebd6744a-03d0-4bcc-a1e2-b7f164e3c99d> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_pwrc_seabirdscompendium> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:e4c5538f-4303-4473-b4bd-ee09e5063370> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ncrmp_blt_fish_pacific> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:3ce7957f-5571-4384-abc2-a7a2b8303c50> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=rcca_transects> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:e7fe5e1b-4a69-4d03-93c3-ae4f3ac589b7> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=noaa_nbi> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:ebc8982a-4edc-4516-945e-04f227cbb00a> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usvi-tcrmp-database> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:ccbf2b9c-b84d-4446-a75b-e8959d41352d> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=fwc_marine_inverts_collection> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:3bb7546d-89e6-4675-a04d-661f0a5b5356> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=me_dmr_trawl> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:267d4e87-80e2-4ea9-afa6-38f22924b372> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=prcrmp_database> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:0787d4da-94e0-43e1-96df-af8c94d211ef> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=18s_monterey_bay_time_series_edna> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:7b8472c6-0d77-4999-a6ad-e0c3d5e40886> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_southflorida_fian_crustaceans> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:2d07c2ec-a25d-4d39-9024-ac4f99c4a4d6> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=noaa_micronesia_reef_monitoring_fish> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:52e427b2-c83c-4a4a-b896-5ee3ab41a034> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=habsos> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:ec528350-b65e-4b9c-8974-c7360237d625> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_southflorida_fian_fish> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:7d5e0f5c-03c2-4ca5-849d-8a32f6a180ab> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=vims_neamap> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:6dea754c-c8aa-41a4-b8aa-b7d1875665d4> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=tpwd_harc_texaslowerlagunamadre_bagseine_20150130> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:f8c4a7b8-e246-4bd5-ae9a-aea5801571fc> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=pifsc_spc_fish_pacific> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:06cc4aef-174c-43f1-8b9c-fbee3b4c26f9> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ogl_msc_northeasternuniversity> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:3f91f0a4-191e-4bb7-9929-69b5d20712de> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=tpwd_harc_texasupperlagunamadre_bagseine_20150202> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:9602e8b3-5724-4e25-8691-6572dff296be> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=vims_chesmmap> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:907fcee8-abf8-4700-98c0-8186d8e12847> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=tpwd_harc_texaslowerlagunamadre_gillnet_20150130> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:80e6b1eb-edbd-45a3-9ccb-604b37b8ab92> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=tpwd_harc_texaslowerlagunamadre_trawl_20150130> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:be6405ff-db15-4f3e-91b6-41831c02fe30> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_waterquality_sanfranciscobay_phytoplankton_1992_2014> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:ff6cf1af-a9bd-4535-b345-8ba47b75406f> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=tpwd_harc_upperlagunamadre_trawl_20150202> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:2a7750f1-093f-42bb-ab7f-a7bd14fcb8d6> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=calhabmap> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:02c2ae08-2a1d-4225-bf67-ea27f154d335> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_southflorida_fian_braunblanquet> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:4c66603f-f980-468a-b223-f4fbb70eea7a> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=puerto-rico-coral-reef-fish-assemblages-2018-2019> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:93dec53c-e396-4357-8081-bcdf81d841c6> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=fhap-sf> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:b615eb2d-1e1e-4977-ba08-61135df0a820> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_fish_hauls_2015> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:049805a5-fe93-4aa6-88cd-f5d438af067f> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=noaa_micronesia_reef_monitoring_benthic> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:09bf73f8-0f72-4fb0-8c65-509cabd9642d> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_nas_nonfish> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:515a8420-73ad-49a3-9059-18d9b3a114a1> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_southflorida_fian_harvest_20150129> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:b97f4212-8d19-4034-ba04-945b66df973d> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_nas> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:c598d7ac-facd-4693-b1e2-7827aae7df17> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_benthicepifauna_2015> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:716ee44f-d612-4435-90bb-fb87ff520c0b> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_zooplankton_2017> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:8d0ca669-c1ef-4151-8341-807a006cfdce> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=cariaco_zooplankton_2001to2017> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:a4e4bad5-f938-48b1-a236-e506d42c4156> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=sbclter_dwc_kelpforest_reeffishabundance> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:a59f4ca2-56a4-4d3f-9a80-9e6f9a2da1a9> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_seabirds_2015> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:bffc5e76-1c7e-4ca9-98a5-edb62f472115> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_zooplankton_2015> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:9627531f-eba9-4c16-ac64-1c01227d08d4> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_stcroix_marinefishes_20150129> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:478100fa-3759-46e2-9eaa-a2cb7b3d47b4> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=noaa_hydrosmac_fl_meiofauna> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:9f5811d8-992a-49fb-b327-2e851c471e6c> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_epifauna_2017> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:68c49fc2-f646-4999-99fb-e0754c56b2af> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2016> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:d9bb00a3-8370-4202-81e6-5d087c425923> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2015> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:f51acae7-430e-470e-be30-5cd3cc34e732> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2017> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:b263908c-9147-49f3-8164-8da9c39867c2> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2018> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:773ad53b-dffa-464e-bc13-222c6b99d614> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2010> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:391d16d5-8155-4bcc-9d25-5a004486199e> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-1997> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:952f6a8c-32d9-4cbe-852d-bff2703b240b> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ccom-ex1314nwatcanseam-speciesoccurrence> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:f86e2b11-e4e3-4669-b758-7867fc3c871f> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_seabirds_2017> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:b9815d03-1f71-4913-bc1b-1ab2f9cc700d> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-1996> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:fbaf247c-b262-40f2-af9c-8d0c3dab65d2> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=smccinverts> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:93800eb8-f87b-4a7a-86cc-bfacdfddbd64> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-1998> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:79a4457a-3c99-4392-94c9-cb056c7da196> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=mbenthos_penobscotbay> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:48de0340-b864-4c36-b64a-848d78ccfbe1> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2000> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:4e4c9325-778b-4c3a-8ba7-6167b426705a> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-1999> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:5214ef13-1355-4309-8aef-e2c7ceb1e974> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2009> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:a2207fd9-ae81-4f85-bdf9-73dbf543792c> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2001> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:860d3c12-50a1-426a-8b95-9167c9828795> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=marinegeo_reeflifesurvey> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:fe4fa058-e9ae-4dc6-a52a-29613708fbcf> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2002> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:4f717206-8ee5-485b-9566-2c67d0d54d62> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2008> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:d7127b0e-f3d4-4941-b4c7-3a5c33b75406> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=coralreefevaluationandmonitoringproject-2007> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:6fe63be5-4e3b-4631-91ba-8af88ff05fa9> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=boem_alaska_2008> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:b2cff3d5-a884-447d-bed9-d5ec94da1bb0> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=noaa_micronesia_reef_monitoring_invert> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:96b5fdbc-0750-4e56-94e6-d58faece5e38> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=whoi_epr_deepseavents_speciescounts> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:30fbc3a4-7039-466b-9be1-16ba00f66aab> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=stable_isotopes_in_gom_seep_fauna> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:e4be93a5-1622-4c97-9e51-c69abd3a8bf4> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2010> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:b7f1a313-0f0e-4d7f-8d57-8c57d2ee9311> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_pinnipeds_2015> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:de13d2a2-00cd-49a9-a1d4-b95e9096f7ec> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2011> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:89c83027-770b-4852-a623-33309f3c16ae> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2015> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:1ad97c55-7dda-4d76-b554-ac5b66b37b60> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2012> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:a5dd77ba-fee3-48c6-b12a-546c4e79ee5c> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2017> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:730f52e7-174e-43c9-9485-373378b23947> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2014> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:c47d9ece-baa5-421e-979c-a0f39d805f35> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2016> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:75c7fec1-0af5-40ee-ba1a-bdbf31529f01> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2018> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:3c292846-4eb8-446c-88d3-497e42f5937e> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2013> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:a1a9bc31-8ce3-4e1c-9a6b-d48de4985dd1> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=pms-icbg_collection> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:8d114582-0b7e-4fa2-abbd-8a3414e7847e> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_asc_polarbearmaternaldens_20150129> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:50164244-0e36-4afb-80a3-f4f9d4c9b373> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2009> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:4fefa531-631a-4dfe-9533-973279426043> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=gom_wbts_mesozooplankton> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:54eef6d1-a2fa-42cf-9f5a-1287a2f437c2> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=usgs_nas_tigershrimp> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:2a3f70b9-056d-4036-8f71-7a339d52a0b8> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_mammals_2017> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:ffcaaf36-3a11-4313-b642-6ec52e76fc47> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2007> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:68d003e9-a50c-4527-95ee-56016b8207e5> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2004> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:46c95e8a-945c-4108-9710-8e89f6e16eaf> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2005> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:431df94a-fa5a-43ea-93a8-7faa83a44112> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2008> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:d823b37c-0e5b-43b7-befd-3e69424f4fb1> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2006> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:c069e628-c1bc-4600-a066-3d022b25ba93> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=serc_invasions_pribilofs> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:a8057aa9-1505-4773-806d-d1b2a03674e8> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas1999> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:0b9dba37-1499-4fa4-8728-a45fdf86e6f7> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2001> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:195bfc0a-47e6-4f72-a037-dd0591143653> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2003> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:f48fc376-2f51-4915-92da-9989d0fadf86> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2000> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:7c04f3a4-5318-4cb5-a4da-8d20050feb4d> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=crempdrytortugas2002> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:68fee14c-2305-4d59-855d-f631ca2f48dc> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=ambon_cetaceans_2015> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:0246f24d-6b88-4d99-b2e0-5ac34bc68b39> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=whoi_deep_sea_larvae_microbiome> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:12448865-2d77-436b-a7fc-89330de616d8> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=snail_bcodmo_whoi> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:def5da61-3de3-409d-bf10-d3840dda31f4> .
<https://www1.usgs.gov/obis-usa/ipt/archive.do?r=sea_cruise_c247_2013> <http://purl.org/pav/hasVersion> <hash://sha256/9090d220edc93472cc952cecf4fae7fd1629d9976f957370c5b67fc89557dafc> <urn:uuid:4405a6b0-5cf7-44c3-97b5-7f3857c4588e> .
ymgan commented 5 months ago

@sformel-usgs could it be that the OBIS USA IPT changed its domain (to hosted IPT https://ipt-obis.gbif.us/) and the alternative identifiers automatically generated by IPT at the time of the dataset's first publication were not automatically updated?

By alternative identifiers, I mean the metadata in IPT. A screenshot of our example here Screenshot 2024-06-21 at 07 52 57

pieterprovoost commented 5 months ago

@jhpoelen Looks like a migration issue on our side, will look into it.

pieterprovoost commented 5 months ago

@jhpoelen Thanks for reporting. The issue on our side has been solved, but there are some remaining instances of URIs that do not resolve properly in the OBIS USA EML documents. @sformel-usgs

jhpoelen commented 5 months ago

@pieterprovoost @ymgan thanks for your prompt reply.

I just confirmed that a "2024-06-21T15:53:20.942Z" snapshot version of https://api.obis.org/v3/dataset produced digital content with signature hash://sha256/d9b687719057923de47058934d0f5f77faef71432327cf5fea0ab2293b886620 (see attached datasets@d9b687719057923de47058934d0f5f77faef71432327cf5fea0ab2293b886620.json.gz )

<https://api.obis.org/v3/dataset> <http://purl.org/pav/hasVersion> <hash://sha256/d9b687719057923de47058934d0f5f77faef71432327cf5fea0ab2293b886620> <urn:uuid:fbe7cf1e-7db5-4e3a-9cc4-315cc5273c4e> .
curl "https://linker.bio/hash://sha256/d9b687719057923de47058934d0f5f77faef71432327cf5fea0ab2293b886620"\
 | jq -c '.results[]'\
 | grep "crempdrytortugas2002"\
 | jq .\
 | head

producing:

{
  "id": "b856037f-bbdf-45da-9b43-c7ac1a6c74d3",
  "url": "https://ipt-obis.gbif.us/resource?r=crempdrytortugas2002",
  "archive": "https://ipt-obis.gbif.us/archive.do?r=crempdrytortugas2002",
  "published": "2020-09-21T22:03:12.000Z",
  "created": "2020-09-22T00:04:03.319Z",
  "updated": "2023-05-18T12:01:26.853Z",
  "core": "event",
  "extensions": [
    "measurementorfact",
   ...
}

And, I was able to confirm that the referenced DwC-A location was able to produce at least one DwC record via

preston track "https://ipt-obis.gbif.us/archive.do?r=crempdrytortugas2002"\
 | preston dwc-stream\
 | head -1\
 | jq .

being

{
  "http://www.w3.org/ns/prov#wasDerivedFrom": "line:zip:hash://sha256/a7dc009d28b1a0c6dcdce0bf0abc8547a345a89309333ef398fea6acfcbf6c29!/event.txt!/L2",
  "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": "http://rs.tdwg.org/dwc/terms/Event",
  "http://rs.tdwg.org/dwc/text/id": "2002_DT_1P1_41_411",
  "http://rs.tdwg.org/dwc/terms/minimumDepthInMeters": "29.0",
  "http://rs.tdwg.org/dwc/terms/sampleSizeUnit": "meters",
  "http://rs.tdwg.org/dwc/terms/eventDate": "2002",
  "http://rs.tdwg.org/dwc/terms/maximumDepthInMeters": "29.0",
  "http://rs.tdwg.org/dwc/terms/waterBody": "Gulf of Mexico",
  "http://rs.tdwg.org/dwc/terms/country": "United States",
  "http://purl.org/dc/terms/type": "Event",
  "http://rs.tdwg.org/dwc/terms/stateProvince": "Florida",
  "http://rs.tdwg.org/dwc/terms/decimalLatitude": "24.6414",
  "http://purl.org/dc/terms/license": "http://creativecommons.org/publicdomain/zero/1.0/legalcode",
  "http://rs.tdwg.org/dwc/terms/habitat": "Patch Reef",
  "http://rs.tdwg.org/dwc/terms/locality": "White Shoal,Dry_Tortugas",
  "http://rs.tdwg.org/dwc/terms/datasetName": "Coral Reef Evaluation and Monitoring Project Dry Tortugas 2002",
  "http://rs.tdwg.org/dwc/terms/eventID": "2002_DT_1P1_41_411",
  "http://rs.tdwg.org/dwc/terms/samplingProtocol": "CREMP sites consist of two to four monitoring stations delimited by permanent markers. Stations are approximately 2m x 22m and are generally perpendicular to the shoreline. Three video transects (benthic survey), a station species inventory (SSI), and a clioniad sponge survey are conducted annually at each station.",
  "http://rs.tdwg.org/dwc/terms/sampleSizeValue": "23.0",
  "http://purl.org/dc/terms/modified": "2020-05-26 08:27:50",
  "http://purl.org/dc/terms/language": "en",
  "http://rs.tdwg.org/dwc/terms/decimalLongitude": "-82.8962",
  "http://rs.tdwg.org/dwc/terms/datasetID": "CREMPDryTortugas2002",
  "http://rs.tdwg.org/dwc/terms/samplingEffort": "Two observers conducted simultaneous 15-20 minute inventories within the roughly 22 x 2 m video stations",
  "http://rs.tdwg.org/dwc/terms/geodeticDatum": "EPSG:4326 WGS84"
}

This suggests that the DwC-A location produces a DwC-A as expected.

Yay!

sformel-usgs commented 4 months ago

I know this is closed, but I wanted to say thank to @jhpoelen for catching it. I was on vacation when this was pulled, so I'm only just getting to it now. @ymgan and @pieterprovoost are correct that the domain is incorrect in the alternate identifier. I'm going to use this as another opportunity to investigate programmatic update to the IPT, but I should have the updates made soon.