Fix licensing for all sources that will be use for xcol release

[camiplata]

1. Overview of the licenses all sources used by the GBIF backbone
2. Statistics about the licenses ChecklistBank that are beyond cc-0 cc-by
3. Remove unspecified and other licenses from front end ChecklistBank
4. Remove other licenses on the future

related to #18

[camiplata]

Datasets that need to be addressed: names number comes from the last backbone release

• [x] World Register of Marine Species `Unspecified' - 236791 names (internal sources have different licenses)
• [x] TAXREF CC BY NC - 115618 names
• [ ] Fauna Europaea CC BY SA- 45652 names
• [x] The IUCN Red List of Threatened Species CC BY NC - 24652 names (Camila has initiated communication with Andrew Rodriguez from GBIF.)
• [x] GRIN Taxonomy Unspecified - 6335 names (DOI missing on CLB)
• [x] IOC World Bird Unspecified - 2419 names (DOI missing on CLB)
• [x] Official Lists and Indexes of Names in Zoology Unspecified - 2315 names @mdoering probably can help with this one
• [ ] Annotated checklist of endemic species from the Western Balkans CC BY NC - 777 names CLB_
• [x] Catálogo de Plantas y Líquenes de Colombia CC BY NC - 484 names, Authors already agree on changing the license, Camila is coordinating this changes with SiB Colombia.
• [ ] Cockroach Species File CC BY NC - 109 names. In COL23 this dataset was excluded as a GSD probably we cannot use it either for the extended release.
• [x] Mammal Species of the World Unspecified - 73 names
• [ ] True Fruit Flies (Diptera, Tephritidae) Unspecified - 33 names
• [x] Catalogue of the type specimens of Polycestinae (Coleoptera: Buprestidae) from research collections of the Zoological Institute, Russian Academy of Sciences CC BY NC - 19 names
• [ ] Lista de especies de vertebrados registrados en jurisdicción del Departamento del Huila CC BY NC - 18 names
• [x] Catalogue of the type specimens of Bufonidae and Megophryidae (Amphibia: Anura) from research collections of the Zoological Institute, Russian Academy of Sciences CC BY NC
• [x] International Cichorieae Network (ICN): Cichorieae Portal Unspecified - 1084 names

2023 added sources

• [ ] Checklist of Danish Fungi CC-BY-NC
  • [x] Lista de referencia de especies de aves de Colombia - 2020 CC-BY-NC

[mdoering]

GRIN: https://npgsweb.ars-grin.gov/gringlobal/taxon/abouttaxonomy

[camiplata]

Check again the sources with the last Ymal file, and transform this information into a google doc so we can keep track of this sources and start a conversation with the data providers and GBIF

[camiplata]

Google doc including the updated list for the xcol release sources

[camiplata]

Through Andrew from GBIF we got a positive response from the IUCN about changing the license.

"The CC BY NC license applies to the spatial data and to the detailed assessment information. The taxonomy and the Red List Categories can be treated as being under a CC BY license – can one even license taxonomy?"

[camiplata]

IUCN licenses has been changed, the GBIF data products is helping with the datasets with unspecified license but most of then are not being maintained and the contact point is outdated.

[camiplata]

• TAXREF has been contacted by markus
• Thomas is dealing with Checklist of Danish Fungi, but more importantly he has put up the Index fungorum api Crawl with 50.000 + names for fungi
• Mammal Species of the World are joining forces with MDD, bats of the world, as MSWnext so we can take this into account for the normal release next year

[camiplata]

• World Register of Marine Species has been changed to cc-by

[camiplata]

International Cichorieae Network (ICN): Cichorieae Portal has been changed to cc-by

[camiplata]

• Russian Academy of Sciences has agree to change all its checklist to cc-by by its next monthly release in April
• TaxRef has updated its license to CC-BY

[mdoering]

@camiplata @DianRHR Are the missing licenses above still the current state? We should get in touch with Christoph re Fauna Europaea ...

[camiplata]

Yes, they are up to date, nevertheless this Google doc has further details.

[mdoering]

The latest build has some NC sources from publishers:

2024-07-12 19:22:43,502 WARN SectorDao License CC_BY_NC of source 9640 from publisher d8d6c888-92e7-4036-9808-fb3812be61e1 is not compatible with license CC_BY of project 3. Do not create any sector for: A preliminary checklist of some insects (Coleoptera, Odonata, Hymenoptera) from Arabuko-Sokoke Forest, Kenya 2024-07-12 19:22:43,507 WARN SectorDao License CC_BY_NC of source 28488 from publisher d8d6c888-92e7-4036-9808-fb3812be61e1 is not compatible with license CC_BY of project 3. Do not create any sector for: A Checklist of the Butterflies of Arabuko-Sokoke Forest, Kenya 2024-07-12 19:22:43,511 WARN SectorDao License CC_BY_NC of source 28545 from publisher d8d6c888-92e7-4036-9808-fb3812be61e1 is not compatible with license CC_BY of project 3. Do not create any sector for: A checklist of plants of Arabuko-Sokoke Forest, Kenya, 2019 2024-07-12 19:22:43,515 WARN SectorDao License CC_BY_NC of source 28597 from publisher d8d6c888-92e7-4036-9808-fb3812be61e1 is not compatible with license CC_BY of project 3. Do not create any sector for: A checklist of the reptiles and amphibians of Arabuko-Sokoke Forest, Kenya, 2019 2024-07-12 19:22:43,522 WARN SectorDao License CC_BY_NC of source 29647 from publisher d8d6c888-92e7-4036-9808-fb3812be61e1 is not compatible with license CC_BY of project 3. Do not create any sector for: A Checklist of the Birds of Arabuko-Sokoke Forest, Kenya

[camiplata]

Weird that the release from last week worked fine, the publisher related to these datasets was added already two weeks ago.

It looks like if last time the cc by-nc dataset where ignored and the build continued with out apparent issues

[mdoering]

... the same thing happened this time. But maybe we can convince the publisher to use a different license?