Informasjonsforvaltning / fdk-dataset-harvester

Apache License 2.0
0 stars 0 forks source link

Exposing a DCAT-AP compatible endpoint for the European Data Portal #44

Closed lillelars closed 3 years ago

lillelars commented 4 years ago

Hentet fra behov: https://github.com/Informasjonsforvaltning/behov/issues/93

stigbd commented 4 years ago

Vi skal bruke fdk-dataset-harvester til å tilby alle datasett i FDK som et DCAT-AP API. Imidlertid er det ein del avklaringar som vi treng å gjere:

lillelars commented 4 years ago

The following questions was sent to the EDP helpdesk (DESK-5407). Awaiting respons on the following:

Today we expose a collection of all the catalogs in our database. One catalog for each publisher. So we need to clarify which of the following is better for you when harvesting from us:

  1. To harvest a collection of catalogs,
  2. We replace all the catalogs with our own "super-catalog, or
  3. To harvest a catalog of catalogs, i.e. we create a "super-catalog" which contains all the catalogs in our collection. (A combination of the two other approaches.)

Currently we have an endpoint in our demo environment implementing the first approach: https://datasets.demo.fellesdatakatalog.digdir.no/catalogs

Looking forward to hearing from you,

stigbd commented 4 years ago

Answer from EDP's technical team:

this is very interestint. Currently, we have use option 2, the super-catalogue for all our harvested portals. In light of DCAT-AP 2.0 we would be happy to try with you the combination, option 3 catalogue of catalogues. This would go well with the new DCAT-AP 2.0 principle.

However, if we do option 3, this would only be stored as this in the triple store and not reflected on our UI. We don't have the capacity in order to change the UI to a new concept this year. So for the UI, you will see option 2, the super catalogue.

Can we proceed like proposed? Option 3 for harvesting and storing and option 2 for UI?

I agree in the proposed solution. Which means we will have to implement a "catalog of catalogs".

lillelars commented 4 years ago

@stigbd hørt noe mer angående denne ?

shenluna commented 3 years ago

Denne er realisert. Vi blir nå høstet av EU, se https://data.europa.eu/data/datasets?page=1&locale=en&catalog=data-norge-no&query= Lukker dermed saken.