search

cessda / cessda.cdc.versions

Issue track and wiki for the CESSDA Data Catalogue
https://datacatalogue.cessda.eu/
Apache License 2.0
0 stars 0 forks source link

ADP Kuha2 Endpoint #201

Closed cessda-bitbucket-importer closed 3 years ago

cessda-bitbucket-importer commented 4 years ago

Original report on BitBucket by John Shepherdson (GitHub: john-shepherdson).

From: Žibert, Gregor
Date: Wed, 15 Jul 2020 at 11:47
Subject: Re: [CESSDA] Data Catalogue - ADP Study records
To: John Shepherdson
Cc: Shepherdson, John W, Štebe, Janez, Dolinar, Maja, Ana Pavlišič, Vipavc Brvar Irena

Dear John,

ADP has managed to set up a Kuha2 OAI-PMH endpoint on its web page. Could you try harvesting XMLs from there?

Endpoint is located at: https://www.adp.fdv.uni-lj.si/v0/oai

Let us know if there are any issues.

Best,

Gregor

cessda-bitbucket-importer commented 4 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

https://www.adp.fdv.uni-lj.si/v0/oai?verb=ListIdentifiers&metadataPrefix=oai_ddi25

cessda-bitbucket-importer commented 4 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

Needs changes to Indexer and both endpoints, as ADP previously used NESSTAR

cessda-bitbucket-importer commented 4 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

Gregor,

Will do. I just checked the config with the OVAL Base Validator (http://oval.base-search.net/) and it is in pretty good shape. 

Could you have a look at the recommendations please?

John

‌

cessda-bitbucket-importer commented 4 years ago

Original comment by Matthew Morris (GitHub: matthew-morris-cessda).

@john-shepherdson The commit d8c00411 has been reverted because of test failures.

cessda-bitbucket-importer commented 4 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

Thu 13/08/2020 11:44

To:

Cc:

Dear John,

have you managed to successfully harvest ADP metadata records?

We have managed to fix the dc:language recommendation from the OVAL Base Validator results below.

Regards,

Gregor

cessda-bitbucket-importer commented 4 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

Thu 13/08/2020 11:53

To:

Cc:

‌

Dear Gregor,

We have harvested 693 ADP records in English

https://datacatalogue-staging.cessda.eu/?publisher.publisher[0]=Slovenian%20Social%20Science%20Data%20Archives%20%28ADP%29

and 65 in Slovenian (most/all of which are also available in English)

https://datacatalogue-staging.cessda.eu/?publisher.publisher[0]=Slovenian%20Social%20Science%20Data%20Archives%20%28ADP%29

Do those numbers look correct?

Regards,

‌

John

cessda-bitbucket-importer commented 4 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

‌

cessda-bitbucket-importer commented 4 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

No further action needed.

cessda-bitbucket-importer commented 3 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

ADP report that some of their recently updated studies are not visible in staging

cessda-bitbucket-importer commented 3 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

@matthew-morris-cessda add list of ADP records that have been excluded by harvester in last 24 hours

cessda-bitbucket-importer commented 3 years ago

Original comment by Matthew Morris (GitHub: matthew-morris-cessda).

2021-02-03 13:29:58.563 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [WELSOC15]
2021-02-03 13:29:58.565 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [SJM201]
2021-02-03 13:29:58.565 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [NADLOS18]
2021-02-03 13:29:58.566 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [VZGL03]
2021-02-03 13:29:58.567 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [ZDRAV97]
2021-02-03 13:29:58.567 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [Zalog]
2021-02-03 13:29:58.568 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9906]
2021-02-03 13:29:58.569 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [MB75]
2021-02-03 13:29:58.569 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9712]
2021-02-03 13:29:58.569 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9811]
2021-02-03 13:29:58.569 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9510]
2021-02-03 13:29:58.569 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [MLAMIR]
2021-02-03 13:29:58.570 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [KORUP01]
2021-02-03 13:29:58.570 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RPIM98]
2021-02-03 13:29:58.570 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9802]
2021-02-03 13:29:58.570 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9705]
2021-02-03 13:29:58.571 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9807]
2021-02-03 13:29:58.571 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISGOS00]
2021-02-03 13:29:58.571 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9501]
2021-02-03 13:29:58.572 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISWWW98]
2021-02-03 13:29:58.572 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9804]
2021-02-03 13:29:58.572 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9909]
2021-02-03 13:29:58.572 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [WVS95]
2021-02-03 13:29:58.572 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [WVS_92]
2021-02-03 13:29:58.572 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9710]
2021-02-03 13:29:58.573 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISPOD96]
2021-02-03 13:29:58.573 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [SPORIN71]
2021-02-03 13:29:58.573 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [ELITE96]
2021-02-03 13:29:58.573 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PD80]
2021-02-03 13:29:58.573 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9707]
2021-02-03 13:29:58.574 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9509]
2021-02-03 13:29:58.574 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9901]
2021-02-03 13:29:58.574 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DER82]
2021-02-03 13:29:58.575 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RTVSPR76]
2021-02-03 13:29:58.575 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [BGP97]
2021-02-03 13:29:58.575 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9812]
2021-02-03 13:29:58.575 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [BGP93]
2021-02-03 13:29:58.575 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [EJDVAR93]
2021-02-03 13:29:58.575 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [BGP01]
2021-02-03 13:29:58.575 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9605]
2021-02-03 13:29:58.575 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [BGP99]
2021-02-03 13:29:58.576 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [UST63]
2021-02-03 13:29:58.576 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PDDVAR92]
2021-02-03 13:29:58.576 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [MIGPOM81]
2021-02-03 13:29:58.576 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [ZKS67]
2021-02-03 13:29:58.577 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [INTEG70]
2021-02-03 13:29:58.577 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9602]
2021-02-03 13:29:58.577 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9601]
2021-02-03 13:29:58.578 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9801]
2021-02-03 13:29:58.578 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9703]
2021-02-03 13:29:58.578 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RMM_92]
2021-02-03 13:29:58.578 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [TD99]
2021-02-03 13:29:58.578 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [BGP94]
2021-02-03 13:29:58.578 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [CENI95SL]
2021-02-03 13:29:58.578 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [TVVSEB74]
2021-02-03 13:29:58.578 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [BGP95]
2021-02-03 13:29:58.579 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9704]
2021-02-03 13:29:58.579 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9502]
2021-02-03 13:29:58.579 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9702]
2021-02-03 13:29:58.579 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DEV73]
2021-02-03 13:29:58.580 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9503]
2021-02-03 13:29:58.580 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [TP83]
2021-02-03 13:29:58.580 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [FFS97]
2021-02-03 13:29:58.580 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISWWW96]
2021-02-03 13:29:58.580 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9806]
2021-02-03 13:29:58.581 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DR75]
2021-02-03 13:29:58.581 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISWWW97]
2021-02-03 13:29:58.581 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9606]
2021-02-03 13:29:58.582 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9610]
2021-02-03 13:29:58.582 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9504]
2021-02-03 13:29:58.583 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [TP73]
2021-02-03 13:29:58.583 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9609]
2021-02-03 13:29:58.584 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9506]
2021-02-03 13:29:58.584 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [EKOODL]
2021-02-03 13:29:58.585 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [NATO97]
2021-02-03 13:29:58.585 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [IZARVO67]
2021-02-03 13:29:58.586 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DET2000]
2021-02-03 13:29:58.586 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [BGP96]
2021-02-03 13:29:58.586 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [CVSV]
2021-02-03 13:29:58.587 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9911]
2021-02-03 13:29:58.587 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [ZASEBN99]
2021-02-03 13:29:58.587 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9701]
2021-02-03 13:29:58.587 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9912]
2021-02-03 13:29:58.588 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISPOD99]
2021-02-03 13:29:58.588 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [POSAV92]
2021-02-03 13:29:58.588 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PSIMV99]
2021-02-03 13:29:58.588 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9805]
2021-02-03 13:29:58.588 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [EU97]
2021-02-03 13:29:58.588 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [BGP92]
2021-02-03 13:29:58.589 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9607]
2021-02-03 13:29:58.589 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [OBCINE]
2021-02-03 13:29:58.589 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DELEG85]
2021-02-03 13:29:58.589 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [FNS73]
2021-02-03 13:29:58.589 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DPS70]
2021-02-03 13:29:58.590 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9711]
2021-02-03 13:29:58.590 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [POSDZ92]
2021-02-03 13:29:58.591 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISGOS99]
2021-02-03 13:29:58.592 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9511]
2021-02-03 13:29:58.592 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISWWW00]
2021-02-03 13:29:58.592 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [LLT96]
2021-02-03 13:29:58.592 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PIMJP97]
2021-02-03 13:29:58.592 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9903]
2021-02-03 13:29:58.592 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [NEK]
2021-02-03 13:29:58.592 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [ZKSRB76]
2021-02-03 13:29:58.592 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9507]
2021-02-03 13:29:58.593 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9910]
2021-02-03 13:29:58.593 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [USTN72]
2021-02-03 13:29:58.594 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DELEG77]
2021-02-03 13:29:58.594 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [SIND94]
2021-02-03 13:29:58.594 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DELEG81]
2021-02-03 13:29:58.595 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9612]
2021-02-03 13:29:58.595 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [MIM99]
2021-02-03 13:29:58.595 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DELEG83]
2021-02-03 13:29:58.595 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9505]
2021-02-03 13:29:58.595 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISPOD00]
2021-02-03 13:29:58.595 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RPNM99]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9611]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9803]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [TANJUG]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISWWW99]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISGOS96]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9810]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9709]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9905]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9904]
2021-02-03 13:29:58.596 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [SJM992]
2021-02-03 13:29:58.597 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [OBCORG67]
2021-02-03 13:29:58.597 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9706]
2021-02-03 13:29:58.597 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9512]
2021-02-03 13:29:58.597 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PV_94]
2021-02-03 13:29:58.597 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISGOS98]
2021-02-03 13:29:58.597 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [ZKSLO78]
2021-02-03 13:29:58.597 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [SUIATT96]
2021-02-03 13:29:58.597 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [DELEG84]
2021-02-03 13:29:58.597 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [SLODS]
2021-02-03 13:29:58.598 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9604]
2021-02-03 13:29:58.598 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISPOD97]
2021-02-03 13:29:58.598 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9603]
2021-02-03 13:29:58.598 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [MB80]
2021-02-03 13:29:58.598 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [RISGOS97]
2021-02-03 13:29:58.598 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9902]
2021-02-03 13:29:58.598 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [JJM82]
2021-02-03 13:29:58.598 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [WVSEVS]
2021-02-03 13:29:58.599 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PBSI9809]
2021-02-03 13:29:58.599 DEBUG              (LanguageExtractor.java:77) - [ADP] No valid languages for study [PROCHR05]

‌

cessda-bitbucket-importer commented 3 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

Thanks, I’ll let Gregor know.

cessda-bitbucket-importer commented 3 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

Need to use ISO 2 letter lang code.

cessda-bitbucket-importer commented 3 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

Duplicate of #274.