search

INSPIRE-MIF / helpdesk-geoportal

Community discussion for INSPIRE geoportal topics
11 stars 3 forks source link

DE: request for a new harvesting #95

Closed alitka closed 2 years ago

alitka commented 2 years ago

Dear Geoportal Helpdesk,

As mentioned in Roberts Mail from 2020/03/02 we would like to initiate a new push of our metadata records to the EU Geoportal. For this reason, we kindly ask you to start a new harvesting of our catalogue instance and publish them for us in the Geoportal harvesting "sandbox", please.

Thanks in advance and best regards, Anja (on behalf of Coordination Office SDI Germany)

alitka commented 2 years ago

Dear @dartasensi We would appreciate if you could start a new harvesting process, as the results of the last harvesting process are already one month old and are not the best in terms of the number of "Downloadable Data Sets". Thanks in advance and best regards.

jescriu commented 2 years ago

Dear @alitka, We will start the new harvest as soon as possible and will let you know. Best, Jordi

jescriu commented 2 years ago

The new harvest is started. Best, Jordi

alitka commented 2 years ago

Dear @jescriu , I've checked the harvest console several times, but all I can see is that the harvest is still ongoing and was originally scheduled to be completed on March 30, 2022. Can you please look in your logs, if it's in the final post-processing phase or still harvesting? Thanks in advance and best regards.

alitka commented 2 years ago

Dear @jescriu, We're almost waiting for over four weeks of the latest harvest results in the harvest console. We would appreciate if you could provide use the results or start a new harvesting process. Thanks in advance and best regards.

jrc-inspire commented 2 years ago

Dear @alitka

apologies for the late reply. The latest harvest was unable to complete (more than 8k metadata were still waiting to be processed). Plus, the HarvestConsole never recovered and it got stuck with this inaccurate "Running" message.

We are currently investigating which is the culprit of these frequent errors, that other MS reported and unfortunately experienced. We really appreciate your patience with this annoying issue.

About the harvest, we removed the broken, restored the previous harvest and stopped the services. Rebooted the machine, the backend services should be now up and running, in a clean state. Then, we will try to lower some concurrency upper limit as new attempt to improve the overall stability. A new harvest has been added to the HarvestConsole scheduler right now.

KR

jescriu commented 2 years ago

Dear @alitka, Our INSPIRE Geoportal IT Team managed to complete the harvest of your endpoint using the harvesting console. Please, revise the results and let us know if the resulting indicators are as expected - We noticed a decrease of metadata records, while an increased number of downloadable datasets. In case you would be willing to comment on the results, contact us by email. Excuses for my delay in answering your posts. Jordi