Open vicehovskis opened 8 months ago
hi @vicehovskis , I did a quick test harvesting one of the CSW servers that you provided and it worked fine on CKAN 2.10.1 so let's go step by step.
The first error you mention (500 Internal error), this is an error returned by the remote CSW server, not CKAN. The harvester is failing because the remote server returned an error. There's not much we can do here, maybe if you share the URL we can identify some problem with it.
Regarding the second stack trace, I see two potential problems. First I'd try disabling the harvesting logging, as it seems like it's trying to add some records to the harvest_log
table and failing. Set ckan.harvest.log_scope = -1
or just remove all the ckan.harvest.log_*
options.
Second this error Harvest source not found for dataset 8bbf3c49-0fac-4575-a0bb-d3e52b6996f9
suggest that the harvest_*
tables might not be present in the database. Check that you have a harvest_source
table with records, and that those records ids match datasets (table package
) of type="harvest" with the same ids. Perhaps the tables were not migrated during the migration.
Hope this helps, it's hard to debug without more details.
Hello, @amercader Thanks for reply! About first issue with 500 code error - where we can see which request harvester is sending, which returns this error?
About second one - developer says, that after turning off logging it is possible to register new harvesting source.
About first issue with 500 code error - where we can see which request harvester is sending, which returns this error?
This should be listed as a harvest error on the harvest admin UI, eg https://yoursite/harvest/<csw source/
Hello, all
We have some issues with harvester on our Latvian open data portal -> https://data.gov.lv/lv
Now we have CKAN version 2.8.6 and we could successful harvest from two CSW resources ->
http://195.244.156.233:8080/geoportal/csw https://geometadati.viss.gov.lv/geoportal/csw
But now on our Latvian Geoportal test enviroment we created new OGC CSW and we try to harvest from it in TEST enviroment in the same way, but receive this error ->
Also in our test enviroment our developer trying to update CKAN version to 2.10.1, and with that new version harvester doesn`t work at all, there are lots the same errors and no ideas how to solve them ->