🐞 BUG REPORT

[hcvdwerf]

🔄 Duplicate Check

• [X] I have searched both open and closed issues and found no similar reports.

🔍 What Happened?

When testing the harvester something is broken. No data is harvested

👣 Steps to Reproduce

1. Go to harvest sources
2. Add harvest source with the following settings
   • URL: https://health-ri.sandbox.semlab-leiden.nl -Title: Semlab leiden
   • Profile: { "profile": "fairdatapoint_dcat_ap" }
3. Trigger the harvester by pressing 'Reharvest' button

📸 Screenshots

No response

📋 Logs

/var/log/ckan/std # tail -f fetch_consumer.log File "/usr/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1880, in _execute_context self.dialect.do_executemany( File "/usr/lib/python3.10/site-packages/sqlalchemy/dialects/postgresql/psycopg2.py", line 982, in do_executemany context._psycopg2_fetched_rows = xtras.execute_values( File "/usr/lib/python3.10/site-packages/psycopg2/extras.py", line 1267, in execute_values parts.append(cur.mogrify(template, args)) sqlalchemy.exc.ProgrammingError: (psycopg2.ProgrammingError) can't adapt type 'Missing' [SQL: INSERT INTO package_extra (id, package_id, key, value, state) VALUES (%(id)s, %(package_id)s, %(key)s, %(value)s, %(state)s)] [parameters: ({'id': '2c35de0b-f5a3-48fe-a1d4-ab5881331e64', 'package_id': 'e745aa66-114c-473a-bc34-6a0f19353ed7', 'key': 'hello', 'value': 'Hello from the FAIR data point profile. Use this function to do FAIR data point specific stuff during the import stage', 'state': 'active'}, {'id': '95fec7b3-7418-40c3-aee0-5c758be72bbf', 'package_id': 'e745aa66-114c-473a-bc34-6a0f19353ed7', 'key': 'language', 'value': '["[\\" http://id.loc.gov/vocabulary/iso639-1/en\\"]"]' , 'state': 'active'}, {'id': '259b34c3-4f2f-4e6d-becb-2ba5515cd460', 'package_id': 'e745aa66-114c-473a-bc34-6a0f19353ed7', 'key': 'conforms_to', 'value': '["[\\" https://health-ri.sandbox.semlab-leiden.nl/profile/2f08228e-1789-40f8-84cd-28e3288c3604\\"]"]' , 'state': 'active'}, {'id': 'a0d2c332-63d2-4679-90e3-b03e7a5f6daa', 'package_id': 'e745aa66-114c-473a-bc34-6a0f19353ed7', 'key': 'uri', 'value': ' https://health-ri.sandbox.semlab-leiden.nl/dataset/d587d6ca-230c-4e2c-a547-e55e35ec2bdb' , 'state': 'active'}, {'id': 'c2a66823-76b1-4fec-83be-8a5b4f91b15f', 'package_id': 'e745aa66-114c-473a-bc34-6a0f19353ed7', 'key': 'theme', 'value': <ckan.lib.navl.dictization_functions.Missing object at 0x7ffffb32fa00>, 'state': 'active'}, {'id': '9e35ce14-8c57-48c1-906b-de7730582e41', 'package_id': 'e745aa66-114c-473a-bc34-6a0f19353ed7', 'key': 'has_version', 'value': <ckan.lib.navl.dictization_functions.Missing object at 0x7ffffb32fa00>, 'state': 'active'}, {'id': '26b0a6b2-a4a2-481f-866f-18f9150f3440', 'package_id': 'e745aa66-114c-473a-bc34-6a0f19353ed7', 'key': 'identifier', 'value': 'amypad', 'state': 'active'}, {'id': '5eff660c-cdc8-4206-b999-31e35ea4794d', 'package_id': 'e745aa66-114c-473a-bc34-6a0f19353ed7', 'key': 'access_rights', 'value': ' https://health-ri.sandbox.semlab-leiden.nl/dataset/d587d6ca-230c-4e2c-a547-e55e35ec2bdb#accessRights' , 'state': 'active'})] (Background on this error at: https://sqlalche.me/e/14/f405)

🌐 Affected Browsers

No response

💻 Operating System

No response

🤝 Want to Contribute to the Fix?

Yes, I'd like to help fix this.

ℹ️ Additional Information

No response