This pull request introduces several improvements and updates to the ckanext-harvest extension, focusing on enhancing templates, improving validation, and optimizing functionality. Below are the key changes:
Template Enhancements: Improved the harvest panel and new source forms for better usability.
New Harvester Templates: Added templates for schemingdcat_ows and schemingdcat_xls harvesters to support new data formats.
Validation Improvements: Enhanced the FieldMappingValidator class to allow None as a valid value for the local field. Updated the validation logic and error messages accordingly.
i18n Updates: Updated internationalization for source templates and fixed translation issues in the schemingdcat_facet_list and admin/config templates.
Field Mapping Library Update: Updated the field_mapping library to provide more detailed information and improved validation.
Endpoint Template Fix: Fixed issues with the endpoints template when the sparql_interface is not active.
Configuration Enhancements: Improved configuration options and custom format rules, providing better flexibility and control.
Harvester Improvements: Enhanced the functionality and logging of various harvesters, including CKAN, XLS, and SchemingDCAT harvesters. Specific improvements include:
Updating _supported_schemas to use a set.
Enhancing default value handling in _update_package_dict_with_config_mapping_default_values.
Cleaning up tags and groups in _set_package_dict_default_values.
Improving the _update_custom_format method for better format/mimetype checking.
Adding log_export_to_csv method for improved logging during the harvesting process.
This pull request introduces several improvements and updates to the
ckanext-harvestextension, focusing on enhancing templates, improving validation, and optimizing functionality. Below are the key changes:schemingdcat_owsandschemingdcat_xlsharvesters to support new data formats.FieldMappingValidatorclass to allowNoneas a valid value for the local field. Updated the validation logic and error messages accordingly.schemingdcat_facet_listandadmin/configtemplates.field_mappinglibrary to provide more detailed information and improved validation.sparql_interfaceis not active._supported_schemasto use a set._update_package_dict_with_config_mapping_default_values._set_package_dict_default_values._update_custom_formatmethod for better format/mimetype checking.log_export_to_csvmethod for improved logging during the harvesting process.