salsadigitalauorg / merlin-framework

Merlin - migration framework
GNU General Public License v3.0
16 stars 3 forks source link

cURL error handling #97

Closed steveworley closed 4 years ago

steveworley commented 4 years ago

Describe the bug Sometimes a domain will fail validating with the local CA cert. We should look at ways that we can automate or provide resolution steps to users.

http://www.chiefscientist.gov.au/2016/07/article-top-victorian-gong-for-australias-chief-scientist-alan-finkel-
         herald-sun/ -- cURL error 60:  (see http://curl.haxx.se/libcurl/c/libcurl-errors.html) 

Sample configuration

domain: http://www.chiefscientist.gov.au
urls:
  - /2016/07/article-top-victorian-gong-for-australias-chief-scientist-alan-finkel-herald-sun/

entity_type: custom_govcms_article
mappings:
  - field: alias
    type: alias
    processors:
      - processor: replace
        pattern: (\/$)
        replace: ''
stooit commented 4 years ago

Resolved with options to disable ssl verification