gleanerio / gleaner

Gleaner: JSON-LD and structured data on the web harvesting
https://gleaner.io
Apache License 2.0
17 stars 10 forks source link

Summon. If not authorized (403), not exist (404), service error (500), do not call headless #230

Open valentinedwv opened 1 year ago

valentinedwv commented 1 year ago

Hydroshare graciously returns an unauthorized, then gleaner goes out an trys again. might need to go an add another field to runstats ;)

Screen Shot 2023-07-18 at 5 41 03 PM
valentinedwv commented 1 year ago

From Doug: For the 403 / 500 stuff I think we can check at this point https://github.com/gleanerio/gleaner/blob/6a4d814d98f052e7bb273d0a8693b75f3a1f181d/internal/summoner/acquire/acquire.go#L138 and then just either skip or report. was just looking at the code during the meeting to see what it would take. Doesn't look onerous