First of all, I know quite a few issues have been written about link cards not working. However, I believe in this case the solution does lie on our end if we could just get the right info.
In short: link preview fetching fails because the Akamai configuration for our site is set up to block most bots and crawlers (returning a 403) except for those we whitelisted. As such, if we can create a pattern that matches the cardyb crawler, this would fix the problem. This is an example of a link that fails.
Is there any info on the referrer, user agent and/or ip range being used so we can add a rule?
First of all, I know quite a few issues have been written about link cards not working. However, I believe in this case the solution does lie on our end if we could just get the right info.
In short: link preview fetching fails because the Akamai configuration for our site is set up to block most bots and crawlers (returning a 403) except for those we whitelisted. As such, if we can create a pattern that matches the cardyb crawler, this would fix the problem. This is an example of a link that fails.
Is there any info on the referrer, user agent and/or ip range being used so we can add a rule?