I had a blocklist in place that included Discord crawler IPs, so crawling obviously wasn't working, now after disabling it, it still wont crawl it at all. I can't even find any requests made from discord (at least not with any discord user agent), embeds on other platforms (e.g. Facebook) work fine. It's definitely something host related as this isn't the only domain on that IP I'm having issues with. I am pretty sure that there shouldn't be any captcha/block, preventing it from crawling so I am kinda clueless.
Description
I had a blocklist in place that included Discord crawler IPs, so crawling obviously wasn't working, now after disabling it, it still wont crawl it at all. I can't even find any requests made from discord (at least not with any discord user agent), embeds on other platforms (e.g. Facebook) work fine. It's definitely something host related as this isn't the only domain on that IP I'm having issues with. I am pretty sure that there shouldn't be any captcha/block, preventing it from crawling so I am kinda clueless.
Domain: https://test.apollo.moe
Steps to Reproduce
Paste link anywhere in discord See embeds not working (Other hosts with same content do show embeds)
Expected Behavior
Embed with Text + Image show up
Current Behavior
It doesn't show up at all
Screenshots/Videos
No response
Client and System Information
Web-Client/Desktop-Client/Android-App
Server is using nginx 1.12.4 In this case these are static html/CSS files but same problems occur with PHP sites.