kadirahq / flow-router

Carefully Designed Client Side Router for Meteor
MIT License
1.09k stars 193 forks source link

setPageCacheTimeout causes 'cannot decode raw data' error when website is crawled #706

Open joeldn opened 7 years ago

joeldn commented 7 years ago

We were experiencing strange behaviour on a website with webpages going down for no apparent reason. Whenever the pages where down they would return a ‘cannot decode raw data’ error for 10 to 15 minutes, but just on a specific route. Other routes on the same website weren’t affected.

After a while we discovered that crawling the website might be the problem and indeed visiting the website with for instance wget —spider would bring it down. The problem is reproducible on a local machine. The website is setup with Flow Router SSR just as described in the readme and when I comment out the setPageCacheTimeout to disable caching everything works fine.

Any ideas?