gajus / usus

Webpage pre-rendering service. ⚡️
Other
805 stars 33 forks source link

Detect if a page responded with a 404 statusCode #25

Open colthreepv opened 7 years ago

colthreepv commented 7 years ago

Hi Gajus, I cannot thank you enough for this project. I'm trying to detect if a crawled page responds with a statusCode different than 200 for SEO reasons, is that possible / will be possible?

gajus commented 7 years ago

Not at the moment but I am planing new features for crawler like functionality as a SEO tool. Will keep an eye on this.

colthreepv commented 7 years ago

It's actually easier than expected. I have copy/pasted deeply from prerender/prerender

I have put that (usus) inside an express server that replies with appropriate status code. If anyone has troubles setting it up can reply here...

Alas a more low-level access would be bliss, if possible by the Chrome API