Crawling does not work properly when using own deployment of prerender

[technicalbirdVayuz]

Hi,

We are using our own deployment of pre-render, i.e running prerender on port 4000, and updating the service URL as HTTP://website.com:4000/

if we request from the Google search console for a specific URL, logs also come but screenshot not come in the Google search console panel after the live test

Whereas if we are using a prerender service URL i.e HTTP://service.prerender.io/ as the service URL then it works fine, Please explain what could be the issue

[technicalbirdVayuz]

Any update on this?

[turicas]

Are you proxying bot requests for your prerender instances (as you would for the prerenderi.io service)? If no, please do so and test again. If yes, you must provide the logs and other details. Without it it's difficult to help.

[technicalbirdVayuz]

This is what I have done to setup

• Configured pre-render, cloned from https://github.com/prerender/prerender
• Running it at port 3100, while the application is running on port 3000 (reverse proxy is done at application through nginx)
• Now if I use command, curl http://localhost:3100/render?url=http://localhost:3000/feed/task/how-to-conv ert-bsnl-3g-sim-to-4g-and-complete-the-activation-process (To render one of the page), It returns HTML but body does not have anything and that's why empty page is rendered at Google Console too.

Doing the same with prerender.io as a service (with token) works

Please help

[turicas]

Did you emailed any plugins? Which configuration (like env vars) you changed? I had to enable some plugins and test some different configurations to have it working properly for a website that takes a while to load. Check the plugins enabled by default in https://github.com/PythonicCafe/dokku-prerender (env.example file). Note that ENABLED_PLUGINS is an env var that my custom server.js uses, so you may enable them in another way (CACHE_* are also related to a custom plugin, prerender-plugin-fscache which is not included in the official prerender).

[technicalbirdVayuz]

These plugins are not available with this in this code: https://github.com/prerender/prerender, can you check once @turicas

[turicas]

These plugins are not available with this in this code: https://github.com/prerender/prerender, can you check once @turicas

Yes they are. https://github.com/prerender/prerender/tree/master/lib/plugins Please read the documentation and try enabling them.

[technicalbirdVayuz]

Following are the plugins that are enabled but still page does not rendered as expected

server.use(prerender.sendPrerenderHeader());
server.use(prerender.browserForceRestart()); 
server.use(prerender.addMetaTags());
server.use(prerender.removeScriptTags());
server.use(prerender.httpHeaders());

[turicas]

Sorry, without more information on the page being rendered I can't help you.