-
- [ ] browser support matrix including mobile
- [ ] implement http://jreject.turnwheel.com/ or similar (mobile friendly?)
- [ ] tested vs should work
- [ ] list devices and people for integration test…
-
Since it is not unusual that such types of files don't have title, author, subject, etc., I'm wondering if there is a way of capturing about (say) 100 characters or so from the beginning of the docume…
-
I think that there are bugs in version 2.3.2 of `HtmlProcessor#isRelativePath(assetPath)`:
```
private isRelativePath(assetPath) {
return !assetPath.startsWith("/") && !assetPath.startsWith("http…
-
None of defined childrens for browscap / resources / user-agents / crawlers / 360spider.json
match user agent appearing in logs:
```
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); …
-
Hi,
I've noticed few issues with your code the first one is just that you forgot to remove the comment in the hermes.py file line 179 and 180:
#print "constructing list of apps"
#brows…
-
Browser and crawlers are using robots.txt informations.
Latests years, those improved the way they need some information to be accessible :
> Bing/Yahoo and Google need a proper access to JS and CS…
-
Two weeks ago i run new site and made some actions to populize him in Google, Yandex and other search-engines. But... After my good work, i saw, that in my "sessions" table are more than 100k nodes. T…
ghost updated
9 years ago
-
In production mode, the application should detect Web crawlers (like the Google Bot) and present non-ajax pages.
cf. https://prerender.io/
-
http://www.sears.com/stooshy-junior-s-lurex-blazer/p-002VA52502712P?prdNo=33
-
Can you add an option to allow search bots like GoogleBot and Bing etc. to bypass the maintenance mode?