-
When running `squint compare https://prod.myapp.com https://beta.myapp.com`, docs mention that beta site is crawled for paths. Why not both?
-
Hello,
Sorry for the dumb question.
Is there a way to skip the cached version for a specific user-agent like Googlebot?
-
The details of the new guest experience for Riot are on the project plan: vector-im/riot-meta#59
To make starting to use Riot as painless and as rewarding as possible, we want people to be able to …
-
Note: I suspect this problem lives outside openlibrary repo. Please point me to the right place to file this issue.
## Description
My avatar should show across all pages.
## Evidence
When I…
-
Hello Norconex-Team,
I am wondering whether the http-collector can scale horizontally, meaning if it is possible to start multiple crawlers with the same configuration working on the same data? I a…
-
Currently, depending on if a series has been matched in standard mode or multi-episode mode (i.e. tvdb2/3/4 mode), different sources of metadata will be used for each episode's Director and Writer. In…
-
Hi,
I am trying to crawl a site which require 2 step authentication.
Firstly, a small window appears which requires filling out with login and password, then I am redirected to a site which also…
-
I'm having troubles crawling certain sites where browsertrix doesn't seem getting past the cookie consent form. So I've created an interactive profile which contains the cookies created after accepti…
-
Hello,
I am currently crawling a website where some of the content is protected by a form authentication mechanism. When trying to request private content without a valid cookie, the web-server res…
-
**Is your feature request related to a problem? Please describe.**
I've read most of the available novels and nowadays I tend to spend time on the Webnovel Source sites and use google translate to re…