-
I installed grab-site on ubuntu 20.04 using nix.
The command I use is 'grab-site https://www.forexfactory.com/forums --concurrency=1' .
Example.com and other sites completed crawling, but the 'h…
-
Hi,
I came across an error (after installing all the required pakages) when I ran the code in the [Use it as a packgake](https://github.com/imethanlee/PhishIntention#use-it-as-a-package) section (R…
-
On multiple occasions I found myself using "Save Page As..." feature (in Firefox, one in beaker doesn't seems to work) and then adding saved page (dir containing all the assets) to beaker library.
…
-
As the ISPs keeps blocking the domains, and each time it happens you guys have to update the complete app to make that search engine work, if there is any way to fetch working domains from a jason fil…
-
```
What steps will reproduce the problem?
1. Enable "Include Sitemap URL in robots.txt"
2. Verify robots.txt file
3. added line:
http://www.mysite.com/sitemap.xml/gz # Added by Google Sitemap Genera…
-
Please can we modify the public website robots.txt file so that this archived website: https://www.webarchive.org.uk/act/wayback/archive/20190313122106/http://www.europeandialogue.org/
can be index…
-
```
Hi, I've downloaded code from svn and added support for two additional
keyboards - Serbian Cyrillic and Serbian Latin. I would appreciate if you
could add those keyboards in some of your future re…
-
Currently the first matching rule will be returned , but I don't think it's an good idea.
**For example this will always be true:**
User-Agent: *
Allow: /
Disallow: /admin/
Disallow: /redirect/
**ch…
-
@cclauss will you please review my GSoC proposal I will definitely look forward to your words
Thank You
-
* [x] I've read and understood the [contribution guidelines](https://github.com/Yoast/wordpress-seo/blob/trunk/.github/CONTRIBUTING.md).
* [x] I've searched for any related issues and avoided creatin…