-
hi, how to crawling site with https?
-
### headers lowercase
[scrapy can not work when headers are lowercase ]
### Steps to Reproduce
1. i must use lowercase headers key and I use Twisted mapping headers and it doesn't work
…
-
Issue Brief
--
It would be better for SEO purposes to set the robots meta tag on attribute landingpages to help the indexing of pages by spiders.
Environment
--
* PHP Version: 7.2
* Magento V…
-
Post contents loaded by axios requests, the robots can't crawl anything from the pages.
-
1.)took the Image of DVWA,(https://hub.docker.com/r/vulnerables/web-dvwa/)
2.)reset DB and able to login via : http://127.0.0.1:80/login.php
3.) Ran the the docker run.
docker run --rm -v $(pwd):/z…
-
```
It would be nice if you could have a list of suffixes and prefixes to also search for
when spidering a site.
For example if you spider a site and find site.com/random.php it would be useful to
al…
-
Hi everyone,
Let’s document our critique sessions on Github, like [your senior batches did last year](https://github.com/mapschool/course/issues/36).
For each group, add in one comment these po…
-
Hello,
I am using ZAP php class, When I tried to execute it I am getting Bad Format (bad_format), When I checked the logs I found the following:
[24-Jan-2018 07:30:42 Europe/Berlin] PHP Warning: …
-
Refer to:
- https://github.com/owncloud/vm/issues/45
- https://github.com/jchaney/owncloud/pull/12
-
### Affected event items:
* Blood Bone
* ArchangelScroll
* Devils Key
* Devils Eye
* Old Scroll
* Illusion Sorcerer Covenant
### A few issues:
* Currently, EventItems are initialized with…