-
I am a big fan of pybuilder.
I am using Scrapy web crawling framework in my project which has its own directory structure, could you please let me know if there is any plugin for integration.
Curren…
-
Curious if you've thought about using the test conventions of different frameworks to try automatically running the test suites. It seems like this could potentially capture many more application quer…
-
I've been working on a [library for encoding x86 instructions](https://github.com/momumi/x86-zig) which should be useful for this project.
Only a few opcodes are implemented at the moment, but the …
-
I tried to add:
```
response = yield from asyncio.wait_for(
self.session.get(url, allow_redirects=False), 20)
```
instead of
```
response = yield from self.…
-
### Title
: Generate and include a sitemap.xml and robots.txt file to improve search engine crawling.
### Enhancement Aim
improve the search engine crawling by adding to more files of robots.txt an…
-
Can we sort out what we need first so we won't bloat our vendor dependencies? @rbo13
-
The [Fragmention specification](https://indieweb.org/fragmention) does not explicitly say anything about hashbang (#!) URLs or similar common (including legacy) single-page-app routing patterns, and i…
-
Like SQLMap for SQLi, I think Commix is the de facto standard tool for Command Injection.
I am working on a project for automated mobile application security assessment called Mobile Security Framewor…
-
More of a discussion point than an issue per se, (1) does it make sense to use a framework like Spring Batch manage the crawling process, and (2) can crawler4j support it?
-
### Project to be ~claimed~
https://pypi.org/project/ll/
**We do not wish to claim this project, but to appeal the upload restrictions on `ell`)
https://pypi.org/project/ell/
### Your PyPI …