-
### Please describe your feature request:
Things like angular,react,etc
### Describe the use case of this feature:
-
The first task is defining and expressing the **forcus crawling** specification.
The second subtask will be implementing that specification in sparkler.
Currently, we have support for URL based fo…
-
There are two aspects:
### Versioning
ATM some crawling pipelines do care/version datasets, e.g.
- [openfmri](https://github.com/datalad/datalad-crawler/blob/master/datalad_crawler/pipelines/open…
-
### Package name
katana
### Package homepage
https://github.com/projectdiscovery/katana
### Description
Next-generation crawling and spidering framework.
### Does the requested package meet the …
-
-
### Describe the feature
Hello
If I set up my crawler from GUI console I can choose Hudi S3 Table as a data source to be crawled. This is not yet possible neither on CFN or CDK. CDK already has iceb…
-
Dear all,
I have installed the framework according to
https://github.com/CIRCL/AIL-framework/blob/master/HOWTO.md
for enabling the crawler. However, even though I followed the steps (note: I hav…
-
# Summary
I understand Lacus can fetch content from both Tor websites and the normal internet.
An installation without configuring Tor will make the built-in test fail, when in reality web conte…
ajoga updated
3 weeks ago
-
### Project to be ~claimed~
https://pypi.org/project/ll/
**We do not wish to claim this project, but to appeal the upload restrictions on `ell`)
https://pypi.org/project/ell/
### Your PyPI …
-
I am a big fan of pybuilder.
I am using Scrapy web crawling framework in my project which has its own directory structure, could you please let me know if there is any plugin for integration.
Curren…