-
To schedule crawls, we presently require analysts to [connect to the server](https://ocdsdeploy.readthedocs.io/en/latest/how-to/kingfisher.html#collect-data-with-kingfisher-scrape) (as the correct use…
-
**Description of Problem:**
I do a clean install with Django 2.0 etc. I run makemigrations with custom model specified that uses UUID for object_id. It fails by claiming my app isn't installed:(. …
-
Twisted came out with a new version 19.x
the scrapyd-api throws and error looking for a str but receiving and int
Prevents using any api function to get status on running spiders
See error code bel…
-
Hello! Thanks for seeing this issue.
The doc of `schedule.json`says:
> setting (string, optional) - a Scrapy setting to use when running the spider
So can I pass two or more Scrapy settings to …
-
Traceback (most recent call last):
File "/home/zjy/workspace/gerapy-dev/lib/python3.7/site-packages/apscheduler/executors/base.py", line 125, in run_job
retval = job.func(*job.args, **job.kwar…
-
**Describe the need**
I want to call the API `http://host_ip:6800/logs/stats.json` to get all the jobs' `json_url` and request them externally .But all json_urls I got were started with `http://127.…
-
因为没有权限验证, 所以暂时想通过ip来控制scrapyd api的权限
-
Do we still need any of these?
* /root
* [x] 2019-nov-main-server-backup (961G)
* [x] 2019-dec-main-server-backup (70GB)
* /home/ocdskingfisher
* [x] ocdskingfisher.dump (March 2019…
-
This is a high priority as OCP need to check the API is working so they can sign-off the project.
The documentation is here: [http://beta.dncp.gov.py/datos/api/v3/doc/](http://beta.dncp.gov.py/dato…
-
$ gerapy init
$ cd gerapy/
$ ls
projects
$ gerapy migrate
Traceback (most recent call last):
File "/home/datacrawl/.local/bin/gerapy", line 11, in
sys.exit(cmd())
File "/home/datacra…