issues
search
scrapy
/
scrapyd
A service daemon to run Scrapy spiders
https://scrapyd.readthedocs.io/en/stable/
BSD 3-Clause "New" or "Revised" License
2.89k
stars
570
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Show timestamp for log files
#509
vorenhoutgithub
closed
13 hours ago
0
Consider deprecated versions of Python3
#508
vorenhoutgithub
closed
2 days ago
1
Adjust doc: add way to listen on IPv6 addresses
#507
vorenhoutgithub
closed
3 days ago
0
Specify settings for spider that share root directories between projects
#506
Aaron2516
closed
1 week ago
1
Is there a way to limit of how many spiders of a certain project would run on Scrapyd?
#505
aaronm137
closed
3 weeks ago
1
How to specify the naming convention of log files?
#504
aaronm137
closed
3 weeks ago
1
Are Scrapyd log files created with delays?
#503
aaronm137
closed
3 weeks ago
1
Added confirm dialog in cancel form
#502
Naik-G
closed
1 month ago
1
When I am in Scrapyd deploy，always report an error
#501
joykerl
closed
5 months ago
1
DA-243 Upgrade to python 3.12
#500
IonascuDenisa
closed
5 months ago
0
Add configuration via env vars
#499
fkromer
closed
1 month ago
1
Enable configuration of bind_address, http_port, username and password via env vars
#498
fkromer
closed
1 month ago
1
Azure Feed exporter not working
#497
MathiasIconB
closed
8 months ago
2
Bad installation steps for "python setup.py install"
#496
HyperUpscale
closed
9 months ago
2
transparent list of projects #493
#495
bsekiewicz
closed
9 months ago
0
Error on windows when trying to deploy - [WinError 32]
#494
amartins2imp
closed
9 months ago
17
Transparent list of projects
#493
bsekiewicz
closed
9 months ago
7
The work of scrapyd with the virtual environments of projects
#492
WhatIsLowe
closed
1 month ago
1
Update overview.rst
#491
mouday
closed
11 months ago
0
Cannot access environment variables in the spider running under ScrapyD
#490
iamumairayub
closed
12 months ago
2
May I ask is there any way use scrpyd to run python script with CrawlerProcess
#489
xinatcg
closed
12 months ago
2
Use wheel files for deployment
#488
majid-vaghari
closed
1 year ago
1
Add `--bind-address` and `--http-port` options (instead of configuration file)
#487
fuqiang-code
closed
5 hours ago
2
Polish docs
#486
izeye
closed
1 year ago
2
Polish
#485
izeye
closed
1 year ago
1
Adding custom endpoints
#484
vazkir
closed
1 month ago
4
How to pause and resume crawling with scrapyd?
#483
Akise
closed
1 year ago
3
Add x-forwarded-prefix support
#482
jpmckinney
closed
1 year ago
0
proxy prefix for Scrapyd (web interface) templates added
#481
TecIntelli
closed
1 year ago
0
Add reverse proxy support for web interface
#480
TecIntelli
closed
1 year ago
1
xxx.log can't be found
#479
hyliush
closed
1 year ago
3
Add support for environment variables
#478
Shleif91
closed
9 months ago
7
[Feature Request] S3 Storage
#477
mgrist
closed
1 year ago
3
feat: Add spiderqueue configuration option
#476
jpmckinney
closed
1 year ago
6
SQLite queue is using all CPU on high frequency poller (<1s)
#475
pspsdev
closed
1 month ago
12
feat: Log environment and command-line arguments for crawl command
#474
jpmckinney
closed
1 year ago
1
crawl: error: Invalid -s value, use -s NAME=VALUE
#473
saavedra29
closed
1 year ago
9
ReadTheDocs build
#472
jpmckinney
closed
1 year ago
2
Scrapy 2.8 support
#471
jpmckinney
closed
1 year ago
2
scrapyd writing logs to console instead of log files in docker container
#470
blacksteel1288
closed
1 year ago
9
Replace distutils.version.LooseVersion with packaging.version Version
#469
jpmckinney
closed
1 year ago
1
test: Add integration tests #400
#468
jpmckinney
closed
1 year ago
1
Api job url
#467
mxdev88
closed
1 year ago
3
High frequency scheduling
#466
pspsdev
closed
1 year ago
1
add FEEDS support like "curl http://localhost:6800/schedule.json ... -d setting=FEEDS=output.csv"
#465
armonbc
closed
1 year ago
0
API - add items and logs url to listjobs.json
#464
mxdev88
closed
1 year ago
3
How to correctly configure CONCURRENT_REQUESTS in a project with multiple spiders
#463
jxlil
closed
1 year ago
1
encoding errors when running a spider via scrapyd
#462
dedepene
closed
1 year ago
2
Update minimum python version in docs
#461
Laerte
closed
1 year ago
1
Add Python 3.11 support
#460
Laerte
closed
1 year ago
1
Next