issues
search
rmax
/
scrapy-redis
Redis-based components for Scrapy.
http://scrapy-redis.readthedocs.io
MIT License
5.54k
stars
1.59k
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Question: How to remove specific url from dupefilter set on redis?
#302
matheus-rossi
opened
6 days ago
3
AttributeError: 'BossSpider' object has no attribute 'settings'
#301
gaye746560359
opened
1 month ago
0
give redis password support
#300
oreader1996
opened
2 months ago
1
docs: fix readthedocs
#299
rmax
closed
4 months ago
0
maint: precommit format, fixes and update copyright
#298
rmax
closed
4 months ago
0
build: use python3.12 as default version
#297
rmax
closed
4 months ago
0
bump version to 0.8.0
#296
rmax
closed
4 months ago
0
Fix test requirements and simplified tox config
#295
rmax
closed
4 months ago
0
fix: Scheduler not compatible with BaseDupeFilter
#294
HairlessVillager
closed
4 months ago
0
`scrapy_redis.scheduler.Scheduler` not compatible with `scrapy.dupefilters.BaseDupeFilter`
#293
HairlessVillager
closed
4 months ago
0
Removed unused import.
#292
sourcepirate
closed
4 months ago
0
Scrapy-redis usage related issues
#291
Hao1617
closed
6 months ago
7
[QUESTION] Is there a way to use response.meta ?
#290
SteliosGiannatos
closed
8 months ago
1
There is a compatibility issue with the latest scrapy-redis package of the new version of scrapy
#289
georgeJzzz
closed
7 months ago
13
Add Kafka Topic Integration to Scrapy Redis
#288
hamed21q
closed
3 months ago
1
Add metadata to URLs to retrieve from Redis
#287
tteguayco
closed
12 months ago
2
[spiders] Remove 'spider' argument to ExecutionEngine.crawl
#286
mic1on
closed
1 year ago
1
[Question] Fetch request url from redis fail
#285
KokoTa
opened
1 year ago
8
How does the CrawlSpider work?
#284
bch80
opened
1 year ago
0
Add Type annotations pep-0483
#283
LuckyPigeon
opened
1 year ago
0
[dev] Add Type annotations
#282
LuckyPigeon
closed
1 year ago
0
[dev] Update GitHub Badge
#281
LuckyPigeon
closed
1 year ago
0
[dev] Add customize fingerprint
#280
LuckyPigeon
closed
1 year ago
4
[DEV] Add GitHub Action badge
#279
LuckyPigeon
closed
1 year ago
0
[rollback] Rollback `request_fingerprint`
#278
LuckyPigeon
closed
1 year ago
3
[update] Update github action
#277
LuckyPigeon
closed
1 year ago
5
[update] tox.ini
#276
LuckyPigeon
closed
1 year ago
0
[dev] Deprecated function scrapy.utils.request.request_fingerprint() warning
#275
LuckyPigeon
closed
1 year ago
0
[dev] Cleanup requirements
#274
LuckyPigeon
closed
1 year ago
0
Is there a planned support for Python3.11?
#273
lion137
closed
1 year ago
5
Scrapy 2.8.0 deprecated function scrapy.utils.request.request_fingerprint() warning
#272
ThanatosDi
closed
1 year ago
1
Playwright?
#271
martmalo
opened
1 year ago
2
fix(sec): upgrade scrapy to 2.6.0
#270
lifefloating
closed
1 year ago
1
[dev] Optimize batch fetch method to boost throughput
#269
NiuBlibing
opened
1 year ago
3
Cleanup requirements
#268
devfox-se
closed
1 year ago
1
make_request_from_data implementation in RedisMixin
#267
rjbks
opened
1 year ago
2
警告： Passing a 'spider' argument to ExecutionEngine.crawl is deprecated
#266
maintain99
closed
1 year ago
4
日志报警：String request is deprecated
#265
maintain99
closed
1 year ago
0
How to use scrapy-redis if I'm using start_requests() instead of start_urls in my spider?
#264
ashwinbala99
closed
1 year ago
3
你好，大佬，请问一个问题，我用scrapy-redis执行爬虫的时候，设置最大并发是20，但是怎么感觉像创建20个队列一样，上一个20执行完之后，下一个20再执行，大佬，您能为我解答一下吗，感激不尽
#263
zhanghongdou
closed
1 year ago
2
why I can not see request record in redis
#262
minikiller
closed
1 year ago
2
[spiders] Remove duplicate check setting types
#261
LuckyPigeon
closed
2 years ago
0
[spiders] remove duplicate check setting types
#260
LuckyPigeon
closed
2 years ago
0
[settings] Deprecate REDIS_START_URLS_BATCH_SIZE
#259
LuckyPigeon
closed
2 years ago
0
[CI/CD] Fix action build
#258
LuckyPigeon
closed
2 years ago
0
error object has no attribute 'make_requests_from_url'
#257
zhajingwen
closed
2 years ago
2
Release Patch Version 0.7.3
#256
LuckyPigeon
closed
2 years ago
1
[CI/CD] Build GitHub action for cross platform buliding
#255
LuckyPigeon
closed
2 years ago
1
[CI/CD] Create templates for issue & pull request
#254
LuckyPigeon
closed
2 years ago
0
[CI/CD] Build macos tox & ci
#253
LuckyPigeon
closed
2 years ago
0
Next