issues
search
scrapy-plugins
/
scrapy-dotpersistence
A scrapy extension to sync `.scrapy` folder to an S3 bucket
BSD 3-Clause "New" or "Revised" License
17
stars
8
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
add AWS_SESSION_TOKEN to make it works with AWS lambda (need executio…
#14
dgouyette-predictice
opened
2 years ago
1
Pypi has an outdated version of this library
#13
SteveSmirnoff
opened
3 years ago
1
Removed reference to non-existent attribute
#12
JakeCowton
closed
4 years ago
0
Added AWS credentials as required to enable the extension
#11
rennerocha
closed
5 years ago
4
Run extension outside scrapy cloud
#10
rennerocha
closed
5 years ago
3
Add Python 3.7 environment and remove unsupported Python versions (3.…
#9
rennerocha
closed
5 years ago
3
Configuration settings being overwritten?
#8
pmyteh
opened
7 years ago
1
Update classifiers, add builds for python 3
#7
vshlapakov
closed
7 years ago
1
Replace s3cmd with awscli
#6
vshlapakov
closed
8 years ago
1
Require s3cmd package
#5
vshlapakov
closed
8 years ago
1
Don't sync data back unless it was loaded successfully
#4
immerrr
closed
8 years ago
3
Increate multipart chunk size when storing to S3
#3
vshlapakov
closed
8 years ago
1
Replace s3cmd util with awscli
#2
vshlapakov
closed
8 years ago
1
Ignore file attributes when syncing
#1
vshlapakov
closed
8 years ago
0