issues
search
buren
/
wayback_archiver
Ruby gem to send URLs to Wayback Machine
https://rubygems.org/gems/wayback_archiver
MIT License
57
stars
11
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update robots requirement from < 0.10.1 to < 0.10.2
#71
dependabot[bot]
opened
1 year ago
0
Update spidr requirement from ~> 0.6.1 to >= 0.6.1, < 0.8.0
#70
dependabot[bot]
opened
1 year ago
0
fix 429, limit to 5 requests per minute
#69
bartman081523
opened
1 year ago
0
Road to v2
#68
buren
opened
2 years ago
7
Road to v2
#67
buren
closed
2 years ago
0
Uncaught timeout exception in http.rb
#66
danshearer
opened
2 years ago
3
Update rake requirement from ~> 12.3 to ~> 13.0
#65
dependabot[bot]
opened
2 years ago
0
Update wayback_archiver.gemspec
#64
bartman081523
closed
2 years ago
0
cannot load such file -- robots (LoadError) with ruby verison 2.5
#51
bartman081523
opened
2 years ago
7
byebug depedency version
#50
bartman081523
closed
2 years ago
0
WARNING: open-ended dependency on byebug
#49
bartman081523
closed
2 years ago
0
rexml dependency version
#48
bartman081523
closed
2 years ago
1
Invalid gemspec in [wayback_archiver.gemspec]
#47
bartman081523
closed
2 years ago
1
Error in running the script
#46
xplosionmind
closed
2 years ago
8
Added Dependency: rexml
#45
bartman081523
closed
2 years ago
0
cannot load such file -- rexml/document
#44
shoeper
closed
2 years ago
2
Update simplecov requirement from ~> 0.14.1 to ~> 0.16.1
#43
dependabot[bot]
opened
3 years ago
0
Upgrade to GitHub-native Dependabot
#42
dependabot-preview[bot]
closed
3 years ago
0
Don't respect robots.txt file by default
#41
buren
closed
3 years ago
0
Add WaybackArchiver::respect_robots_txt
#40
buren
closed
3 years ago
0
Jekyll integration
#39
xplosionmind
closed
3 years ago
3
Update Spidr gem constraint
#38
jgarber623
closed
3 years ago
3
Consider *not* respecting robots.txt by default
#37
buren
closed
2 years ago
1
TravisCI fix and bundler v2.0 upgrade
#36
buren
closed
4 years ago
0
Set default concurrency to 1, due to harsher rate limits
#35
buren
closed
4 years ago
0
Update bundler requirement from ~> 1.3 to ~> 2.1
#34
dependabot-preview[bot]
closed
4 years ago
1
avoid 429, ignore robots
#33
bartman081523
closed
3 years ago
3
Rate limiting – HTTP 429, Too Many Requests
#32
buren
opened
4 years ago
11
Update rake requirement from ~> 10.3 to ~> 12.3
#31
dependabot-preview[bot]
closed
5 years ago
0
Update bundler requirement from ~> 1.3 to ~> 2.0
#30
dependabot-preview[bot]
closed
5 years ago
1
Update simplecov requirement from ~> 0.14.1 to ~> 0.16.1
#29
dependabot-preview[bot]
closed
5 years ago
1
Fix hosts argument regression
#28
buren
closed
2 years ago
0
Add support for multiple hosts
#27
buren
closed
5 years ago
0
Collect only OK,(200,302) pages
#26
bartman081523
closed
5 years ago
2
`check_path': path conflicts with opaque (URI::InvalidURIError)
#25
bartman081523
closed
5 years ago
4
Fix #16 : Pull: Archive every found file
#24
bartman081523
closed
5 years ago
3
Refactor Request#perform_request error handling
#23
buren
closed
6 years ago
0
Consider retrying on certain HTTP response codes, i.e 429, 502, 503
#22
buren
opened
6 years ago
0
Protect sitemap index duplicates
#21
buren
closed
6 years ago
0
Brakes when crawling hemnet.se sitemap
#20
buren
closed
6 years ago
0
Adapters
#19
buren
closed
6 years ago
0
Update the Travis CI config to run on Ruby 2.0
#18
buren
closed
6 years ago
0
Replace usage of String#match? in HttpCode
#17
buren
closed
6 years ago
0
Configure crawler to send more page types than just html
#16
buren
closed
5 years ago
0
Figure out what to do when a domain redirects to a subdomain when starting to crawl
#15
buren
closed
2 years ago
1
Rewrite - CLI, Proper concurrency, added test suite, proper Sitemap
#14
buren
closed
6 years ago
0
Logger
#13
buren
closed
7 years ago
0
Concurrent
#12
buren
closed
7 years ago
0
Use the concurrent-ruby gem
#11
buren
closed
7 years ago
0
most URLs sent to Wayback have 502 Bad Gateway status
#10
milliken
closed
7 years ago
3
Next