issues
search
sul-dlss
/
wasapi-downloader
Java application to download WARCs from WASAPI
Other
6
stars
4
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
add assertions to test that filename setting works
#100
jmartin-sul
closed
7 years ago
1
review and approve README
#99
ndushay
closed
7 years ago
3
rename "jobId" in command line to "crawlId" ?
#98
ndushay
closed
7 years ago
0
Add single file download.
#97
tingulfsen
closed
7 years ago
2
get all the result pages
#96
jmartin-sul
closed
7 years ago
4
Update README
#95
tingulfsen
closed
7 years ago
1
refactor WasapiValidator.validateResponse()
#94
ndushay
opened
7 years ago
0
setting to set the number of retries per file download
#93
ndushay
closed
7 years ago
1
setting? to choose which checksum to validate with
#92
ndushay
closed
7 years ago
3
Some needed tweaks discovering while doing other work
#91
ndushay
closed
7 years ago
1
baseurl can end with or without slash
#90
ndushay
opened
7 years ago
0
output basedir can end with or without slash
#89
ndushay
opened
7 years ago
0
command line allows file list output (no download)
#88
ndushay
opened
7 years ago
0
Update build and deployment
#87
tingulfsen
closed
7 years ago
4
Crawl selection
#86
ndushay
closed
7 years ago
4
remove crawlStartBefore setting - not implemented
#85
jmartin-sul
closed
7 years ago
4
Use Java long to parse JSON size attribute.
#84
tingulfsen
closed
7 years ago
1
integer settings validation improvements
#83
ndushay
opened
7 years ago
0
what settings go together, what settings conflict?
#82
jmartin-sul
opened
7 years ago
0
command line allows single file download requests
#81
ndushay
closed
7 years ago
0
actually deploy finished code to prod
#80
ndushay
closed
7 years ago
2
build/deploy configures "ready-to-run" app
#79
ndushay
closed
7 years ago
0
document how to use wasapi-downloader in the README
#78
ndushay
closed
7 years ago
0
report network glitch during download to system.err
#77
ndushay
closed
7 years ago
0
VMs get memory they need
#76
ndushay
closed
7 years ago
1
hook up checksum validation of downloaded files
#75
ndushay
closed
7 years ago
0
download WARCs into correct location
#74
ndushay
closed
7 years ago
1
hook up crawl selection
#73
ndushay
closed
7 years ago
0
add accountId and "last known crawl" (jobIdLowerBound) settings
#72
jmartin-sul
closed
7 years ago
3
WasapiDownloader requests list files given settings
#71
ndushay
closed
7 years ago
4
add account ID to settings
#70
jmartin-sul
closed
7 years ago
0
validate settings
#69
jmartin-sul
closed
7 years ago
2
code doesn't work with https://partner.archive-it.org/wasapi/v1/login
#68
ndushay
opened
7 years ago
1
be able to benchmark download timings with on/off setting
#67
ndushay
opened
7 years ago
0
Move validate checksum
#66
ndushay
closed
7 years ago
1
Improve networking test coverage, minor refactorings
#65
tingulfsen
closed
7 years ago
4
download action retries until limit
#64
ndushay
closed
7 years ago
0
move validate checksum methods to WasapiValidator
#63
ndushay
closed
7 years ago
0
WasapiFile: output json for each warc at crawl id level
#62
ndushay
opened
7 years ago
0
Initialize HttpClient properly.
#61
tingulfsen
closed
7 years ago
1
Add tests for WasapiClient
#60
tingulfsen
closed
7 years ago
0
Test WasapiConnection
#59
tingulfsen
closed
7 years ago
0
allow authurl to get picked up from command line args, add tests
#58
jmartin-sul
closed
7 years ago
1
if wasapi adds login endpoint as part of spec, then remove it from settings file
#57
ndushay
opened
7 years ago
0
args override settings; add setting for output directory
#56
jmartin-sul
closed
7 years ago
1
add checkstyle (akin to rubocop)
#55
ndushay
closed
7 years ago
5
all settings should be available from either .properties file or command line args
#54
jmartin-sul
closed
7 years ago
0
capistrano: use settings.properties from shared_configs
#53
ndushay
closed
7 years ago
3
add lint checker (checkstyle?)
#52
ndushay
closed
7 years ago
1
deployment updates shared_configs
#51
ndushay
closed
7 years ago
1
Previous
Next