sul-dlss / wasapi-downloader

Java application to download WARCs from WASAPI
Other
6 stars 4 forks source link

Added ability to resume download. Added support for Java 1.8. #125

Closed justinlittman closed 5 years ago

justinlittman commented 5 years ago

Steps to test:

  1. Replace settings/config.properties with config.properties from shared_configs. Set outputBaseDir to point to scratch space.
  2. ./gradlew installDist
  3. ./build/install/wasapi-downloader/bin/wasapi-downloader --collectionId 5425 --crawlStartAfter 2018-01-01
  4. Download some files and then interrupt. Notice which files successfully downloaded and which is partially downloaded.
  5. ./build/install/wasapi-downloader/bin/wasapi-downloader --collectionId 5425 --crawlStartAfter 2018-01-01 --resume`

Expected result: