search

xroche / httrack

HTTrack Website Copier, copy websites to your computer (Official repository)
http://www.httrack.com/
Other
3.63k stars 659 forks source link

Error when downloading docs.docker.com #120

Closed alexkubica closed 6 years ago

alexkubica commented 7 years ago

I'm tring to download https://docs.docker.com/ but it exits imediatley and this is the log that I get:

HTTrack3.48-22 launched on Fri, 27 Jan 2017 19:56:52 at https://docs.docker.com/
(winhttrack https://docs.docker.com/ -O "/home/alex/websites/docker" -%v )

Information, Warnings and Errors reported for this mirror:
note:   the hts-log.txt file, and hts-cache folder, may contain sensitive information,
    such as username/password authentication for websites mirrored in this project
    do not share these files/folders if you want these information to remain private

19:56:53    Error:  "error:00000001:lib(0):func(0):reason(1)" (-5) after 2 retries at link https://docs.docker.com/robots.txt (from primary/primary)
19:56:53    Warning:    Retry after error -5 (error:00000001:lib(0):func(0):reason(1)) at link https://docs.docker.com/ (from primary/primary)
19:56:53    Warning:    Retry after error -5 (error:00000001:lib(0):func(0):reason(1)) at link https://docs.docker.com/ (from primary/primary)
19:56:54    Error:  "error:00000001:lib(0):func(0):reason(1)" (-5) after 2 retries at link https://docs.docker.com/ (from primary/primary)
19:56:54    Warning:    No data seems to have been transferred during this session! : restoring previous one!

How can this be solved?

automaticgiant commented 7 years ago

seems to be mostly #102 , but that's not gone out in a release yet . i've been able to use https://hub.docker.com/r/automaticgiant/httrack-git/ (builds from master) to more successfully mirror docs.docker.com . don't recommend close yet .

i've not yet been able to find a satisfactory set of options to usefully mirror the site yet. i get alot of endless self-redirects, and incomplete mirroring. tons of 301s during spider as well.

rm -rf docker/; docker run -it --rm -v ${PWD}:/mirror automaticgiant/httrack-git httrack https://docs.docker.com/ -O ./docker -v -%I -z
docker/
WARNING! You are running this program as root!
It might be a good idea to run as a different user
HTTrack3.48-24 launched on Mon, 20 Feb 2017 11:13:50 at https://docs.docker.com/
(httrack https://docs.docker.com/ -O ./docker -v -%I -z )

Information, Warnings and Errors reported for this mirror:
note:   the hts-log.txt file, and hts-cache folder, may contain sensitive information,
    such as username/password authentication for websites mirrored in this project
    do not share these files/folders if you want these information to remain private

Mirror launched on Mon, 20 Feb 2017 11:13:50 by HTTrack Website Copier/3.48-24 [XR&CO'2014]
mirroring https://docs.docker.com/ with the wizard help..
11:13:50    Info:   engine: start
11:13:50    Info:   Warning: could not detect encoding for: primary/primary
11:13:50    Info:   engine: check-html: primary/primary
hashtable summary: size=16 (lg2=4) used=1 stash-size=0 pool-size=6 pool-capacity=256 pool-used=6 writes=1 (new=1) moved=0 stashed=0 max-stash-size=0 avg-moved=0 rehash=0 pool-compact=0 pool-realloc=1 memory=1264
11:13:51    Info:   engine: transfer-status: link recorded: https://docs.docker.com/ -> ./docker/docs.docker.com/index.html
11:13:51//docs.dInfo: coengine: transfer-status: link recorded: https://docs.docker.com/robots.txt ->
11:13:51ps://docInfo: erNote: robots.txt forbidden links for https://docs.docker.com are: /v1.4/, /v1.5/, /v1.6/, /v1.7/, /v1.8/, /v1.9/, /v1.10/, /v1.11/, /v1.12/, /datacenter/dtr/2.1, /datacenter/dtr/2.0, /datacenter/ucp/2.0, /datacenter/ucp/1.1, /apidocs/v*
11:13:51    Warning:    Note: due to https://docs.docker.com remote robots.txt rules, links beginning with these path will be forbidden: /v1.4/, /v1.5/, /v1.6/, /v1.7/, /v1.8/, /v1.9/, /v1.10/, /v1.11/, /v1.12/, /datacenter/dtr/2.1, /datacenter/dtr/2.0, /datacenter/ucp/2.0, /datacenter/ucp/1.1, /apidocs/v* (see in the options to disable this)
11:13:51ps://docInfo: erengine: check-html: https://docs.docker.com/
hashtable summary: size=2048 (lg2=11) used=507 stash-size=1 pool-size=5049 pool-capacity=8192 pool-used=5049 writes=507 (new=507) moved=572 stashed=26 max-stash-size=8 avg-moved=1.12821 rehash=7 pool-compact=0 pool-realloc=6 memory=57968
11:13:51ocker.coInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/apple-touch-icon-57x57.png
11:13:52    Info:   engine: transfer-status: link recorded: https://docs.docker.com/favicons/apple-touch-icon-57x57.png -> ./docker/docs.docker.com/favicons/apple-touch-icon-57x57.png
11:13:52//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/apple-touch-icon-57x57.png
11:13:52    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/apple-touch-icon-60x60.png
11:13:52ocker.coInfo: coengine: transfer-status: link recorded: https://docs.docker.com/favicons/apple-touch-icon-60x60.png -> ./docker/docs.docker.com/favicons/apple-touch-icon-60x60.png
11:13:52//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/apple-touch-icon-60x60.png
11:13:52    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/apple-touch-icon-72x72.png
11:13:53ocker.coInfo: coengine: transfer-status: link recorded: https://docs.docker.com/favicons/apple-touch-icon-72x72.png -> ./docker/docs.docker.com/favicons/apple-touch-icon-72x72.png
11:13:53//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/apple-touch-icon-72x72.png
11:13:53    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/apple-touch-icon-76x76.png
11:13:53ocker.coInfo: coengine: transfer-status: link recorded: https://docs.docker.com/favicons/apple-touch-icon-76x76.png -> ./docker/docs.docker.com/favicons/apple-touch-icon-76x76.png
11:13:53//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/apple-touch-icon-76x76.png
11:13:53    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/apple-touch-icon-114x114.png
11:13:53ocker.coInfo: coengine: transfer-status: link recorded: https://docs.docker.com/favicons/apple-touch-icon-114x114.png -> ./docker/docs.docker.com/favicons/apple-touch-icon-114x114.png
11:13:53//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/apple-touch-icon-114x114.png
11:13:54    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/apple-touch-icon-120x120.png
11:13:54ocker.coInfo: coengine: transfer-status: link recorded: https://docs.docker.com/favicons/apple-touch-icon-120x120.png -> ./docker/docs.docker.com/favicons/apple-touch-icon-120x120.png
11:13:54//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/apple-touch-icon-120x120.png
11:13:54    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/favicon-32x32.png
11:13:54ocker.coInfo: coengine: transfer-status: link recorded: https://docs.docker.com/favicons/favicon-32x32.png -> ./docker/docs.docker.com/favicons/favicon-32x32.png
11:13:54//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/favicon-32x32.png
11:13:54    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/favicon-96x96.png
11:13:55ocker.coInfo: coengine: transfer-status: link recorded: https://docs.docker.com/favicons/favicon-96x96.png -> ./docker/docs.docker.com/favicons/favicon-96x96.png
11:13:55//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/favicon-96x96.png
11:13:55    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/favicon-16x16.png
11:13:55ocker.coInfo: coengine: transfer-status: link recorded: https://docs.docker.com/favicons/favicon-16x16.png -> ./docker/docs.docker.com/favicons/favicon-16x16.png
11:13:55//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/favicon-16x16.png
11:13:55    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/favicons/manifest.json
11:13:56ocker.coInfo: coengine: transfer-status: link recorded: https://docs.docker.com/favicons/manifest.json -> ./docker/docs.docker.com/favicons/manifest.json
11:13:56//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/favicons/manifest.json
11:13:56    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/allcss.css
11:13:56ocker.coInfo: alengine: transfer-status: link recorded: https://docs.docker.com/css/allcss.css -> ./docker/docs.docker.com/css/allcss.css
11:13:57//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/app2.css
11:13:58ocker.coInfo: apengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/responsive.css
11:13:58ocker.coInfo: reengine: transfer-status: link recorded: https://docs.docker.com/css/app2.css -> ./docker/docs.docker.com/css/app2.css
11:13:58//docs.dInfo: coengine: transfer-status: link recorded: https://docs.docker.com/css/responsive.css -> ./docker/docs.docker.com/css/responsive.css
11:13:58//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/p2p.css
11:13:58ocker.coInfo: p2engine: transfer-status: link recorded: https://docs.docker.com/css/p2p.css -> ./docker/docs.docker.com/css/p2p.css
11:13:58//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/mobile_responsive.css
11:13:58ocker.coInfo: moengine: transfer-status: link recorded: https://docs.docker.com/css/mobile_responsive.css -> ./docker/docs.docker.com/css/mobile_responsive.css
11:13:59//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/temporary.css
11:13:59ocker.coInfo: teengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/hopscotch.css
11:13:59ocker.coInfo: hoengine: transfer-status: link recorded: https://docs.docker.com/css/temporary.css -> ./docker/docs.docker.com/css/temporary.css
11:13:59//docs.dInfo: coengine: transfer-status: link recorded: https://docs.docker.com/css/hopscotch.css -> ./docker/docs.docker.com/css/hopscotch.css
11:14:00//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/documentation.css
11:14:00ocker.coInfo: doengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/modernizr.min.js
11:14:00ocker.coInfo: odengine: transfer-status: link recorded: https://docs.docker.com/css/documentation.css -> ./docker/docs.docker.com/css/documentation.css
11:14:00//docs.dInfo: coengine: transfer-status: link recorded: https://docs.docker.com/js/modernizr.min.js -> ./docker/docs.docker.com/js/modernizr.min.js
11:14:00//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/js/modernizr.min.js
11:14:00    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/forms2.css
11:14:01ocker.coInfo: foengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/forms2-theme-simple.css
11:14:01ocker.coInfo: foengine: transfer-status: link recorded: https://docs.docker.com/css/forms2.css -> ./docker/docs.docker.com/css/forms2.css
11:14:01//docs.dInfo: coengine: transfer-status: link recorded: https://docs.docker.com/css/forms2-theme-simple.css -> ./docker/docs.docker.com/css/forms2-theme-simple.css
11:14:01//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/dockercon-17.png
11:14:02ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/dockercon-17.png -> ./docker/docs.docker.com/images/dockercon-17.png
11:14:02//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/dockercon-17.png
11:14:02    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/v1.4
11:14:02ocker.coInfo:  (engine: transfer-status: link error (301, 'Moved Permanently'): https://docs.docker.com/v1.4
11:14:02//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/v1.5
11:14:03ocker.coInfo:  (engine: transfer-status: link error (301, 'Moved Permanently'): https://docs.docker.com/v1.5
11:14:03//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/v1.6
11:14:03ocker.coInfo:  (engine: transfer-status: link error (301, 'Moved Permanently'): https://docs.docker.com/v1.6
11:14:03//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/v1.7
11:14:03ocker.coInfo:  (engine: transfer-status: link error (301, 'Moved Permanently'): https://docs.docker.com/v1.7
11:14:04//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/v1.8
11:14:04ocker.coInfo:  (engine: transfer-status: link error (301, 'Moved Permanently'): https://docs.docker.com/v1.8
11:14:04//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/manuals/
11:14:04ocker.coInfo:  (engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/v1.9
11:14:04    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): https://docs.docker.com/v1.9
11:14:05//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/v1.10
11:14:05ocker.coInfo: 0 engine: transfer-status: link error (301, 'Moved Permanently'): https://docs.docker.com/v1.10
11:14:05//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/v1.11
11:14:05ocker.coInfo: 1 engine: transfer-status: link error (301, 'Moved Permanently'): https://docs.docker.com/v1.11
11:14:05//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/v1.12
11:14:06ocker.coInfo: 2 engine: transfer-status: link error (301, 'Moved Permanently'): https://docs.docker.com/v1.12
11:14:06//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/getstarted-voting-app/index.md
11:14:06ocker.coInfo: neengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/engine/getstarted-voting-app/index.md
11:14:06//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-apple@2X.png
11:14:07ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-apple@2X.png -> ./docker/docs.docker.com/images/icon-apple@2X.png
11:14:07//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-apple@2X.png
11:14:07    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-windows@2X.png
11:14:07ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-windows@2X.png -> ./docker/docs.docker.com/images/icon-windows@2X.png
11:14:07//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-windows@2X.png
11:14:07    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-linux@2X.png
11:14:07ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-linux@2X.png -> ./docker/docs.docker.com/images/icon-linux@2X.png
11:14:07//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-linux@2X.png
11:14:08    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-engine@2X.png
11:14:08ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-engine@2X.png -> ./docker/docs.docker.com/images/icon-engine@2X.png
11:14:08//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-engine@2X.png
11:14:08    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/docker-hub/index.md
11:14:08ocker.coInfo: erengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/docker-hub/index.md
11:14:08//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-hub@2X.png
11:14:09ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-hub@2X.png -> ./docker/docs.docker.com/images/icon-hub@2X.png
11:14:09//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-hub@2X.png
11:14:09    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/docker-cloud/index.md
11:14:09ocker.coInfo: erengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/docker-cloud/index.md
11:14:09//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-cloud@2X.png
11:14:10ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-cloud@2X.png -> ./docker/docs.docker.com/images/icon-cloud@2X.png
11:14:10//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-cloud@2X.png
11:14:10    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-registry@2X.png
11:14:10ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-registry@2X.png -> ./docker/docs.docker.com/images/icon-registry@2X.png
11:14:10//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-registry@2X.png
11:14:10    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/datacenter/ucp/2.1/guides/index.md
11:14:10ocker.coInfo: ceengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/datacenter/ucp/2.1/guides/index.md
11:14:11//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-ucp@2X.png
11:14:11ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-ucp@2X.png -> ./docker/docs.docker.com/images/icon-ucp@2X.png
11:14:11//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-ucp@2X.png
11:14:11    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-machine@2X.png
11:14:11ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-machine@2X.png -> ./docker/docs.docker.com/images/icon-machine@2X.png
11:14:11//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-machine@2X.png
11:14:12    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/icon-compose@2X.png
11:14:12ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/icon-compose@2X.png -> ./docker/docs.docker.com/images/icon-compose@2X.png
11:14:12//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/icon-compose@2X.png
11:14:12    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/images/chat.png
11:14:12ocker.coInfo: esengine: transfer-status: link recorded: https://docs.docker.com/images/chat.png -> ./docker/docs.docker.com/images/chat.png
11:14:12//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/images/chat.png
11:14:12    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/forms2.min.js
11:14:13ocker.coInfo: orengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/css/github.css
11:14:13ocker.coInfo: giengine: transfer-status: link recorded: https://docs.docker.com/js/forms2.min.js -> ./docker/docs.docker.com/js/forms2.min.js
11:14:13//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/js/forms2.min.js
11:14:13    Info:   engine: transfer-status: link recorded: https://docs.docker.com/css/github.css -> ./docker/docs.docker.com/css/github.css
11:14:13//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/highlight.pack.js
11:14:14ocker.coInfo: igengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/alljs.js
11:14:14ocker.coInfo: llengine: transfer-status: link recorded: https://docs.docker.com/js/highlight.pack.js -> ./docker/docs.docker.com/js/highlight.pack.js
11:14:14//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/js/highlight.pack.js
11:14:15    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/glossary/
11:14:15ocker.coInfo: saengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/menu.js
11:14:15ocker.coInfo: enengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/reference/
11:14:16ocker.coInfo: reengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/samples/
11:14:16ocker.coInfo: leengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/
11:14:17ocker.coInfo: neengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/docker-for-mac/install/
11:14:17ocker.coInfo: erengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/app.js
11:14:17ocker.coInfo: ppengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/linux/ubuntu/
11:14:17ocker.coInfo: neengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/docker-for-windows/install/
11:14:17ocker.coInfo: erengine: transfer-status: link recorded: https://docs.docker.com/js/alljs.js -> ./docker/docs.docker.com/js/alljs.js
11:14:17//docs.dInfo: coengine: transfer-status: link recorded: https://docs.docker.com/js/menu.js -> ./docker/docs.docker.com/js/menu.js
11:14:17//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/js/alljs.js
11:14:17    Info:   File successfully written in background: ./docker/docs.docker.com/js/menu.js
11:14:17    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/linux/rhel/
11:14:17ocker.coInfo: neengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/linux/centos/
11:14:18ocker.coInfo: neengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/anchorlinks.js
11:14:18ocker.coInfo: ncengine: transfer-status: link recorded: https://docs.docker.com/js/app.js -> ./docker/docs.docker.com/js/app.js
11:14:18//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/js/app.js
11:14:18    Info:   engine: transfer-status: link recorded: https://docs.docker.com/js/anchorlinks.js -> ./docker/docs.docker.com/js/anchorlinks.js
11:14:18//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/js/anchorlinks.js
11:14:18    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/linux/fedora/
11:14:18ocker.coInfo: neengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/hopscotch.js
11:14:18ocker.coInfo: opengine: transfer-status: link recorded: https://docs.docker.com/js/hopscotch.js -> ./docker/docs.docker.com/js/hopscotch.js
11:14:18//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/js/hopscotch.js
11:14:19    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/my_first_tour.js
11:14:19ocker.coInfo: y_engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/js/XDFrame.html
11:14:19ocker.coInfo: DFengine: transfer-status: link recorded: https://docs.docker.com/js/my_first_tour.js -> ./docker/docs.docker.com/js/my_first_tour.js
11:14:19//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/js/my_first_tour.js
11:14:20https://Info: ocWarning: could not detect encoding for: https://docs.docker.com/css/allcss.css
11:14:20    Info:   engine: check-html: https://docs.docker.com/css/allcss.css
hashtable summary: size=16 (lg2=4) used=0 stash-size=0 pool-size=0 pool-capacity=0 pool-used=0 writes=0 (new=0) moved=0 stashed=0 max-stash-size=0 avg-moved=-nan rehash=0 pool-compact=0 pool-realloc=0 memory=1008
11:14:20    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/linux/debian/
11:14:20ocker.coInfo: neengine: transfer-status: link recorded: https://docs.docker.com/js/XDFrame.html -> ./docker/docs.docker.com/js/XDFrame.html
11:14:20//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-bg_flat_75_ffffff_40x100.png
11:14:20//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-bg_highlight-soft_75_cccccc_1x100.png
11:14:20//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-bg_glass_75_e6e6e6_1x400.png
11:14:20//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-bg_glass_75_dadada_1x400.png
11:14:21//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-bg_glass_65_ffffff_1x400.png
11:14:21//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-bg_glass_55_fbf9ee_1x400.png
11:14:21//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-bg_glass_95_fef1ec_1x400.png
11:14:21//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-icons_222222_256x240.png
11:14:21//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-icons_888888_256x240.png
11:14:22//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-icons_454545_256x240.png
11:14:22//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-icons_2e83ff_256x240.png
11:14:22//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-icons_cd0a0a_256x240.png
11:14:22//docs.dInfo: coengine: transfer-status: link error (404, 'Not Found'): https://docs.docker.com/css/images/ui-bg_flat_0_aaaaaa_40x100.png
11:14:23//docs.dInfo: coengine: transfer-status: link recorded: https://docs.docker.com/fonts/glyphicons-halflings-regular.eot -> ./docker/docs.docker.com/fonts/glyphicons-halflings-regular.eot
11:14:23//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/fonts/glyphicons-halflings-regular.eot
11:14:23    Info:   engine: transfer-status: link recorded: https://docs.docker.com/fonts/glyphicons-halflings-regular.eot? -> ./docker/docs.docker.com/fonts/glyphicons-halflings-regulard41d.eot
11:14:23//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/fonts/glyphicons-halflings-regulard41d.eot
11:14:23    Info:   engine: transfer-status: link recorded: https://docs.docker.com/fonts/glyphicons-halflings-regular.woff2 -> ./docker/docs.docker.com/fonts/glyphicons-halflings-regular.woff2
11:14:23//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/fonts/glyphicons-halflings-regular.woff2
11:14:23    Info:   engine: transfer-status: link recorded: https://docs.docker.com/fonts/glyphicons-halflings-regular.woff -> ./docker/docs.docker.com/fonts/glyphicons-halflings-regular.woff
11:14:23//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/fonts/glyphicons-halflings-regular.woff
11:14:23    Info:   engine: transfer-status: link recorded: https://docs.docker.com/fonts/glyphicons-halflings-regular.ttf -> ./docker/docs.docker.com/fonts/glyphicons-halflings-regular.ttf
11:14:23//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/fonts/glyphicons-halflings-regular.ttf
11:14:25    Info:   engine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/linux/suse/
11:14:25ocker.coInfo: neengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/linux/oracle/
11:14:25ocker.coInfo: neengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/linux/other/
11:14:25ocker.coInfo: neengine: transfer-status: link recorded: https://docs.docker.com/fonts/glyphicons-halflings-regular.svg -> ./docker/docs.docker.com/fonts/glyphicons-halflings-regular.svg
11:14:26//docs.dInfo: coengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/binaries/
11:14:26ocker.coInfo: neengine: transfer-status: link error (301, 'Moved Permanently'): docs.docker.com/engine/installation/linux/linux-postinstall/
11:14:26ocker.coInfo: neengine: transfer-status: link recorded: https://docs.docker.com/fonts/fontawesome-webfont.eot?v=4.4.0 -> ./docker/docs.docker.com/fonts/fontawesome-webfont93e3.eot
11:14:26//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/fonts/fontawesome-webfont93e3.eot
11:14:26    Info:   engine: transfer-status: link recorded: https://docs.docker.com/fonts/fontawesome-webfont.eot? -> ./docker/docs.docker.com/fonts/fontawesome-webfontd41d.eot
11:14:26//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/fonts/fontawesome-webfontd41d.eot
11:14:26    Info:   engine: transfer-status: link recorded: https://docs.docker.com/fonts/fontawesome-webfont.woff2?v=4.4.0 -> ./docker/docs.docker.com/fonts/fontawesome-webfont93e3.woff2
11:14:26//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/fonts/fontawesome-webfont93e3.woff2
11:14:26    Info:   engine: transfer-status: link recorded: https://docs.docker.com/fonts/fontawesome-webfont.woff?v=4.4.0 -> ./docker/docs.docker.com/fonts/fontawesome-webfont93e3.woff
11:14:26//docs.dInfo: coFile successfully written in background: ./docker/docs.docker.com/fonts/fontawesome-webfont93e3.woff

technically, this issue is rendered moot by #102 , but we should still figure out if there is some kind of problem with httrack or with usage that prevents trivial mirroring of this important resource.