minio / mc

Unix like utilities for object store
https://min.io/download
GNU Affero General Public License v3.0
2.86k stars 548 forks source link

"mc mirror" crash version Sat, 05 Sep 2015 23:43:46 GMT #1144

Closed ExaTad closed 9 years ago

ExaTad commented 9 years ago

"mc mirror" crashed attempting to mirror an AWS bucket with millions of files down to a local disk.

 [tadhunt@Scarface smartreports]$ mc version
Sat, 05 Sep 2015 23:43:46 GMT
[tadhunt@Scarface smartreports]$ mc mirror  https://s3-us-west-2.amazonaws.com/{some-bucket} .
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
...5F8F0C9BB6A6F1F15AFFB5A910BC: 5.25 GB / 15.29 GB  ▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓ ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░  34.33 % 443.06 KB/s 6h36m2sruntime: bad pointer in frame github.com/minio/mc/vendor/github.com/minio/minio/pkg/quick.(*config).Load at 0xc97e93d8e0: 0x1
fatal error: invalid stack pointer

runtime stack:
runtime.throw(0x517080, 0x15)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/panic.go:527 +0x90 fp=0xb01867f8 sp=0xb01867e0
runtime.adjustpointers(0xc97e93d890, 0xb0186970, 0xb0186b60, 0x6258b8)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/stack1.go:438 +0x2d4 fp=0xb01868f0 sp=0xb01867f8
runtime.adjustframe(0xb0186a80, 0xb0186b60, 0xc800000001)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/stack1.go:505 +0x1b5 fp=0xb01869a8 sp=0xb01868f0
runtime.gentraceback(0x4ff20, 0xc97e93d840, 0x0, 0xca24b47c80, 0x0, 0x0, 0x7fffffff, 0x58b930, 0xb0186b60, 0x0, ...)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/traceback.go:336 +0xa69 fp=0xb0186ad8 sp=0xb01869a8
runtime.copystack(0xca24b47c80, 0x2000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/stack1.go:616 +0x1a7 fp=0xb0186bc8 sp=0xb0186ad8
runtime.shrinkstack(0xca24b47c80)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/stack1.go:880 +0x148 fp=0xb0186bf8 sp=0xb0186bc8
runtime.markroot(0xc820018060, 0x1fe)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgcmark.go:130 +0x1ac fp=0xb0186c98 sp=0xb0186bf8
runtime.parfordo(0xc820018060)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/parfor.go:110 +0x1d4 fp=0xb0186d20 sp=0xb0186c98
runtime.gchelper()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1700 +0x56 fp=0xb0186d68 sp=0xb0186d20
runtime.stopm()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc1.go:1131 +0x146 fp=0xb0186d90 sp=0xb0186d68
runtime.findrunnable(0xc82001ea00, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc1.go:1530 +0x69e fp=0xb0186e10 sp=0xb0186d90
runtime.schedule()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc1.go:1639 +0x267 fp=0xb0186e48 sp=0xb0186e10
runtime.park_m(0xc820170c00)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc1.go:1698 +0x18b fp=0xb0186e70 sp=0xb0186e48
runtime.mcall(0xb0186ed0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:204 +0x5b fp=0xb0186e80 sp=0xb0186e70

goroutine 1 [semacquire, 207 minutes]:
runtime.gopark(0x58bb98, 0x703cc0, 0x4d98f0, 0xa, 0x19, 0x4)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xca46a29398 sp=0xca46a29370
runtime.goparkunlock(0x703cc0, 0x4d98f0, 0xa, 0x6c619, 0x4)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xca46a293d0 sp=0xca46a29398
runtime.semacquire(0xc97e952b4c, 0x100101)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/sema.go:100 +0x2f7 fp=0xca46a29430 sp=0xca46a293d0
sync.runtime_Semacquire(0xc97e952b4c)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/sema.go:43 +0x26 fp=0xca46a29448 sp=0xca46a29430
sync.(*WaitGroup).Wait(0xc97e952b40)
    /usr/local/Cellar/go/1.5/libexec/src/sync/waitgroup.go:126 +0xb4 fp=0xca46a29490 sp=0xca46a29448
main.doMirrorCmdSession(0xc820015860)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:300 +0x59c fp=0xca46a295c8 sp=0xca46a29490
main.mainMirror(0xc8200f85a0)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:329 +0x57d fp=0xca46a297d0 sp=0xca46a295c8
github.com/minio/mc/vendor/github.com/minio/cli.Command.Run(0x4c92a8, 0x6, 0x0, 0x0, 0x0, 0x0, 0x0, 0x55b8c0, 0x45, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/cli/command.go:123 +0x10be fp=0xca46a29c88 sp=0xca46a297d0
github.com/minio/mc/vendor/github.com/minio/cli.(*App).Run(0xc8200ec000, 0xc82000a200, 0x4, 0x4, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/cli/app.go:199 +0x77d fp=0xca46a29ee8 sp=0xca46a29c88
github.com/minio/mc/vendor/github.com/minio/cli.(*App).RunAndExitOnError(0xc8200ec000)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/cli/app.go:210 +0x45 fp=0xca46a29f30 sp=0xca46a29ee8
main.main()
    /Users/harsha/mygo/src/github.com/minio/mc/main.go:176 +0x65 fp=0xca46a29f50 sp=0xca46a29f30
runtime.main()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:111 +0x2b0 fp=0xca46a29fa0 sp=0xca46a29f50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xca46a29fa8 sp=0xca46a29fa0

goroutine 17 [syscall, 260 minutes, locked to thread]:
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820040fb8 sp=0xc820040fb0

goroutine 2 [force gc (idle), 207 minutes]:
runtime.gopark(0x58bb98, 0x6fe590, 0x4d5220, 0xf, 0x14, 0x1)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc82002c758 sp=0xc82002c730
runtime.goparkunlock(0x6fe590, 0x4d5220, 0xf, 0xc820000114, 0x1)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc82002c790 sp=0xc82002c758
runtime.forcegchelper()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:152 +0xb8 fp=0xc82002c7c0 sp=0xc82002c790
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82002c7c8 sp=0xc82002c7c0
created by runtime.init.4
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:141 +0x2b

goroutine 3 [GC sweep wait]:
runtime.gopark(0x58bb98, 0x6fe740, 0x4cf000, 0xd, 0x91814, 0x1)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc82002cf48 sp=0xc82002cf20
runtime.goparkunlock(0x6fe740, 0x4cf000, 0xd, 0x14, 0x1)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc82002cf80 sp=0xc82002cf48
runtime.bgsweep(0xc820064000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgcsweep.go:67 +0x14d fp=0xc82002cfb8 sp=0xc82002cf80
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82002cfc0 sp=0xc82002cfb8
created by runtime.gcenable
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:205 +0x53

goroutine 4 [finalizer wait, 260 minutes]:
runtime.gopark(0x58bb98, 0x723970, 0x4d4db0, 0xe, 0x14, 0x1)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc82002d718 sp=0xc82002d6f0
runtime.goparkunlock(0x723970, 0x4d4db0, 0xe, 0x14, 0x1)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc82002d750 sp=0xc82002d718
runtime.runfinq()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mfinal.go:154 +0xaa fp=0xc82002d7c0 sp=0xc82002d750
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82002d7c8 sp=0xc82002d7c0
created by runtime.createfing
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mfinal.go:135 +0x60

goroutine 5 [syscall, 260 minutes]:
runtime.notetsleepg(0x723c40, 0xffffffffffffffff, 0x1)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/lock_sema.go:264 +0x86 fp=0xc82002df40 sp=0xc82002df00
runtime.signal_recv(0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/sigqueue.go:111 +0x132 fp=0xc82002df78 sp=0xc82002df40
os/signal.loop()
    /usr/local/Cellar/go/1.5/libexec/src/os/signal/signal_unix.go:22 +0x18 fp=0xc82002dfc0 sp=0xc82002df78
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82002dfc8 sp=0xc82002dfc0
created by os/signal.init.1
    /usr/local/Cellar/go/1.5/libexec/src/os/signal/signal_unix.go:28 +0x37

goroutine 19 [syscall]:
runtime.notetsleepg(0x6fe778, 0x20234bb, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/lock_sema.go:264 +0x86 fp=0xc820028738 sp=0xc8200286f8
runtime.timerproc()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/time.go:209 +0xde fp=0xc8200287c0 sp=0xc820028738
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8200287c8 sp=0xc8200287c0
created by runtime.addtimerLocked
    /usr/local/Cellar/go/1.5/libexec/src/runtime/time.go:116 +0x11f

goroutine 35 [garbage collection]:
runtime.systemstack_switch()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:216 fp=0xc820028c98 sp=0xc820028c90
runtime.gc(0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1096 +0x3d0 fp=0xc820028f90 sp=0xc820028c98
runtime.backgroundgc()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:896 +0x3d fp=0xc820028fc0 sp=0xc820028f90
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820028fc8 sp=0xc820028fc0
created by runtime.startGC
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:869 +0x186

goroutine 36 [mark worker (idle)]:
runtime.gopark(0x58ba30, 0xc820202000, 0x518180, 0x12, 0x14, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820176750 sp=0xc820176728
runtime.gcBgMarkWorker(0xc82001c000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1288 +0xf7 fp=0xc8201767b8 sp=0xc820176750
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8201767c0 sp=0xc8201767b8
created by runtime.gcBgMarkStartWorkers
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1238 +0x93

goroutine 37 [mark worker (idle)]:
runtime.gopark(0x58ba30, 0xc820534000, 0x518180, 0x12, 0x14, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820176f50 sp=0xc820176f28
runtime.gcBgMarkWorker(0xc82001d500)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1288 +0xf7 fp=0xc820176fb8 sp=0xc820176f50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820176fc0 sp=0xc820176fb8
created by runtime.gcBgMarkStartWorkers
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1238 +0x93

goroutine 38 [mark worker (idle)]:
runtime.gopark(0x58ba30, 0xc820032d80, 0x518180, 0x12, 0x14, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820177750 sp=0xc820177728
runtime.gcBgMarkWorker(0xc82001ea00)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1288 +0xf7 fp=0xc8201777b8 sp=0xc820177750
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8201777c0 sp=0xc8201777b8
created by runtime.gcBgMarkStartWorkers
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1238 +0x93

goroutine 39 [mark worker (idle)]:
runtime.gopark(0x58ba30, 0xc820360900, 0x518180, 0x12, 0x14, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820177f50 sp=0xc820177f28
runtime.gcBgMarkWorker(0xc820020000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1288 +0xf7 fp=0xc820177fb8 sp=0xc820177f50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820177fc0 sp=0xc820177fb8
created by runtime.gcBgMarkStartWorkers
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1238 +0x93

goroutine 40 [mark worker (idle)]:
runtime.gopark(0x58ba30, 0xc8202db200, 0x518180, 0x12, 0x14, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820178750 sp=0xc820178728
runtime.gcBgMarkWorker(0xc820021500)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1288 +0xf7 fp=0xc8201787b8 sp=0xc820178750
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8201787c0 sp=0xc8201787b8
created by runtime.gcBgMarkStartWorkers
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1238 +0x93

goroutine 41 [mark worker (idle)]:
runtime.gopark(0x58ba30, 0xc94e1bfb00, 0x518180, 0x12, 0x14, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820178f50 sp=0xc820178f28
runtime.gcBgMarkWorker(0xc820022a00)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1288 +0xf7 fp=0xc820178fb8 sp=0xc820178f50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820178fc0 sp=0xc820178fb8
created by runtime.gcBgMarkStartWorkers
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1238 +0x93

goroutine 6 [mark worker (idle)]:
runtime.gopark(0x58ba30, 0xc820202000, 0x518180, 0x12, 0x14, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc82002e750 sp=0xc82002e728
runtime.gcBgMarkWorker(0xc820024000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1288 +0xf7 fp=0xc82002e7b8 sp=0xc82002e750
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82002e7c0 sp=0xc82002e7b8
created by runtime.gcBgMarkStartWorkers
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1238 +0x93

goroutine 7 [mark worker (idle)]:
runtime.gopark(0x58ba30, 0xc978d47b00, 0x518180, 0x12, 0x14, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc82002ef50 sp=0xc82002ef28
runtime.gcBgMarkWorker(0xc820025500)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1288 +0xf7 fp=0xc82002efb8 sp=0xc82002ef50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82002efc0 sp=0xc82002efb8
created by runtime.gcBgMarkStartWorkers
    /usr/local/Cellar/go/1.5/libexec/src/runtime/mgc.go:1238 +0x93

goroutine 8 [chan receive, 260 minutes]:
runtime.gopark(0x58bb98, 0xc82055e058, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc82002f638 sp=0xc82002f610
runtime.goparkunlock(0xc82055e058, 0x4d3960, 0xc, 0xc82056a017, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc82002f670 sp=0xc82002f638
runtime.chanrecv(0x383140, 0xc82055e000, 0x0, 0x1, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:505 +0x901 fp=0xc82002f730 sp=0xc82002f670
runtime.chanrecv1(0x383140, 0xc82055e000, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:349 +0x2b fp=0xc82002f760 sp=0xc82002f730
main.signalTrap.func1(0xc82000f9c0, 0x2, 0x2, 0xc820065110, 0xc820065110)
    /Users/harsha/mygo/src/github.com/minio/mc/signals.go:39 +0xaf fp=0xc82002f798 sp=0xc82002f760
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82002f7a0 sp=0xc82002f798
created by main.signalTrap
    /Users/harsha/mygo/src/github.com/minio/mc/signals.go:43 +0x76

goroutine 9 [chan send, 207 minutes]:
runtime.gopark(0x58bb98, 0xc8200184d8, 0x4d3970, 0x9, 0x16, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc82002fe10 sp=0xc82002fde8
runtime.goparkunlock(0xc8200184d8, 0x4d3970, 0x9, 0x16, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc82002fe48 sp=0xc82002fe10
runtime.chansend(0x382c60, 0xc820018480, 0xc82002ff7c, 0x1, 0x3c507, 0xc)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:197 +0x499 fp=0xc82002ff18 sp=0xc82002fe48
runtime.chansend1(0x382c60, 0xc820018480, 0xc82002ff7c)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:92 +0x43 fp=0xc82002ff50 sp=0xc82002ff18
main.cursorAnimate.func1(0x4db740, 0xc, 0xc820018480)
    /Users/harsha/mygo/src/github.com/minio/mc/pb.go:123 +0x87 fp=0xc82002ffa8 sp=0xc82002ff50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82002ffb0 sp=0xc82002ffa8
created by main.cursorAnimate
    /Users/harsha/mygo/src/github.com/minio/mc/pb.go:126 +0x77

goroutine 50 [select, 260 minutes, locked to thread]:
runtime.gopark(0x58bbd0, 0xc820576728, 0x4ca198, 0x6, 0x6ff18, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820576528 sp=0xc820576500
runtime.selectgoImpl(0xc820576728, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc8205766d0 sp=0xc820576528
runtime.selectgo(0xc820576728)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc8205766f0 sp=0xc8205766d0
runtime.ensureSigM.func1()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/signal1_unix.go:227 +0x323 fp=0xc8205767c0 sp=0xc8205766f0
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8205767c8 sp=0xc8205767c0
created by runtime.ensureSigM
    /usr/local/Cellar/go/1.5/libexec/src/runtime/signal1_unix.go:240 +0xd0

goroutine 182 [chan receive]:
runtime.gopark(0x58bb98, 0xc97e86fc18, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820626db8 sp=0xc820626d90
runtime.goparkunlock(0xc97e86fc18, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc820626df0 sp=0xc820626db8
runtime.chanrecv(0x382660, 0xc97e86fbc0, 0xc820626f80, 0xc820502701, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:448 +0x472 fp=0xc820626eb0 sp=0xc820626df0
runtime.chanrecv2(0x382660, 0xc97e86fbc0, 0xc820626f80, 0xc9c78af2c0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:354 +0x2b fp=0xc820626ee0 sp=0xc820626eb0
main.newCpBar.func1(0xc97e86fbc0, 0xc97e86fc20)
    /Users/harsha/mygo/src/github.com/minio/mc/pb.go:172 +0xf4 fp=0xc820626fa0 sp=0xc820626ee0
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820626fa8 sp=0xc820626fa0
created by main.newCpBar
    /Users/harsha/mygo/src/github.com/minio/mc/pb.go:203 +0x90

goroutine 183 [select]:
runtime.gopark(0x58bbd0, 0xc82003cef0, 0x4ca198, 0x6, 0x18, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc82003cc70 sp=0xc82003cc48
runtime.selectgoImpl(0xc82003cef0, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc82003ce18 sp=0xc82003cc70
runtime.selectgo(0xc82003cef0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc82003ce38 sp=0xc82003ce18
main.doMirrorCmdSession.func1(0xc97e952b40, 0xc97e86fce0, 0xc97e952b10, 0xc820015860, 0xc820065110)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:243 +0x67c fp=0xc82003cf88 sp=0xc82003ce38
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82003cf90 sp=0xc82003cf88
created by main.doMirrorCmdSession
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:272 +0x520

goroutine 184 [chan send]:
runtime.gopark(0x58bb98, 0xc97e958058, 0x4d3970, 0x9, 0x16, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc97e97ed18 sp=0xc97e97ecf0
runtime.goparkunlock(0xc97e958058, 0x4d3970, 0x9, 0xc97e914016, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc97e97ed50 sp=0xc97e97ed18
runtime.chansend(0x382900, 0xc97e958000, 0xc97e97eeb7, 0xc97e952b01, 0x3a5a8, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:236 +0x8c0 fp=0xc97e97ee20 sp=0xc97e97ed50
runtime.chansend1(0x382900, 0xc97e958000, 0xc97e97eeb7)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:92 +0x43 fp=0xc97e97ee58 sp=0xc97e97ee20
main.doMirrorCmdSession.func2(0xc97e952b40, 0xc97e86fce0, 0xc979207800, 0xc97e916fc0, 0xc97e952b10, 0xc97e958000)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:290 +0x358 fp=0xc97e97ef80 sp=0xc97e97ee58
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc97e97ef88 sp=0xc97e97ef80
created by main.doMirrorCmdSession
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:298 +0x58e

goroutine 285 [select]:
runtime.gopark(0x58bbd0, 0xc97e97ff10, 0x4ca198, 0x6, 0x18, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc97e97fd18 sp=0xc97e97fcf0
runtime.selectgoImpl(0xc97e97ff10, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc97e97fec0 sp=0xc97e97fd18
runtime.selectgo(0xc97e97ff10)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc97e97fee0 sp=0xc97e97fec0
github.com/minio/mc/vendor/github.com/minio/pb.(*ProgressBar).writer(0xc97e928600)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/pb/pb.go:353 +0x111 fp=0xc97e97ffa8 sp=0xc97e97fee0
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc97e97ffb0 sp=0xc97e97ffa8
created by github.com/minio/mc/vendor/github.com/minio/pb.(*ProgressBar).Start
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/pb/pb.go:105 +0xa6

goroutine 4403627 [IO wait]:
runtime.gopark(0x58bb58, 0xa103d08, 0x4c6350, 0x7, 0xfe51b, 0x5)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc8205c9360 sp=0xc8205c9338
runtime.netpollblock(0xa103ce0, 0xffffff0000000072, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:338 +0x15e fp=0xc8205c93a8 sp=0xc8205c9360
net.runtime_pollWait(0xa103ce0, 0x72, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:157 +0x60 fp=0xc8205c93c8 sp=0xc8205c93a8
net.(*pollDesc).Wait(0xca24b45c60, 0x72, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:73 +0x3a fp=0xc8205c93e8 sp=0xc8205c93c8
net.(*pollDesc).WaitRead(0xca24b45c60, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:78 +0x36 fp=0xc8205c9410 sp=0xc8205c93e8
net.(*netFD).Read(0xca24b45c00, 0xc82061e000, 0x2000, 0x2000, 0x0, 0xaa0050, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_unix.go:232 +0x23a fp=0xc8205c94e0 sp=0xc8205c9410
net.(*conn).Read(0xc82018a148, 0xc82061e000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/net.go:172 +0xe4 fp=0xc8205c9548 sp=0xc8205c94e0
crypto/tls.(*block).readFromUntil(0xc820328450, 0xe40050, 0xc82018a148, 0x5, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:455 +0xcc fp=0xc8205c95b0 sp=0xc8205c9548
crypto/tls.(*Conn).readRecord(0xc9cac68840, 0x58bc17, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:540 +0x2d1 fp=0xc8205c9ae0 sp=0xc8205c95b0
crypto/tls.(*Conn).Read(0xc9cac68840, 0xc8219f6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:901 +0x167 fp=0xc8205c9be0 sp=0xc8205c9ae0
net/http.noteEOFReader.Read(0xe0e708, 0xc9cac68840, 0xc82040d188, 0xc8219f6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1370 +0x67 fp=0xc8205c9c30 sp=0xc8205c9be0
net/http.(*noteEOFReader).Read(0xc8204ee6a0, 0xc8219f6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    <autogenerated>:126 +0xd0 fp=0xc8205c9c80 sp=0xc8205c9c30
bufio.(*Reader).fill(0xc9cab89920)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:97 +0x1e9 fp=0xc8205c9d40 sp=0xc8205c9c80
bufio.(*Reader).Peek(0xc9cab89920, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:132 +0xcc fp=0xc8205c9d50 sp=0xc8205c9d40
net/http.(*persistConn).readLoop(0xc82040d130)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:876 +0xf7 fp=0xc8205c9f98 sp=0xc8205c9d50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8205c9fa0 sp=0xc8205c9f98
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:685 +0xc78

goroutine 4403438 [IO wait]:
runtime.gopark(0x58bb58, 0xe00858, 0x4c6350, 0x7, 0xfe51b, 0x5)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820653360 sp=0xc820653338
runtime.netpollblock(0xe00830, 0xffffff0000000072, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:338 +0x15e fp=0xc8206533a8 sp=0xc820653360
net.runtime_pollWait(0xe00830, 0x72, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:157 +0x60 fp=0xc8206533c8 sp=0xc8206533a8
net.(*pollDesc).Wait(0xc820124840, 0x72, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:73 +0x3a fp=0xc8206533e8 sp=0xc8206533c8
net.(*pollDesc).WaitRead(0xc820124840, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:78 +0x36 fp=0xc820653410 sp=0xc8206533e8
net.(*netFD).Read(0xc8201247e0, 0xc820402000, 0x2000, 0x2000, 0x0, 0xaa0050, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_unix.go:232 +0x23a fp=0xc8206534e0 sp=0xc820653410
net.(*conn).Read(0xc979204488, 0xc820402000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/net.go:172 +0xe4 fp=0xc820653548 sp=0xc8206534e0
crypto/tls.(*block).readFromUntil(0xc83fa98510, 0xe40050, 0xc979204488, 0x5, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:455 +0xcc fp=0xc8206535b0 sp=0xc820653548
crypto/tls.(*Conn).readRecord(0xc820363600, 0x58bc17, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:540 +0x2d1 fp=0xc820653ae0 sp=0xc8206535b0
crypto/tls.(*Conn).Read(0xc820363600, 0xc820349000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:901 +0x167 fp=0xc820653be0 sp=0xc820653ae0
net/http.noteEOFReader.Read(0xe0e708, 0xc820363600, 0xc82040cec8, 0xc820349000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1370 +0x67 fp=0xc820653c30 sp=0xc820653be0
net/http.(*noteEOFReader).Read(0xc820504300, 0xc820349000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    <autogenerated>:126 +0xd0 fp=0xc820653c80 sp=0xc820653c30
bufio.(*Reader).fill(0xc8202794a0)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:97 +0x1e9 fp=0xc820653d40 sp=0xc820653c80
bufio.(*Reader).Peek(0xc8202794a0, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:132 +0xcc fp=0xc820653d50 sp=0xc820653d40
net/http.(*persistConn).readLoop(0xc82040ce70)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:876 +0xf7 fp=0xc820653f98 sp=0xc820653d50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820653fa0 sp=0xc820653f98
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:685 +0xc78

goroutine 4402999 [runnable]:
runtime.gopark(0x58bb58, 0x7e37c50, 0x4c6350, 0x7, 0xfe51b, 0x5)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820651360 sp=0xc820651338
runtime.netpollblock(0x7e37c28, 0xffffff0000000072, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:338 +0x15e fp=0xc8206513a8 sp=0xc820651360
net.runtime_pollWait(0x7e37c28, 0x72, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:157 +0x60 fp=0xc8206513c8 sp=0xc8206513a8
net.(*pollDesc).Wait(0xc82061d480, 0x72, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:73 +0x3a fp=0xc8206513e8 sp=0xc8206513c8
net.(*pollDesc).WaitRead(0xc82061d480, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:78 +0x36 fp=0xc820651410 sp=0xc8206513e8
net.(*netFD).Read(0xc82061d420, 0xc97e9ba000, 0x2000, 0x2000, 0x0, 0xaa0050, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_unix.go:232 +0x23a fp=0xc8206514e0 sp=0xc820651410
net.(*conn).Read(0xc9792040b8, 0xc97e9ba000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/net.go:172 +0xe4 fp=0xc820651548 sp=0xc8206514e0
crypto/tls.(*block).readFromUntil(0xc9f90060c0, 0xe40050, 0xc9792040b8, 0x5, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:455 +0xcc fp=0xc8206515b0 sp=0xc820651548
crypto/tls.(*Conn).readRecord(0xc820234dc0, 0x58bc17, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:540 +0x2d1 fp=0xc820651ae0 sp=0xc8206515b0
crypto/tls.(*Conn).Read(0xc820234dc0, 0xc8200f1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:901 +0x167 fp=0xc820651be0 sp=0xc820651ae0
net/http.noteEOFReader.Read(0xe0e708, 0xc820234dc0, 0xc820490528, 0xc8200f1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1370 +0x67 fp=0xc820651c30 sp=0xc820651be0
net/http.(*noteEOFReader).Read(0xc82045bbe0, 0xc8200f1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    <autogenerated>:126 +0xd0 fp=0xc820651c80 sp=0xc820651c30
bufio.(*Reader).fill(0xc820186360)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:97 +0x1e9 fp=0xc820651d40 sp=0xc820651c80
bufio.(*Reader).Peek(0xc820186360, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:132 +0xcc fp=0xc820651d50 sp=0xc820651d40
net/http.(*persistConn).readLoop(0xc8204904d0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:876 +0xf7 fp=0xc820651f98 sp=0xc820651d50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820651fa0 sp=0xc820651f98
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:685 +0xc78

goroutine 4403308 [select]:
runtime.gopark(0x58bbd0, 0xc9cac05f10, 0x4ca198, 0x6, 0xc81ffd7c18, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc9cac05c78 sp=0xc9cac05c50
runtime.selectgoImpl(0xc9cac05f10, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc9cac05e20 sp=0xc9cac05c78
runtime.selectgo(0xc9cac05f10)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc9cac05e40 sp=0xc9cac05e20
net/http.(*persistConn).writeLoop(0xc82040c580)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1009 +0x40c fp=0xc9cac05fa8 sp=0xc9cac05e40
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc9cac05fb0 sp=0xc9cac05fa8
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:686 +0xc9d

goroutine 4402005 [IO wait]:
runtime.gopark(0x58bb58, 0x7e36bd0, 0x4c6350, 0x7, 0xfe51b, 0x5)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc8206110b0 sp=0xc820611088
runtime.netpollblock(0x7e36ba8, 0xffffff0000000072, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:338 +0x15e fp=0xc8206110f8 sp=0xc8206110b0
net.runtime_pollWait(0x7e36ba8, 0x72, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:157 +0x60 fp=0xc820611118 sp=0xc8206110f8
net.(*pollDesc).Wait(0xc9cabc1c60, 0x72, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:73 +0x3a fp=0xc820611138 sp=0xc820611118
net.(*pollDesc).WaitRead(0xc9cabc1c60, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:78 +0x36 fp=0xc820611160 sp=0xc820611138
net.(*netFD).Read(0xc9cabc1c00, 0xc9cabf8800, 0x400, 0x400, 0x0, 0xaa0050, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_unix.go:232 +0x23a fp=0xc820611230 sp=0xc820611160
net.(*conn).Read(0xc8203b8000, 0xc9cabf8800, 0x400, 0x400, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/net.go:172 +0xe4 fp=0xc820611298 sp=0xc820611230
crypto/tls.(*block).readFromUntil(0xc8204f0450, 0xe40050, 0xc8203b8000, 0x5, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:455 +0xcc fp=0xc820611300 sp=0xc820611298
crypto/tls.(*Conn).readRecord(0xc820362000, 0x16, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:540 +0x2d1 fp=0xc820611830 sp=0xc820611300
crypto/tls.(*Conn).readHandshake(0xc820362000, 0x0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:776 +0xd3 fp=0xc820611a20 sp=0xc820611830
crypto/tls.(*Conn).clientHandshake(0xc820362000, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/handshake_client.go:142 +0xf77 fp=0xc820611f08 sp=0xc820611a20
crypto/tls.(*Conn).Handshake(0xc820362000, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:974 +0xec fp=0xc820611f48 sp=0xc820611f08
net/http.(*Transport).dialConn.func3(0xc820362000, 0xc8fe094280, 0xc82016dce0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:662 +0x21 fp=0xc820611f88 sp=0xc820611f48
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820611f90 sp=0xc820611f88
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:667 +0x7bc

goroutine 4403439 [select]:
runtime.gopark(0x58bbd0, 0xc820614f10, 0x4ca198, 0x6, 0xc81ffd9018, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820614c78 sp=0xc820614c50
runtime.selectgoImpl(0xc820614f10, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc820614e20 sp=0xc820614c78
runtime.selectgo(0xc820614f10)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc820614e40 sp=0xc820614e20
net/http.(*persistConn).writeLoop(0xc82040ce70)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1009 +0x40c fp=0xc820614fa8 sp=0xc820614e40
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820614fb0 sp=0xc820614fa8
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:686 +0xc9d

goroutine 4403724 [select]:
runtime.gopark(0x58bbd0, 0xc8200aef10, 0x4ca198, 0x6, 0x18, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc8200aec78 sp=0xc8200aec50
runtime.selectgoImpl(0xc8200aef10, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc8200aee20 sp=0xc8200aec78
runtime.selectgo(0xc8200aef10)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc8200aee40 sp=0xc8200aee20
net/http.(*persistConn).writeLoop(0xc8204906e0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1009 +0x40c fp=0xc8200aefa8 sp=0xc8200aee40
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8200aefb0 sp=0xc8200aefa8
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:686 +0xc9d

goroutine 4402018 [chan receive]:
runtime.gopark(0x58bb98, 0xc97e86f318, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc993377630 sp=0xc993377608
runtime.goparkunlock(0xc97e86f318, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc993377668 sp=0xc993377630
runtime.chanrecv(0x382fc0, 0xc97e86f2c0, 0xc993377788, 0x36301, 0xc820500000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:448 +0x472 fp=0xc993377728 sp=0xc993377668
runtime.chanrecv1(0x382fc0, 0xc97e86f2c0, 0xc993377788)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:349 +0x2b fp=0xc993377758 sp=0xc993377728
net/http.(*Transport).getConn.func2.1(0xc97e86f2c0, 0xc820090090, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:536 +0x4c fp=0xc9933777a8 sp=0xc993377758
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc9933777b0 sp=0xc9933777a8
created by net/http.(*Transport).getConn.func2
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:542 +0x77

goroutine 4403530 [select]:
runtime.gopark(0x58bbd0, 0xc820615f10, 0x4ca198, 0x6, 0xd8418, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820615c78 sp=0xc820615c50
runtime.selectgoImpl(0xc820615f10, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc820615e20 sp=0xc820615c78
runtime.selectgo(0xc820615f10)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc820615e40 sp=0xc820615e20
net/http.(*persistConn).writeLoop(0xc820660420)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1009 +0x40c fp=0xc820615fa8 sp=0xc820615e40
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820615fb0 sp=0xc820615fa8
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:686 +0xc9d

goroutine 4401905 [chan receive]:
runtime.gopark(0x58bb98, 0xc989471798, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc993395888 sp=0xc993395860
runtime.goparkunlock(0xc989471798, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc9933958c0 sp=0xc993395888
runtime.chanrecv(0x382960, 0xc989471740, 0xc993395cf8, 0xc993395901, 0x170000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:505 +0x901 fp=0xc993395980 sp=0xc9933958c0
runtime.chanrecv1(0x382960, 0xc989471740, 0xc993395cf8)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:349 +0x2b fp=0xc9933959b0 sp=0xc993395980
net/http.(*Transport).dialConn(0xc820090090, 0x0, 0xc8205027e0, 0x5, 0xc8204fa5c0, 0x1e, 0x3639d, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:668 +0x7f8 fp=0xc993395ef0 sp=0xc9933959b0
net/http.(*Transport).getConn.func4(0xc820090090, 0x0, 0xc8205027e0, 0x5, 0xc8204fa5c0, 0x1e, 0xc97e86f2c0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:549 +0x66 fp=0xc993395f68 sp=0xc993395ef0
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc993395f70 sp=0xc993395f68
created by net/http.(*Transport).getConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:551 +0x265

goroutine 4403705 [IO wait]:
runtime.gopark(0x58bb58, 0x7eb7dd0, 0x4c6350, 0x7, 0xfe51b, 0x5)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc97e8e7360 sp=0xc97e8e7338
runtime.netpollblock(0x7eb7da8, 0xffffff0000000072, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:338 +0x15e fp=0xc97e8e73a8 sp=0xc97e8e7360
net.runtime_pollWait(0x7eb7da8, 0x72, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:157 +0x60 fp=0xc97e8e73c8 sp=0xc97e8e73a8
net.(*pollDesc).Wait(0xc82011f1e0, 0x72, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:73 +0x3a fp=0xc97e8e73e8 sp=0xc97e8e73c8
net.(*pollDesc).WaitRead(0xc82011f1e0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:78 +0x36 fp=0xc97e8e7410 sp=0xc97e8e73e8
net.(*netFD).Read(0xc82011f180, 0xc9caaf8000, 0x2000, 0x2000, 0x0, 0xaa0050, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_unix.go:232 +0x23a fp=0xc97e8e74e0 sp=0xc97e8e7410
net.(*conn).Read(0xc8200300e0, 0xc9caaf8000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/net.go:172 +0xe4 fp=0xc97e8e7548 sp=0xc97e8e74e0
crypto/tls.(*block).readFromUntil(0xc8204f0f60, 0xe40050, 0xc8200300e0, 0x5, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:455 +0xcc fp=0xc97e8e75b0 sp=0xc97e8e7548
crypto/tls.(*Conn).readRecord(0xc9cac14580, 0x58bc17, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:540 +0x2d1 fp=0xc97e8e7ae0 sp=0xc97e8e75b0
crypto/tls.(*Conn).Read(0xc9cac14580, 0xc8204fd000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:901 +0x167 fp=0xc97e8e7be0 sp=0xc97e8e7ae0
net/http.noteEOFReader.Read(0xe0e708, 0xc9cac14580, 0xc8204901b8, 0xc8204fd000, 0x1000, 0x1000, 0xc8202a1b00, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1370 +0x67 fp=0xc97e8e7c30 sp=0xc97e8e7be0
net/http.(*noteEOFReader).Read(0xc8204c0cc0, 0xc8204fd000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    <autogenerated>:126 +0xd0 fp=0xc97e8e7c80 sp=0xc97e8e7c30
bufio.(*Reader).fill(0xc82016c480)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:97 +0x1e9 fp=0xc97e8e7d40 sp=0xc97e8e7c80
bufio.(*Reader).Peek(0xc82016c480, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:132 +0xcc fp=0xc97e8e7d50 sp=0xc97e8e7d40
net/http.(*persistConn).readLoop(0xc820490160)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:876 +0xf7 fp=0xc97e8e7f98 sp=0xc97e8e7d50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc97e8e7fa0 sp=0xc97e8e7f98
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:685 +0xc78

goroutine 4403706 [select]:
runtime.gopark(0x58bbd0, 0xc820625f10, 0x4ca198, 0x6, 0xc81ffdd418, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820625c78 sp=0xc820625c50
runtime.selectgoImpl(0xc820625f10, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc820625e20 sp=0xc820625c78
runtime.selectgo(0xc820625f10)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc820625e40 sp=0xc820625e20
net/http.(*persistConn).writeLoop(0xc820490160)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1009 +0x40c fp=0xc820625fa8 sp=0xc820625e40
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820625fb0 sp=0xc820625fa8
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:686 +0xc9d

goroutine 4402038 [IO wait]:
runtime.gopark(0x58bb58, 0x7e37590, 0x4c6350, 0x7, 0xfe51b, 0x5)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc8201d69f8 sp=0xc8201d69d0
runtime.netpollblock(0x7e37568, 0xffffff0000000072, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:338 +0x15e fp=0xc8201d6a40 sp=0xc8201d69f8
net.runtime_pollWait(0x7e37568, 0x72, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:157 +0x60 fp=0xc8201d6a60 sp=0xc8201d6a40
net.(*pollDesc).Wait(0xc8200fbfe0, 0x72, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:73 +0x3a fp=0xc8201d6a80 sp=0xc8201d6a60
net.(*pollDesc).WaitRead(0xc8200fbfe0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:78 +0x36 fp=0xc8201d6aa8 sp=0xc8201d6a80
net.(*netFD).Read(0xc8200fbf80, 0xc8201cab0a, 0x14f6, 0x14f6, 0x0, 0xaa0050, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_unix.go:232 +0x23a fp=0xc8201d6b78 sp=0xc8201d6aa8
net.(*conn).Read(0xc82018a168, 0xc8201cab0a, 0x14f6, 0x14f6, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/net.go:172 +0xe4 fp=0xc8201d6be0 sp=0xc8201d6b78
crypto/tls.(*block).readFromUntil(0xc921f58090, 0xe40050, 0xc82018a168, 0x1028, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:455 +0xcc fp=0xc8201d6c48 sp=0xc8201d6be0
crypto/tls.(*Conn).readRecord(0xc8202e0580, 0xc820171e16, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:583 +0xccf fp=0xc8201d7178 sp=0xc8201d6c48
crypto/tls.(*Conn).readHandshake(0xc8202e0580, 0x0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:776 +0xd3 fp=0xc8201d7368 sp=0xc8201d7178
crypto/tls.(*clientHandshakeState).doFullHandshake(0xc8201d7e58, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/handshake_client.go:236 +0x6c fp=0xc8201d7a20 sp=0xc8201d7368
crypto/tls.(*Conn).clientHandshake(0xc8202e0580, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/handshake_client.go:206 +0x164e fp=0xc8201d7f08 sp=0xc8201d7a20
crypto/tls.(*Conn).Handshake(0xc8202e0580, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:974 +0xec fp=0xc8201d7f48 sp=0xc8201d7f08
net/http.(*Transport).dialConn.func3(0xc8202e0580, 0xc93df9b100, 0xc989471740)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:662 +0x21 fp=0xc8201d7f88 sp=0xc8201d7f48
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8201d7f90 sp=0xc8201d7f88
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:667 +0x7bc

goroutine 4403690 [select]:
runtime.gopark(0x58bbd0, 0xc9cac35510, 0x4ca198, 0x6, 0xc81ffde518, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc9cac35178 sp=0xc9cac35150
runtime.selectgoImpl(0xc9cac35510, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc9cac35320 sp=0xc9cac35178
runtime.selectgo(0xc9cac35510)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc9cac35340 sp=0xc9cac35320
net/http.(*persistConn).roundTrip(0xc820490160, 0xc820457a80, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1164 +0xb0d fp=0xc9cac35658 sp=0xc9cac35340
net/http.(*Transport).RoundTrip(0xc820090090, 0xc8205029a0, 0x22, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:235 +0x530 fp=0xc9cac35778 sp=0xc9cac35658
github.com/minio/mc/vendor/github.com/minio/minio-go.(*request).Do(0xca1e4a1950, 0xc820428503, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/request.go:324 +0x9e fp=0xc9cac357b8 sp=0xc9cac35778
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV1.getObject(0xc979206d00, 0xc820428503, 0x1d, 0xc820428521, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v1.go:656 +0x1b3 fp=0xc9cac359f0 sp=0xc9cac357b8
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV2.GetPartialObject(0xc979206d00, 0xc820428503, 0x1d, 0xc820428521, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v2.go:260 +0x1cf fp=0xc9cac35b70 sp=0xc9cac359f0
github.com/minio/mc/pkg/client/s3.(*s3Client).GetObject(0xc82048a180, 0x0, 0x0, 0x0, 0x0, 0xc820578f08, 0xc820456f01)
    /Users/harsha/mygo/src/github.com/minio/mc/pkg/client/s3/s3.go:96 +0xda fp=0xc9cac35d20 sp=0xc9cac35b70
main.getSource(0xc8204284e0, 0xd0, 0x0, 0x0, 0xc820456f60, 0xc820502700)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:57 +0xb7 fp=0xc9cac35d70 sp=0xc9cac35d20
main.doMirror(0xc9af8f9a80, 0xc8204b9da0, 0x1, 0x4, 0x0, 0xc97e952b10, 0xc97e958000, 0xc97e952b50, 0xc97e86fce0)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:98 +0x285 fp=0xc9cac35f58 sp=0xc9cac35d70
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc9cac35f60 sp=0xc9cac35f58
created by main.doMirrorCmdSession.func2
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:294 +0x3d0

goroutine 4403529 [IO wait]:
runtime.gopark(0x58bb58, 0x7eb8910, 0x4c6350, 0x7, 0xfe51b, 0x5)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xca46a23360 sp=0xca46a23338
runtime.netpollblock(0x7eb88e8, 0xffffff0000000072, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:338 +0x15e fp=0xca46a233a8 sp=0xca46a23360
net.runtime_pollWait(0x7eb88e8, 0x72, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:157 +0x60 fp=0xca46a233c8 sp=0xca46a233a8
net.(*pollDesc).Wait(0xc8200fb640, 0x72, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:73 +0x3a fp=0xca46a233e8 sp=0xca46a233c8
net.(*pollDesc).WaitRead(0xc8200fb640, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:78 +0x36 fp=0xca46a23410 sp=0xca46a233e8
net.(*netFD).Read(0xc8200fb5e0, 0xc82019e000, 0x2000, 0x2000, 0x0, 0xaa0050, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_unix.go:232 +0x23a fp=0xca46a234e0 sp=0xca46a23410
net.(*conn).Read(0xc8203b8010, 0xc82019e000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/net.go:172 +0xe4 fp=0xca46a23548 sp=0xca46a234e0
crypto/tls.(*block).readFromUntil(0xc83fa99560, 0xe40050, 0xc8203b8010, 0x5, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:455 +0xcc fp=0xca46a235b0 sp=0xca46a23548
crypto/tls.(*Conn).readRecord(0xc820234000, 0x58bc17, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:540 +0x2d1 fp=0xca46a23ae0 sp=0xca46a235b0
crypto/tls.(*Conn).Read(0xc820234000, 0xc8205cf000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:901 +0x167 fp=0xca46a23be0 sp=0xca46a23ae0
net/http.noteEOFReader.Read(0xe0e708, 0xc820234000, 0xc820660478, 0xc8205cf000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1370 +0x67 fp=0xca46a23c30 sp=0xca46a23be0
net/http.(*noteEOFReader).Read(0xc8203c41c0, 0xc8205cf000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    <autogenerated>:126 +0xd0 fp=0xca46a23c80 sp=0xca46a23c30
bufio.(*Reader).fill(0xc8204daae0)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:97 +0x1e9 fp=0xca46a23d40 sp=0xca46a23c80
bufio.(*Reader).Peek(0xc8204daae0, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:132 +0xcc fp=0xca46a23d50 sp=0xca46a23d40
net/http.(*persistConn).readLoop(0xc820660420)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:876 +0xf7 fp=0xca46a23f98 sp=0xca46a23d50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xca46a23fa0 sp=0xca46a23f98
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:685 +0xc78

goroutine 4403648 [select]:
runtime.gopark(0x58bbd0, 0xc820657510, 0x4ca198, 0x6, 0xc81ffd9a18, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820657178 sp=0xc820657150
runtime.selectgoImpl(0xc820657510, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc820657320 sp=0xc820657178
runtime.selectgo(0xc820657510)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc820657340 sp=0xc820657320
net/http.(*persistConn).roundTrip(0xc8204904d0, 0xc820497ac0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1164 +0xb0d fp=0xc820657658 sp=0xc820657340
net/http.(*Transport).RoundTrip(0xc820090090, 0xc82043a2a0, 0x22, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:235 +0x530 fp=0xc820657778 sp=0xc820657658
github.com/minio/mc/vendor/github.com/minio/minio-go.(*request).Do(0xc8560b5110, 0xc8200b00f3, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/request.go:324 +0x9e fp=0xc8206577b8 sp=0xc820657778
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV1.getObject(0xc97e8d2500, 0xc8200b00f3, 0x1d, 0xc8200b0111, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v1.go:656 +0x1b3 fp=0xc8206579f0 sp=0xc8206577b8
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV2.GetPartialObject(0xc97e8d2500, 0xc8200b00f3, 0x1d, 0xc8200b0111, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v2.go:260 +0x1cf fp=0xc820657b70 sp=0xc8206579f0
github.com/minio/mc/pkg/client/s3.(*s3Client).GetObject(0xc8204ca260, 0x0, 0x0, 0x0, 0x0, 0xc820578708, 0xc820496c01)
    /Users/harsha/mygo/src/github.com/minio/mc/pkg/client/s3/s3.go:96 +0xda fp=0xc820657d20 sp=0xc820657b70
main.getSource(0xc8200b00d0, 0xd0, 0x0, 0x0, 0xc820496c70, 0xc82043a0e0)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:57 +0xb7 fp=0xc820657d70 sp=0xc820657d20
main.doMirror(0xca2b3c27c0, 0xc8203edaa0, 0x1, 0x4, 0x0, 0xc97e952b10, 0xc97e958000, 0xc97e952b50, 0xc97e86fce0)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:98 +0x285 fp=0xc820657f58 sp=0xc820657d70
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820657f60 sp=0xc820657f58
created by main.doMirrorCmdSession.func2
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:294 +0x3d0

goroutine 4403723 [IO wait]:
runtime.gopark(0x58bb58, 0xa103ac8, 0x4c6350, 0x7, 0xfe51b, 0x5)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820135360 sp=0xc820135338
runtime.netpollblock(0xa103aa0, 0xffffff0000000072, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:338 +0x15e fp=0xc8201353a8 sp=0xc820135360
net.runtime_pollWait(0xa103aa0, 0x72, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:157 +0x60 fp=0xc8201353c8 sp=0xc8201353a8
net.(*pollDesc).Wait(0xc820301b80, 0x72, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:73 +0x3a fp=0xc8201353e8 sp=0xc8201353c8
net.(*pollDesc).WaitRead(0xc820301b80, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:78 +0x36 fp=0xc820135410 sp=0xc8201353e8
net.(*netFD).Read(0xc820301b20, 0xc8201b2000, 0x2000, 0x2000, 0x0, 0xaa0050, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_unix.go:232 +0x23a fp=0xc8201354e0 sp=0xc820135410
net.(*conn).Read(0xc94c2f6000, 0xc8201b2000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/net.go:172 +0xe4 fp=0xc820135548 sp=0xc8201354e0
crypto/tls.(*block).readFromUntil(0xc921f58b10, 0xe40050, 0xc94c2f6000, 0x5, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:455 +0xcc fp=0xc8201355b0 sp=0xc820135548
crypto/tls.(*Conn).readRecord(0xc946b04840, 0x58bc17, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:540 +0x2d1 fp=0xc820135ae0 sp=0xc8201355b0
crypto/tls.(*Conn).Read(0xc946b04840, 0xc820271000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:901 +0x167 fp=0xc820135be0 sp=0xc820135ae0
net/http.noteEOFReader.Read(0xe0e708, 0xc946b04840, 0xc820490738, 0xc820271000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1370 +0x67 fp=0xc820135c30 sp=0xc820135be0
net/http.(*noteEOFReader).Read(0xc82040b460, 0xc820271000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    <autogenerated>:126 +0xd0 fp=0xc820135c80 sp=0xc820135c30
bufio.(*Reader).fill(0xc8204da540)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:97 +0x1e9 fp=0xc820135d40 sp=0xc820135c80
bufio.(*Reader).Peek(0xc8204da540, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/bufio/bufio.go:132 +0xcc fp=0xc820135d50 sp=0xc820135d40
net/http.(*persistConn).readLoop(0xc8204906e0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:876 +0xf7 fp=0xc820135f98 sp=0xc820135d50
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820135fa0 sp=0xc820135f98
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:685 +0xc78

goroutine 4403628 [select]:
runtime.gopark(0x58bbd0, 0xc820042f10, 0x4ca198, 0x6, 0xc81ffd8518, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820042c78 sp=0xc820042c50
runtime.selectgoImpl(0xc820042f10, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc820042e20 sp=0xc820042c78
runtime.selectgo(0xc820042f10)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc820042e40 sp=0xc820042e20
net/http.(*persistConn).writeLoop(0xc82040d130)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1009 +0x40c fp=0xc820042fa8 sp=0xc820042e40
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820042fb0 sp=0xc820042fa8
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:686 +0xc9d

goroutine 4403307 [select]:
runtime.gopark(0x58bbd0, 0xc8200aced8, 0x4ca198, 0x6, 0xc81ffd9118, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc8200acb98 sp=0xc8200acb70
runtime.selectgoImpl(0xc8200aced8, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc8200acd40 sp=0xc8200acb98
runtime.selectgo(0xc8200aced8)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc8200acd60 sp=0xc8200acd40
net/http.(*persistConn).readLoop(0xc82040c580)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:976 +0xac7 fp=0xc8200acfa8 sp=0xc8200acd60
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8200acfb0 sp=0xc8200acfa8
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:685 +0xc78

goroutine 4403766 [select]:
runtime.gopark(0x58bbd0, 0xca46a25510, 0x4ca198, 0x6, 0xc81ffdad18, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xca46a25178 sp=0xca46a25150
runtime.selectgoImpl(0xca46a25510, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xca46a25320 sp=0xca46a25178
runtime.selectgo(0xca46a25510)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xca46a25340 sp=0xca46a25320
net/http.(*persistConn).roundTrip(0xc820660420, 0xc8204c92b0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1164 +0xb0d fp=0xca46a25658 sp=0xca46a25340
net/http.(*Transport).RoundTrip(0xc820090090, 0xc8204ace00, 0x22, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:235 +0x530 fp=0xca46a25778 sp=0xca46a25658
github.com/minio/mc/vendor/github.com/minio/minio-go.(*request).Do(0xc9c78aeb10, 0xc94db8c1c3, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/request.go:324 +0x9e fp=0xca46a257b8 sp=0xca46a25778
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV1.getObject(0xc9cabc9200, 0xc94db8c1c3, 0x1d, 0xc94db8c1e1, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v1.go:656 +0x1b3 fp=0xca46a259f0 sp=0xca46a257b8
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV2.GetPartialObject(0xc9cabc9200, 0xc94db8c1c3, 0x1d, 0xc94db8c1e1, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v2.go:260 +0x1cf fp=0xca46a25b70 sp=0xca46a259f0
github.com/minio/mc/pkg/client/s3.(*s3Client).GetObject(0xc8204a4cc0, 0x0, 0x0, 0x0, 0x0, 0xc820179708, 0xc8204c8301)
    /Users/harsha/mygo/src/github.com/minio/mc/pkg/client/s3/s3.go:96 +0xda fp=0xca46a25d20 sp=0xca46a25b70
main.getSource(0xc94db8c1a0, 0xd0, 0x0, 0x0, 0xc8204c8350, 0xc8204acb60)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:57 +0xb7 fp=0xca46a25d70 sp=0xca46a25d20
main.doMirror(0xc97989e680, 0xc97e9171e0, 0x1, 0x4, 0x0, 0xc97e952b10, 0xc97e958000, 0xc97e952b50, 0xc97e86fce0)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:98 +0x285 fp=0xca46a25f58 sp=0xca46a25d70
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xca46a25f60 sp=0xca46a25f58
created by main.doMirrorCmdSession.func2
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:294 +0x3d0

goroutine 4403763 [select]:
runtime.gopark(0x58bbd0, 0xc8205cd510, 0x4ca198, 0x6, 0xc81ffda818, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc8205cd178 sp=0xc8205cd150
runtime.selectgoImpl(0xc8205cd510, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc8205cd320 sp=0xc8205cd178
runtime.selectgo(0xc8205cd510)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc8205cd340 sp=0xc8205cd320
net/http.(*persistConn).roundTrip(0xc8204906e0, 0xc820507d10, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1164 +0xb0d fp=0xc8205cd658 sp=0xc8205cd340
net/http.(*Transport).RoundTrip(0xc820090090, 0xc8204ac380, 0x22, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:235 +0x530 fp=0xc8205cd778 sp=0xc8205cd658
github.com/minio/mc/vendor/github.com/minio/minio-go.(*request).Do(0xc8203c9380, 0xc8204280f3, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/request.go:324 +0x9e fp=0xc8205cd7b8 sp=0xc8205cd778
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV1.getObject(0xc9cabc8400, 0xc8204280f3, 0x1d, 0xc820428111, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v1.go:656 +0x1b3 fp=0xc8205cd9f0 sp=0xc8205cd7b8
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV2.GetPartialObject(0xc9cabc8400, 0xc8204280f3, 0x1d, 0xc820428111, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v2.go:260 +0x1cf fp=0xc8205cdb70 sp=0xc8205cd9f0
github.com/minio/mc/pkg/client/s3.(*s3Client).GetObject(0xc8204ae400, 0x0, 0x0, 0x0, 0x0, 0xc82002bf08, 0xc820506d01)
    /Users/harsha/mygo/src/github.com/minio/mc/pkg/client/s3/s3.go:96 +0xda fp=0xc8205cdd20 sp=0xc8205cdb70
main.getSource(0xc8204280d0, 0xd0, 0x0, 0x0, 0xc820506d40, 0xc8204ac1c0)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:57 +0xb7 fp=0xc8205cdd70 sp=0xc8205cdd20
main.doMirror(0xc9af8f88c0, 0xc8204c1400, 0x1, 0x4, 0x0, 0xc97e952b10, 0xc97e958000, 0xc97e952b50, 0xc97e86fce0)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:98 +0x285 fp=0xc8205cdf58 sp=0xc8205cdd70
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8205cdf60 sp=0xc8205cdf58
created by main.doMirrorCmdSession.func2
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:294 +0x3d0

goroutine 4403000 [select]:
runtime.gopark(0x58bbd0, 0xc820618f10, 0x4ca198, 0x6, 0xc81ffdab18, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820618c78 sp=0xc820618c50
runtime.selectgoImpl(0xc820618f10, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc820618e20 sp=0xc820618c78
runtime.selectgo(0xc820618f10)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc820618e40 sp=0xc820618e20
net/http.(*persistConn).writeLoop(0xc8204904d0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1009 +0x40c fp=0xc820618fa8 sp=0xc820618e40
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820618fb0 sp=0xc820618fa8
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:686 +0xc9d

goroutine 4401812 [chan receive]:
runtime.gopark(0x58bb98, 0xc82016dd38, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc8205c7888 sp=0xc8205c7860
runtime.goparkunlock(0xc82016dd38, 0x4d3960, 0xc, 0x1c000000000017, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc8205c78c0 sp=0xc8205c7888
runtime.chanrecv(0x382960, 0xc82016dce0, 0xc8205c7cf8, 0xc8205c7901, 0x170000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:505 +0x901 fp=0xc8205c7980 sp=0xc8205c78c0
runtime.chanrecv1(0x382960, 0xc82016dce0, 0xc8205c7cf8)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:349 +0x2b fp=0xc8205c79b0 sp=0xc8205c7980
net/http.(*Transport).dialConn(0xc820090090, 0x0, 0xc8204ac000, 0x5, 0xc8204f6140, 0x1e, 0xc820030040, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:668 +0x7f8 fp=0xc8205c7ef0 sp=0xc8205c79b0
net/http.(*Transport).getConn.func4(0xc820090090, 0x0, 0xc8204ac000, 0x5, 0xc8204f6140, 0x1e, 0xc8200eba40)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:549 +0x66 fp=0xc8205c7f68 sp=0xc8205c7ef0
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8205c7f70 sp=0xc8205c7f68
created by net/http.(*Transport).getConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:551 +0x265

goroutine 4401968 [chan receive]:
runtime.gopark(0x58bb98, 0xc97e8c1a38, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xca069a7888 sp=0xca069a7860
runtime.goparkunlock(0xc97e8c1a38, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xca069a78c0 sp=0xca069a7888
runtime.chanrecv(0x382960, 0xc97e8c19e0, 0xca069a7cf8, 0xca069a7901, 0x170000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:505 +0x901 fp=0xca069a7980 sp=0xca069a78c0
runtime.chanrecv1(0x382960, 0xc97e8c19e0, 0xca069a7cf8)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:349 +0x2b fp=0xca069a79b0 sp=0xca069a7980
net/http.(*Transport).dialConn(0xc820090090, 0x0, 0xc82043b5e0, 0x5, 0xc8204e5700, 0x1e, 0x3639d, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:668 +0x7f8 fp=0xca069a7ef0 sp=0xca069a79b0
net/http.(*Transport).getConn.func4(0xc820090090, 0x0, 0xc82043b5e0, 0x5, 0xc8204e5700, 0x1e, 0xc989470b40)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:549 +0x66 fp=0xca069a7f68 sp=0xca069a7ef0
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xca069a7f70 sp=0xca069a7f68
created by net/http.(*Transport).getConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:551 +0x265

goroutine 4401846 [IO wait]:
runtime.gopark(0x58bb58, 0x7e36f90, 0x4c6350, 0x7, 0xfe51b, 0x5)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc82060f0b0 sp=0xc82060f088
runtime.netpollblock(0x7e36f68, 0xffffff0000000072, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:338 +0x15e fp=0xc82060f0f8 sp=0xc82060f0b0
net.runtime_pollWait(0x7e36f68, 0x72, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/netpoll.go:157 +0x60 fp=0xc82060f118 sp=0xc82060f0f8
net.(*pollDesc).Wait(0xc8204e6220, 0x72, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:73 +0x3a fp=0xc82060f138 sp=0xc82060f118
net.(*pollDesc).WaitRead(0xc8204e6220, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_poll_runtime.go:78 +0x36 fp=0xc82060f160 sp=0xc82060f138
net.(*netFD).Read(0xc8204e61c0, 0xc820265000, 0x400, 0x400, 0x0, 0xaa0050, 0xc820010190)
    /usr/local/Cellar/go/1.5/libexec/src/net/fd_unix.go:232 +0x23a fp=0xc82060f230 sp=0xc82060f160
net.(*conn).Read(0xc8203bc008, 0xc820265000, 0x400, 0x400, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/net.go:172 +0xe4 fp=0xc82060f298 sp=0xc82060f230
crypto/tls.(*block).readFromUntil(0xc921f59110, 0xe40050, 0xc8203bc008, 0x5, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:455 +0xcc fp=0xc82060f300 sp=0xc82060f298
crypto/tls.(*Conn).readRecord(0xc82032c2c0, 0x16, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:540 +0x2d1 fp=0xc82060f830 sp=0xc82060f300
crypto/tls.(*Conn).readHandshake(0xc82032c2c0, 0x0, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:776 +0xd3 fp=0xc82060fa20 sp=0xc82060f830
crypto/tls.(*Conn).clientHandshake(0xc82032c2c0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/handshake_client.go:142 +0xf77 fp=0xc82060ff08 sp=0xc82060fa20
crypto/tls.(*Conn).Handshake(0xc82032c2c0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/crypto/tls/conn.go:974 +0xec fp=0xc82060ff48 sp=0xc82060ff08
net/http.(*Transport).dialConn.func3(0xc82032c2c0, 0xc97989f340, 0xc97e8c19e0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:662 +0x21 fp=0xc82060ff88 sp=0xc82060ff48
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc82060ff90 sp=0xc82060ff88
created by net/http.(*Transport).dialConn
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:667 +0x7bc

goroutine 4403748 [select]:
runtime.gopark(0x58bbd0, 0xc820137510, 0x4ca198, 0x6, 0xc81ffda318, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820137178 sp=0xc820137150
runtime.selectgoImpl(0xc820137510, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc820137320 sp=0xc820137178
runtime.selectgo(0xc820137510)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc820137340 sp=0xc820137320
net/http.(*persistConn).roundTrip(0xc82040ce70, 0xc8204ed770, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1164 +0xb0d fp=0xc820137658 sp=0xc820137340
net/http.(*Transport).RoundTrip(0xc820090090, 0xc820346460, 0x22, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:235 +0x530 fp=0xc820137778 sp=0xc820137658
github.com/minio/mc/vendor/github.com/minio/minio-go.(*request).Do(0xca06546c90, 0xc8200676e3, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/request.go:324 +0x9e fp=0xc8201377b8 sp=0xc820137778
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV1.getObject(0xc8202ccb00, 0xc8200676e3, 0x1d, 0xc820067701, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v1.go:656 +0x1b3 fp=0xc8201379f0 sp=0xc8201377b8
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV2.GetPartialObject(0xc8202ccb00, 0xc8200676e3, 0x1d, 0xc820067701, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v2.go:260 +0x1cf fp=0xc820137b70 sp=0xc8201379f0
github.com/minio/mc/pkg/client/s3.(*s3Client).GetObject(0xc8204c1a80, 0x0, 0x0, 0x0, 0x0, 0xc820572f08, 0xc8204ec901)
    /Users/harsha/mygo/src/github.com/minio/mc/pkg/client/s3/s3.go:96 +0xda fp=0xc820137d20 sp=0xc820137b70
main.getSource(0xc8200676c0, 0xd0, 0x0, 0x0, 0xc8204ec940, 0xc820347a40)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:57 +0xb7 fp=0xc820137d70 sp=0xc820137d20
main.doMirror(0xc9caaf7640, 0xc8204dcfa0, 0x1, 0x4, 0x0, 0xc97e952b10, 0xc97e958000, 0xc97e952b50, 0xc97e86fce0)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:98 +0x285 fp=0xc820137f58 sp=0xc820137d70
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820137f60 sp=0xc820137f58
created by main.doMirrorCmdSession.func2
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:294 +0x3d0

goroutine 4403744 [copystack]:
runtime.assertE2T2(0x390fa0, 0x390fa0, 0xc8204ba390, 0xc9933918f0, 0x1)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/iface.go:233 fp=0xc97e93d848 sp=0xc97e93d840
github.com/minio/mc/vendor/github.com/minio/minio/pkg/quick.(*config).Load(0xc820484240, 0xc820484200, 0x1e, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio/pkg/quick/quick.go:192 +0x485 fp=0xc97e93d938 sp=0xc97e93d848
main.getMcConfig(0x3, 0xc9f90067e0)
    /Users/harsha/mygo/src/github.com/minio/mc/config.go:140 +0x22e fp=0xc97e93d9b8 sp=0xc97e93d938
main.getHostConfig(0xc8200dccf0, 0x8f, 0x0, 0x0, 0x0, 0x0, 0xecd65ba17)
    /Users/harsha/mygo/src/github.com/minio/mc/hostconfig.go:33 +0x49 fp=0xc97e93dac8 sp=0xc97e93d9b8
main.url2Client(0xc8200dccf0, 0x8f, 0x0, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:171 +0x4f fp=0xc97e93db68 sp=0xc97e93dac8
main.target2Client(0xc8200dccf0, 0x8f, 0x0, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:193 +0x3b fp=0xc97e93dbc8 sp=0xc97e93db68
main.putTargets(0xc8204ba0a0, 0x1, 0x1, 0x1415, 0x7e30aa0, 0xc820484100, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:80 +0x104 fp=0xc97e93dd60 sp=0xc97e93dbc8
main.doMirror(0xc9a3b435c0, 0xc8204fa680, 0x1, 0x4, 0x0, 0xc97e952b10, 0xc97e958000, 0xc97e952b50, 0xc97e86fce0)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:126 +0x765 fp=0xc97e93df48 sp=0xc97e93dd60
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc97e93df50 sp=0xc97e93df48
created by main.doMirrorCmdSession.func2
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:294 +0x3d0

goroutine 4403751 [select]:
runtime.gopark(0x58bbd0, 0xc97e8e5510, 0x4ca198, 0x6, 0xc81ffd9118, 0x2)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc97e8e5178 sp=0xc97e8e5150
runtime.selectgoImpl(0xc97e8e5510, 0x0, 0x18)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:392 +0xa64 fp=0xc97e8e5320 sp=0xc97e8e5178
runtime.selectgo(0xc97e8e5510)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/select.go:212 +0x12 fp=0xc97e8e5340 sp=0xc97e8e5320
net/http.(*persistConn).roundTrip(0xc82040d130, 0xc8204f5000, 0x0, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:1164 +0xb0d fp=0xc97e8e5658 sp=0xc97e8e5340
net/http.(*Transport).RoundTrip(0xc820090090, 0xc820150000, 0x22, 0x0, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:235 +0x530 fp=0xc97e8e5778 sp=0xc97e8e5658
github.com/minio/mc/vendor/github.com/minio/minio-go.(*request).Do(0xc83fa98db0, 0xc94db8cb83, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/request.go:324 +0x9e fp=0xc97e8e57b8 sp=0xc97e8e5778
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV1.getObject(0xc8202cd000, 0xc94db8cb83, 0x1d, 0xc94db8cba1, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v1.go:656 +0x1b3 fp=0xc97e8e59f0 sp=0xc97e8e57b8
github.com/minio/mc/vendor/github.com/minio/minio-go.apiV2.GetPartialObject(0xc8202cd000, 0xc94db8cb83, 0x1d, 0xc94db8cba1, 0x8f, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio-go/api-v2.go:260 +0x1cf fp=0xc97e8e5b70 sp=0xc97e8e59f0
github.com/minio/mc/pkg/client/s3.(*s3Client).GetObject(0xc82049e480, 0x0, 0x0, 0x0, 0x0, 0xc820572f08, 0xc8204d4101)
    /Users/harsha/mygo/src/github.com/minio/mc/pkg/client/s3/s3.go:96 +0xda fp=0xc97e8e5d20 sp=0xc97e8e5b70
main.getSource(0xc94db8cb60, 0xd0, 0x0, 0x0, 0xc8204d4110, 0xc820346c40)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:57 +0xb7 fp=0xc97e8e5d70 sp=0xc97e8e5d20
main.doMirror(0xc97989f7c0, 0xc8204af9e0, 0x1, 0x4, 0x0, 0xc97e952b10, 0xc97e958000, 0xc97e952b50, 0xc97e86fce0)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:98 +0x285 fp=0xc97e8e5f58 sp=0xc97e8e5d70
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc97e8e5f60 sp=0xc97e8e5f58
created by main.doMirrorCmdSession.func2
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:294 +0x3d0

goroutine 4401969 [chan receive]:
runtime.gopark(0x58bb98, 0xc989470b98, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820172630 sp=0xc820172608
runtime.goparkunlock(0xc989470b98, 0x4d3960, 0xc, 0xc8204e5717, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc820172668 sp=0xc820172630
runtime.chanrecv(0x382fc0, 0xc989470b40, 0xc820172788, 0xc979204001, 0x7e30000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:448 +0x472 fp=0xc820172728 sp=0xc820172668
runtime.chanrecv1(0x382fc0, 0xc989470b40, 0xc820172788)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:349 +0x2b fp=0xc820172758 sp=0xc820172728
net/http.(*Transport).getConn.func2.1(0xc989470b40, 0xc820090090, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:536 +0x4c fp=0xc8201727a8 sp=0xc820172758
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8201727b0 sp=0xc8201727a8
created by net/http.(*Transport).getConn.func2
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:542 +0x77

goroutine 4401816 [chan receive]:
runtime.gopark(0x58bb98, 0xc8200eba98, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:185 +0x163 fp=0xc820574e30 sp=0xc820574e08
runtime.goparkunlock(0xc8200eba98, 0x4d3960, 0xc, 0x17, 0x3)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/proc.go:191 +0x54 fp=0xc820574e68 sp=0xc820574e30
runtime.chanrecv(0x382fc0, 0xc8200eba40, 0xc820574f88, 0x36301, 0xc97e950000)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:448 +0x472 fp=0xc820574f28 sp=0xc820574e68
runtime.chanrecv1(0x382fc0, 0xc8200eba40, 0xc820574f88)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/chan.go:349 +0x2b fp=0xc820574f58 sp=0xc820574f28
net/http.(*Transport).getConn.func2.1(0xc8200eba40, 0xc820090090, 0x0)
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:536 +0x4c fp=0xc820574fa8 sp=0xc820574f58
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820574fb0 sp=0xc820574fa8
created by net/http.(*Transport).getConn.func2
    /usr/local/Cellar/go/1.5/libexec/src/net/http/transport.go:542 +0x77
[tadhunt@Scarface smartreports]$ 
harshavardhana commented 9 years ago

@ExaTad - we have fixed this bug by moving our minimum Golang version requirement to 1.5.1.

This was a bug in Golang 1.5 where an interface{} conversion internally would lead to a bad stack pointer - https://github.com/golang/go/issues/12253

Relevant part from the the backtrace

goroutine 4403744 [copystack]:
runtime.assertE2T2(0x390fa0, 0x390fa0, 0xc8204ba390, 0xc9933918f0, 0x1)
    /usr/local/Cellar/go/1.5/libexec/src/runtime/iface.go:233 fp=0xc97e93d848 sp=0xc97e93d840
github.com/minio/mc/vendor/github.com/minio/minio/pkg/quick.(*config).Load(0xc820484240, 0xc820484200, 0x1e, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio/pkg/quick/quick.go:192 +0x485 fp=0xc97e93d938 sp=0xc97e93d848
main.getMcConfig(0x3, 0xc9f90067e0)
    /Users/harsha/mygo/src/github.com/minio/mc/config.go:140 +0x22e fp=0xc97e93d9b8 sp=0xc97e93d938
main.getHostConfig(0xc8200dccf0, 0x8f, 0x0, 0x0, 0x0, 0x0, 0xecd65ba17)
    /Users/harsha/mygo/src/github.com/minio/mc/hostconfig.go:33 +0x49 fp=0xc97e93dac8 sp=0xc97e93d9b8
main.url2Client(0xc8200dccf0, 0x8f, 0x0, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:171 +0x4f fp=0xc97e93db68 sp=0xc97e93dac8
main.target2Client(0xc8200dccf0, 0x8f, 0x0, 0x0, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:193 +0x3b fp=0xc97e93dbc8 sp=0xc97e93db68
main.putTargets(0xc8204ba0a0, 0x1, 0x1, 0x1415, 0x7e30aa0, 0xc820484100, 0x0)
    /Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:80 +0x104 fp=0xc97e93dd60 sp=0xc97e93dbc8
main.doMirror(0xc9a3b435c0, 0xc8204fa680, 0x1, 0x4, 0x0, 0xc97e952b10, 0xc97e958000, 0xc97e952b50, 0xc97e86fce0)
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:126 +0x765 fp=0xc97e93df48 sp=0xc97e93dd60
runtime.goexit()
    /usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc97e93df50 sp=0xc97e93df48
created by main.doMirrorCmdSession.func2
    /Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:294 +0x3d0
harshavardhana commented 9 years ago

@ExaTad - we didn't make a release yet but we will soon. I am going to update an experimental version ready.

Will be available shortly, you can check back on the version through following command.

$ mc update experimental
harshavardhana commented 9 years ago

I have updated the experimental base with new binaries, you can download them and let me know if you see the crash again. We have few more changes pending for the upcoming release which should happen by end of this week.

./mc update experimental

┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃  Update available:                                                                                                           ┃
┃  Run "mc cp https://dl.minio.io:9000/updates/experimental/2015/Sept/darwin-amd64/mc ./mc.new; chmod 755 ./mc.new" to update. ┃
┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛

Thanks for trying out mc

ExaTad commented 9 years ago

Thanks, I'll give it a try when I'm back in the office.

-Tad

harshavardhana commented 9 years ago

Tad were you able test the new binary ?

tadhunt commented 9 years ago

I finally had a chance to test the new binary. The crash is gone, but there were a bunch of mirror errors still. The internal error is worrying, I'm not confident it's actually copied the data, and I don't know which objects are missing. It would be great if the error message was more descriptive, and specified which objects failed to mirror...

[tadhunt@Scarface 2015-10-05]$ mc version
Version: Mon, 05 Oct 2015 17:52:35 GMT
Release-Tag: RELEASE.Mon-05-Oct-2015-17-52-35-GMT
[tadhunt@Scarface 2015-10-05]$ mc mirror https://s3-us-west-2.amazonaws.com/<bucket>/ .
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
...DD4FA4710B55FC7C0B5D0788C59E: 15.29 GB / 15.29 GB  ▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓  100.00 % 479.61 KB/s 9h17m10s
[tadhunt@Scarface 2015-10-05]$ 
harshavardhana commented 9 years ago

The internal error is worrying, I'm not confident it's actually copied the data, and I don't know which objects are missing.

The error is directly coming from Amazon S3 which i am not entirely sure why, i will add another keyword there to describe which source copy failed.

harshavardhana commented 9 years ago

1164 added an improvement, will be available when we make a proper release this week.

harshavardhana commented 9 years ago

Fixed by #1227 - closing this.

lock[bot] commented 4 years ago

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.