Closed ExaTad closed 9 years ago
@ExaTad - we have fixed this bug by moving our minimum Golang version requirement to 1.5.1.
This was a bug in Golang 1.5 where an interface{} conversion internally would lead to a bad stack pointer - https://github.com/golang/go/issues/12253
Relevant part from the the backtrace
goroutine 4403744 [copystack]:
runtime.assertE2T2(0x390fa0, 0x390fa0, 0xc8204ba390, 0xc9933918f0, 0x1)
/usr/local/Cellar/go/1.5/libexec/src/runtime/iface.go:233 fp=0xc97e93d848 sp=0xc97e93d840
github.com/minio/mc/vendor/github.com/minio/minio/pkg/quick.(*config).Load(0xc820484240, 0xc820484200, 0x1e, 0x0)
/Users/harsha/mygo/src/github.com/minio/mc/vendor/github.com/minio/minio/pkg/quick/quick.go:192 +0x485 fp=0xc97e93d938 sp=0xc97e93d848
main.getMcConfig(0x3, 0xc9f90067e0)
/Users/harsha/mygo/src/github.com/minio/mc/config.go:140 +0x22e fp=0xc97e93d9b8 sp=0xc97e93d938
main.getHostConfig(0xc8200dccf0, 0x8f, 0x0, 0x0, 0x0, 0x0, 0xecd65ba17)
/Users/harsha/mygo/src/github.com/minio/mc/hostconfig.go:33 +0x49 fp=0xc97e93dac8 sp=0xc97e93d9b8
main.url2Client(0xc8200dccf0, 0x8f, 0x0, 0x0, 0x0)
/Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:171 +0x4f fp=0xc97e93db68 sp=0xc97e93dac8
main.target2Client(0xc8200dccf0, 0x8f, 0x0, 0x0, 0x0)
/Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:193 +0x3b fp=0xc97e93dbc8 sp=0xc97e93db68
main.putTargets(0xc8204ba0a0, 0x1, 0x1, 0x1415, 0x7e30aa0, 0xc820484100, 0x0)
/Users/harsha/mygo/src/github.com/minio/mc/common-methods.go:80 +0x104 fp=0xc97e93dd60 sp=0xc97e93dbc8
main.doMirror(0xc9a3b435c0, 0xc8204fa680, 0x1, 0x4, 0x0, 0xc97e952b10, 0xc97e958000, 0xc97e952b50, 0xc97e86fce0)
/Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:126 +0x765 fp=0xc97e93df48 sp=0xc97e93dd60
runtime.goexit()
/usr/local/Cellar/go/1.5/libexec/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc97e93df50 sp=0xc97e93df48
created by main.doMirrorCmdSession.func2
/Users/harsha/mygo/src/github.com/minio/mc/mirror-main.go:294 +0x3d0
@ExaTad - we didn't make a release yet but we will soon. I am going to update an experimental version ready.
Will be available shortly, you can check back on the version through following command.
$ mc update experimental
I have updated the experimental base with new binaries, you can download them and let me know if you see the crash again. We have few more changes pending for the upcoming release which should happen by end of this week.
./mc update experimental
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Update available: ┃
┃ Run "mc cp https://dl.minio.io:9000/updates/experimental/2015/Sept/darwin-amd64/mc ./mc.new; chmod 755 ./mc.new" to update. ┃
┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛
Thanks for trying out mc
Thanks, I'll give it a try when I'm back in the office.
-Tad
Tad were you able test the new binary ?
I finally had a chance to test the new binary. The crash is gone, but there were a bunch of mirror errors still. The internal error is worrying, I'm not confident it's actually copied the data, and I don't know which objects are missing. It would be great if the error message was more descriptive, and specified which objects failed to mirror...
[tadhunt@Scarface 2015-10-05]$ mc version
Version: Mon, 05 Oct 2015 17:52:35 GMT
Release-Tag: RELEASE.Mon-05-Oct-2015-17-52-35-GMT
[tadhunt@Scarface 2015-10-05]$ mc mirror https://s3-us-west-2.amazonaws.com/<bucket>/ .
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. EOF
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
mc: <ERROR> Failed to mirror. We encountered an internal error. Please try again.
...DD4FA4710B55FC7C0B5D0788C59E: 15.29 GB / 15.29 GB ▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓ 100.00 % 479.61 KB/s 9h17m10s
[tadhunt@Scarface 2015-10-05]$
The internal error is worrying, I'm not confident it's actually copied the data, and I don't know which objects are missing.
The error is directly coming from Amazon S3 which i am not entirely sure why, i will add another keyword there to describe which source copy failed.
Fixed by #1227 - closing this.
This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.
"mc mirror" crashed attempting to mirror an AWS bucket with millions of files down to a local disk.