Open mjschmidt opened 2 years ago
kevkevinpal
commented
2 years ago Hey @mjschmidt are you still having this issue I would like to help, other than this log was there anything onscreen that you saw. Can you check to see if the sphinx relay service is still running on your myNode?
mjschmidt
commented
2 years ago Hi @kevkevinpal I am still having this issue. I will take a look a little later, thank you for reaching out. would it be preferable if I did an uninstall reinstall? I am sure I will have the same issue, but I may be able to grab earlier log files?
kevkevinpal
commented
2 years ago yea @mjschmidt a restart may help, I just see that line
Oct 23 08:15:07 myNode systemd[1]: Stopping Sphinx Relay...
which makes me think that relay stopped and the service isn't running anymore
mjschmidt
commented
2 years ago Okay thank you for the quick response, I will do this tonight and update you with the results.
Thanks! @kevkevinpal
mjschmidt
commented
2 years ago Sorry still haven't gotten to this, fully intend to.
mjschmidt
commented
2 years ago Still getting the same error from my static webpage load up, here are my logs. And they don't point to me being able to look into anything specifically.
-- Logs begin at Thu 2021-11-11 22:18:38 CST, end at Fri 2021-11-12 00:21:24 CST. --
Nov 12 00:21:24 myNode sphinxrelay[28838]: [lightning] [ 'pendingChannels' ]
Nov 12 00:21:24 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:21:23 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:20:53 myNode sphinxrelay[28838]: [lightning] [ 'pendingChannels' ]
Nov 12 00:20:53 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:20:53 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:20:24 myNode sphinxrelay[28838]: [lightning] [ 'pendingChannels' ]
Nov 12 00:20:24 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:20:23 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:19:54 myNode sphinxrelay[28838]: [lightning] [ 'pendingChannels' ]
Nov 12 00:19:53 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:19:53 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:19:24 myNode sphinxrelay[28838]: [lightning] [ 'pendingChannels' ]
Nov 12 00:19:23 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:19:23 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:18:54 myNode sphinxrelay[28838]: [lightning] [ 'pendingChannels' ]
Nov 12 00:18:53 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:18:53 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:18:23 myNode sphinxrelay[28838]: [lightning] [ 'pendingChannels' ]
Nov 12 00:18:23 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:18:23 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:18:18 myNode sphinxrelay[28838]: -> 2021-11-12 00:18:18: GET /static/sphinx-logo.png 304 3ms
Nov 12 00:18:17 myNode sphinxrelay[28838]: -> 2021-11-12 00:18:17: GET /static/js/qrious.js 200 9ms
Nov 12 00:18:17 myNode sphinxrelay[28838]: -> 2021-11-12 00:18:17: GET /static/sphinx-logo.png 200 7ms
Nov 12 00:18:17 myNode sphinxrelay[28838]: -> 2021-11-12 00:18:17: GET /static/ 200 17ms
Nov 12 00:17:53 myNode sphinxrelay[28838]: [lightning] [ 'pendingChannels' ]
Nov 12 00:17:53 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:17:53 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:17:23 myNode sphinxrelay[28838]: [lightning] [ 'pendingChannels' ]
Nov 12 00:17:23 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:17:23 myNode sphinxrelay[28838]: [lightning] [ 'listChannels' ]
Nov 12 00:16:54 myNode sphinxrelay[28838]: [tribes] subscribed! omitted on purpose/#
Nov 12 00:16:54 myNode sphinxrelay[28838]: [tribes] connected!
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]:
Nov 12 00:16:54 myNode sphinxrelay[28838]: Scan this QR in Sphinx app:
Nov 12 00:16:54 myNode sphinxrelay[28838]: >> this code does not work when i try to connect to sphinx
Nov 12 00:16:54 myNode sphinxrelay[28838]: => Relay version: , commit:
Nov 12 00:16:54 myNode sphinxrelay[28838]: [tribes] try to connect: tls://tribes.sphinx.chat:8883
Nov 12 00:16:54 myNode sphinxrelay[28838]: [lightning] [ 'signBuffer' ]
Nov 12 00:16:54 myNode sphinxrelay[28838]: >>> FINISH SETUP
Nov 12 00:16:54 myNode sphinxrelay[28838]: => [lightning] connected! 2021-11-12 00:16:54
Nov 12 00:16:53 myNode sphinxrelay[28838]: (node:28916) DeprecationWarning: grpc.load: Use the @grpc/proto-loader module with grpc.loadPackageDefinition instead
Nov 12 00:16:53 myNode sphinxrelay[28838]: Node listening on 53001.
Nov 12 00:16:53 myNode sphinxrelay[28838]: => 2021-11-12 00:16:53 [lightning] reconnecting... attempt #1
Nov 12 00:16:53 myNode sphinxrelay[28838]: Fri, 12 Nov 2021 06:16:53 GMT body-parser deprecated undefined extended: provide extended option at dist/app.js:80:25
Nov 12 00:16:53 myNode sphinxrelay[28838]: => [db] setup done
Nov 12 00:16:53 myNode sphinxrelay[28838]: => [db] done syncing
Nov 12 00:16:53 myNode sphinxrelay[28838]: => [db] sync now
Nov 12 00:16:53 myNode sphinxrelay[28838]: => [db] starting setup...
Nov 12 00:16:53 myNode sphinxrelay[28838]: => env: production
Nov 12 00:16:43 myNode sphinxrelay[28838]: > cp config/app.json dist/config/app.json && cp config/config.json dist/config/config.json && env NODE_ENV=production node dist/app.js
Nov 12 00:16:43 myNode sphinxrelay[28838]: > nodeapp@1.0.0 prod /opt/mynode/sphinxrelay
Nov 12 00:16:43 myNode systemd[1]: Started Sphinx Relay.
Nov 12 00:16:43 myNode sphinxrelay[28831]: + exit 0
Nov 12 00:16:43 myNode sphinxrelay[28831]: + sed -i 's/public_url": ".*/public_url": "omitted on purpose .onion:53001",/g' /mnt/hdd/mynode/sphinxrelay/app.json
Nov 12 00:16:43 myNode sphinxrelay[28831]: + '[' -f /mnt/hdd/mynode/sphinxrelay/app.json ']'
Nov 12 00:16:43 myNode sphinxrelay[28831]: + SPHINX_TOR_ADDR=omitted on purpose.onion
Nov 12 00:16:43 myNode sphinxrelay[28831]: ++ cat /var/lib/tor/mynode_sphinx/hostname
Nov 12 00:16:43 myNode sphinxrelay[28831]: + LOCAL_IP_ADDR=x.x.x.x omitted on purpose
Nov 12 00:16:43 myNode sphinxrelay[28831]: ++ head -n 1
Nov 12 00:16:43 myNode sphinxrelay[28831]: ++ cut '-d ' -f1
Nov 12 00:16:43 myNode sphinxrelay[28831]: ++ hostname -I
Nov 12 00:16:43 myNode sphinxrelay[28831]: + set -e
Nov 12 00:16:42 myNode sphinxrelay[28804]: "synced_to_chain": true,
Nov 12 00:16:42 myNode sphinxrelay[28804]: Checking if LND is synced...
Nov 12 00:16:42 myNode sphinxrelay[28803]: Not shutting down!
Nov 12 00:16:42 myNode sphinxrelay[28803]: Checking if device is shutting down...
Nov 12 00:16:42 myNode systemd[1]: Starting Sphinx Relay...
mjschmidt
commented
2 years ago Any advice here @kevkevinpal
kevkevinpal
commented
2 years ago Any advice here @kevkevinpal
Could you try connecting to the onion route with /app at the end and see if the word INDEX appears when the page loads?
mjschmidt
commented
2 years ago Yes I can try this later, thanks for the follow up. I was trying the page at /static and / path and I when I tried the / root path I got nothing and I wasn't sure what to do next.
kevkevinpal
commented
2 years ago Hmm okay so if you're unable to access the /app path and don't see INDEX then the service probably isn't running, there is probably some issue with how myNode is getting the service up. Do you know if others running on a MyNode were able to get their node running sphinx or do you think this is an isolated issue for you?
mjschmidt
commented
2 years ago I can open and reference this issue with myNode and see what they say.
kevkevinpal
commented
2 years ago I can open and reference this issue with myNode and see what they say.
Yea that would be great also if you're able to get it resolved please let us know it would be helpful in case someone else finds themself with the same issue :)
mjschmidt
commented
2 years ago Quick update on this, I do now see the word INDEX, but the QR code still shows CONNECTION_STRING as the address and when I manually enter the address it does not connect, I get
java.io IOException: Tor executable file not foundAnd a generate token failed message from the client. The client is the latest version available on the google andriod play store.
kevkevinpal
commented
2 years ago Quick update on this, I do now see the word INDEX, but the QR code still shows CONNECTION_STRING as the address and when I manually enter the address it does not connect, I get
java.io IOException: Tor executable file not foundAnd a generate token failed message from the client. The client is the latest version available on the google andriod play store.
Try downloading the app from the GitHub page there are some know issues with the tor library when downloaded from the playstore
mjschmidt
commented
2 years ago Looking at this more, it looks like my docker service continues to restart. Perhaps we should start there? I am not sure why it is not starting correctly and timing out. I've never seen this with docker before.
I tried to restart the node and service manually, but that did not resolve anything?
-- Logs begin at Tue 2021-11-30 19:31:49 CST, end at Tue 2021-11-30 20:03:16 CST. --
Nov 30 20:03:15 myNode dockerd[19681]: time="2021-11-30T20:03:15.013104318-06:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Nov 30 20:03:15 myNode dockerd[19681]: time="2021-11-30T20:03:15.013048170-06:00" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock 0 }] }" module=grpc
Nov 30 20:03:15 myNode dockerd[19681]: time="2021-11-30T20:03:15.012984967-06:00" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Nov 30 20:03:15 myNode dockerd[19681]: time="2021-11-30T20:03:15.012920912-06:00" level=info msg="parsed scheme: \"unix\"" module=grpc
Nov 30 20:03:15 myNode dockerd[19681]: time="2021-11-30T20:03:15.007961977-06:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Nov 30 20:03:15 myNode dockerd[19681]: time="2021-11-30T20:03:15.007911700-06:00" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock 0 }] }" module=grpc
Nov 30 20:03:15 myNode dockerd[19681]: time="2021-11-30T20:03:15.007830719-06:00" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Nov 30 20:03:15 myNode dockerd[19681]: time="2021-11-30T20:03:15.007745794-06:00" level=info msg="parsed scheme: \"unix\"" module=grpc
Nov 30 20:03:14 myNode dockerd[19681]: time="2021-11-30T20:03:14.999209301-06:00" level=info msg="Starting up"
Nov 30 20:03:14 myNode systemd[1]: Starting Docker Application Container Engine...
Nov 30 20:03:14 myNode systemd[1]: Stopped Docker Application Container Engine.
Nov 30 20:03:14 myNode systemd[1]: docker.service: Scheduled restart job, restart counter is at 6.
Nov 30 20:03:14 myNode systemd[1]: docker.service: Service RestartSec=2s expired, scheduling restart.
Nov 30 20:03:12 myNode systemd[1]: Failed to start Docker Application Container Engine.
Nov 30 20:03:12 myNode systemd[1]: docker.service: Failed with result 'exit-code'.
Nov 30 20:03:12 myNode systemd[1]: docker.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Nov 30 20:03:12 myNode dockerd[19009]: fault 0x0
Nov 30 20:03:12 myNode dockerd[19009]: cpsr 0x10
Nov 30 20:03:12 myNode dockerd[19009]: pc 0xb6d0df14
Nov 30 20:03:12 myNode dockerd[19009]: lr 0xffffffff
Nov 30 20:03:12 myNode dockerd[19009]: sp 0xa66d97e0
Nov 30 20:03:12 myNode dockerd[19009]: ip 0x0
Nov 30 20:03:12 myNode dockerd[19009]: fp 0x35251cc
Nov 30 20:03:12 myNode dockerd[19009]: r10 0x5800540
Nov 30 20:03:12 myNode dockerd[19009]: r9 0xe0
Nov 30 20:03:12 myNode dockerd[19009]: r8 0x585e240
Nov 30 20:03:12 myNode dockerd[19009]: r7 0xaf
Nov 30 20:03:12 myNode dockerd[19009]: r6 0xa66d97e4
Nov 30 20:03:12 myNode dockerd[19009]: r5 0x6
Nov 30 20:03:12 myNode dockerd[19009]: r4 0xb6fc9968
Nov 30 20:03:12 myNode dockerd[19009]: r3 0x8
Nov 30 20:03:12 myNode dockerd[19009]: r2 0x0
Nov 30 20:03:12 myNode dockerd[19009]: r1 0xa66d97e4
Nov 30 20:03:12 myNode dockerd[19009]: r0 0x0
Nov 30 20:03:12 myNode dockerd[19009]: oldmask 0x0
Nov 30 20:03:12 myNode dockerd[19009]: error 0x0
Nov 30 20:03:12 myNode dockerd[19009]: trap 0x0
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:237 +0x1cc
Nov 30 20:03:12 myNode dockerd[19009]: created by github.com/docker/docker/daemon.(*Daemon).restore
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:244 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).restore.func1(0x5a90600, 0x6130000, 0x58c6300, 0x5a90f88, 0x63bada0, 0x68f5752, 0x40)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/container.go:97 +0x3c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).load(0x58c6300, 0x68f5752, 0x40, 0x254d748, 0x5e06008, 0x59cc040)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:147 +0x124
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).FromDisk(0x6184000, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/encoding/json/stream.go:63 +0x5c
Nov 30 20:03:12 myNode dockerd[19009]: encoding/json.(*Decoder).Decode(0x69fe0c0, 0x2810428, 0x6184000, 0x0, 0x5e06040)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/encoding/json/stream.go:140 +0x1fc
Nov 30 20:03:12 myNode dockerd[19009]: encoding/json.(*Decoder).readValue(0x69fe0c0, 0x0, 0x0, 0x71)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/encoding/json/stream.go:165 +0xf8
Nov 30 20:03:12 myNode dockerd[19009]: encoding/json.(*Decoder).refill(0x69fe0c0, 0xac, 0x59a3980)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file.go:117 +0x5c
Nov 30 20:03:12 myNode dockerd[19009]: os.(*File).Read(0x5e06040, 0x6d08200, 0x200, 0x200, 0x69fe0c0, 0xc0, 0xb4)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file_posix.go:31
Nov 30 20:03:12 myNode dockerd[19009]: os.(*File).read(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/internal/poll/fd_unix.go:162 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: internal/poll.(*FD).Read(0x59cc200, 0x6d08200, 0x200, 0x200, 0x0, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/internal/poll/fd_unix.go:581
Nov 30 20:03:12 myNode dockerd[19009]: internal/poll.ignoringEINTRIO(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/syscall_unix.go:187
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Read(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/zsyscall_linux_arm.go:686 +0x40
Nov 30 20:03:12 myNode dockerd[19009]: syscall.read(0x1b, 0x6d08200, 0x200, 0x200, 0x0, 0x0, 0x59cc201)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/asm_linux_arm.s:14 +0x8
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Syscall(0x3, 0x1b, 0x6d08200, 0x200, 0x200, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: goroutine 1297 [runnable]:
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:237 +0x1cc
Nov 30 20:03:12 myNode dockerd[19009]: created by github.com/docker/docker/daemon.(*Daemon).restore
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:244 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).restore.func1(0x5a90600, 0x6130000, 0x58c6300, 0x5a90f88, 0x63bada0, 0x5d6dd02, 0x40)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/container.go:97 +0x3c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).load(0x58c6300, 0x5d6dd02, 0x40, 0x254d748, 0x5e06e10, 0x5964bc0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:133 +0x58
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).FromDisk(0x75fc640, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:356
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).ConfigPath(...)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:340 +0xc8
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).GetRootResourcePath(0x75fc640, 0x20c58d9, 0xe, 0x75f17e0, 0x75f17a0, 0x7730c00, 0x7730bc0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:28 +0xa0
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.FollowSymlinkInScope(0x696ad80, 0x71, 0x7740460, 0x62, 0x71, 0x753ac18, 0x1d76650, 0x26708c0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:103 +0x294
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.evalSymlinksInScope(0x696ad80, 0x71, 0x7740460, 0x62, 0x0, 0x0, 0x696a980, 0x72)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat.go:22 +0x38
Nov 30 20:03:12 myNode dockerd[19009]: os.Lstat(0x696af80, 0x71, 0x696af80, 0x71, 0xf, 0x696af80)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:44 +0x64
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog(0x696af80, 0x71, 0x71, 0x696af80, 0x71, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file_posix.go:245
Nov 30 20:03:12 myNode dockerd[19009]: os.ignoringEINTR(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:45
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog.func1(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/syscall_linux_arm.go:129
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Lstat(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/zsyscall_linux_arm.go:1286 +0xb4
Nov 30 20:03:12 myNode dockerd[19009]: syscall.fstatat(0xffffff9c, 0x696af80, 0x71, 0x75ddf18, 0x100, 0x1, 0x99fb1c)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/asm_linux_arm.s:45 +0x8
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Syscall6(0x147, 0xffffff9c, 0x696b180, 0x75ddf18, 0x100, 0x0, 0x0, 0x0, 0x696b180, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: goroutine 1296 [runnable]:
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:237 +0x1cc
Nov 30 20:03:12 myNode dockerd[19009]: created by github.com/docker/docker/daemon.(*Daemon).restore
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:244 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).restore.func1(0x5a90600, 0x6130000, 0x58c6300, 0x5a90f88, 0x63bada0, 0x66c6332, 0x40)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/container.go:97 +0x3c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).load(0x58c6300, 0x66c6332, 0x40, 0x254d748, 0x5e06ce8, 0x5964940)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:133 +0x58
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).FromDisk(0x75fc500, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:356
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).ConfigPath(...)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:340 +0xc8
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).GetRootResourcePath(0x75fc500, 0x20c58d9, 0xe, 0x75f1340, 0x75f1300, 0x7730680, 0x7730640)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:28 +0xa0
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.FollowSymlinkInScope(0x694fb80, 0x71, 0x75fbb20, 0x62, 0x71, 0x753abd0, 0x1d76650, 0x26708c0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:103 +0x294
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.evalSymlinksInScope(0x694fb80, 0x71, 0x75fbb20, 0x62, 0x0, 0x0, 0x694f780, 0x72)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat.go:22 +0x38
Nov 30 20:03:12 myNode dockerd[19009]: os.Lstat(0x694fd80, 0x71, 0x694fd80, 0x71, 0xf, 0x694fd80)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:44 +0x64
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog(0x694fd80, 0x71, 0x71, 0x694fd80, 0x71, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file_posix.go:245
Nov 30 20:03:12 myNode dockerd[19009]: os.ignoringEINTR(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:45
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog.func1(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/syscall_linux_arm.go:129
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Lstat(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/zsyscall_linux_arm.go:1286 +0xb4
Nov 30 20:03:12 myNode dockerd[19009]: syscall.fstatat(0xffffff9c, 0x694fd80, 0x71, 0x75ddb28, 0x100, 0x1, 0x99fb1c)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/asm_linux_arm.s:45 +0x8
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Syscall6(0x147, 0xffffff9c, 0x694ff80, 0x75ddb28, 0x100, 0x0, 0x0, 0x0, 0x694ff80, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: goroutine 1295 [runnable]:
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:237 +0x1cc
Nov 30 20:03:12 myNode dockerd[19009]: created by github.com/docker/docker/daemon.(*Daemon).restore
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:244 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).restore.func1(0x5a90600, 0x6130000, 0x58c6300, 0x5a90f88, 0x63bada0, 0x61dd282, 0x40)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/container.go:97 +0x3c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).load(0x58c6300, 0x61dd282, 0x40, 0x254d748, 0x5e06c40, 0x59647c0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:133 +0x58
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).FromDisk(0x75fc3c0, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:356
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).ConfigPath(...)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:340 +0xc8
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).GetRootResourcePath(0x75fc3c0, 0x20c58d9, 0xe, 0x75f1060, 0x75f1020, 0x7730380, 0x7730340)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:28 +0xa0
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.FollowSymlinkInScope(0x694ad80, 0x71, 0x75fb650, 0x62, 0x71, 0x753ab88, 0x1d76650, 0x26708c0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:103 +0x294
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.evalSymlinksInScope(0x694ad80, 0x71, 0x75fb650, 0x62, 0x0, 0x0, 0x694a980, 0x72)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat.go:22 +0x38
Nov 30 20:03:12 myNode dockerd[19009]: os.Lstat(0x694af80, 0x71, 0x694af80, 0x71, 0xf, 0x694af80)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:44 +0x64
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog(0x694af80, 0x71, 0x71, 0x694af80, 0x71, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file_posix.go:245
Nov 30 20:03:12 myNode dockerd[19009]: os.ignoringEINTR(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:45
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog.func1(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/syscall_linux_arm.go:129
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Lstat(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/zsyscall_linux_arm.go:1286 +0xb4
Nov 30 20:03:12 myNode dockerd[19009]: syscall.fstatat(0xffffff9c, 0x694af80, 0x71, 0x75dd858, 0x100, 0x1, 0x99fb1c)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/asm_linux_arm.s:45 +0x8
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Syscall6(0x147, 0xffffff9c, 0x694b180, 0x75dd858, 0x100, 0x0, 0x0, 0x0, 0x694b180, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: goroutine 1294 [runnable]:
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:237 +0x1cc
Nov 30 20:03:12 myNode dockerd[19009]: created by github.com/docker/docker/daemon.(*Daemon).restore
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:244 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).restore.func1(0x5a90600, 0x6130000, 0x58c6300, 0x5a90f88, 0x63bada0, 0x64a0642, 0x40)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/container.go:97 +0x3c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).load(0x58c6300, 0x64a0642, 0x40, 0x254d748, 0x5e06a48, 0x5964040)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:147 +0x124
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).FromDisk(0x75fc280, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/encoding/json/stream.go:63 +0x5c
Nov 30 20:03:12 myNode dockerd[19009]: encoding/json.(*Decoder).Decode(0x772c840, 0x2810428, 0x75fc280, 0x0, 0x5e06bc8)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/encoding/json/stream.go:140 +0x1fc
Nov 30 20:03:12 myNode dockerd[19009]: encoding/json.(*Decoder).readValue(0x772c840, 0x0, 0x0, 0x71)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/encoding/json/stream.go:165 +0xf8
Nov 30 20:03:12 myNode dockerd[19009]: encoding/json.(*Decoder).refill(0x772c840, 0xac, 0x692cb80)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file.go:117 +0x5c
Nov 30 20:03:12 myNode dockerd[19009]: os.(*File).Read(0x5e06bc8, 0x7732a00, 0x200, 0x200, 0x772c840, 0xc0, 0xb4)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file_posix.go:31
Nov 30 20:03:12 myNode dockerd[19009]: os.(*File).read(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/internal/poll/fd_unix.go:162 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: internal/poll.(*FD).Read(0x5964640, 0x7732a00, 0x200, 0x200, 0x0, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/internal/poll/fd_unix.go:581
Nov 30 20:03:12 myNode dockerd[19009]: internal/poll.ignoringEINTRIO(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/syscall_unix.go:187
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Read(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/zsyscall_linux_arm.go:686 +0x40
Nov 30 20:03:12 myNode dockerd[19009]: syscall.read(0x12b, 0x7732a00, 0x200, 0x200, 0x0, 0x0, 0x5964601)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/asm_linux_arm.s:14 +0x8
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Syscall(0x3, 0x12b, 0x7732a00, 0x200, 0x200, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: goroutine 1293 [runnable]:
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:237 +0x1cc
Nov 30 20:03:12 myNode dockerd[19009]: created by github.com/docker/docker/daemon.(*Daemon).restore
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:244 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).restore.func1(0x5a90600, 0x6130000, 0x58c6300, 0x5a90f88, 0x63bada0, 0x67b6cd2, 0x40)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/container.go:97 +0x3c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).load(0x58c6300, 0x67b6cd2, 0x40, 0x254d748, 0x5e06920, 0x5b63f00)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:133 +0x58
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).FromDisk(0x75fc140, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:356
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).ConfigPath(...)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:340 +0xc8
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).GetRootResourcePath(0x75fc140, 0x20c58d9, 0xe, 0x75f0720, 0x75f06e0, 0x754d440, 0x754d400)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:28 +0xa0
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.FollowSymlinkInScope(0x6908580, 0x71, 0x75fa3f0, 0x62, 0x71, 0x753aaf8, 0x1d76650, 0x26708c0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:103 +0x294
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.evalSymlinksInScope(0x6908580, 0x71, 0x75fa3f0, 0x62, 0x0, 0x0, 0x6908180, 0x72)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat.go:22 +0x38
Nov 30 20:03:12 myNode dockerd[19009]: os.Lstat(0x6908780, 0x71, 0x6908780, 0x71, 0xf, 0x6908780)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:44 +0x64
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog(0x6908780, 0x71, 0x71, 0x6908780, 0x71, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file_posix.go:245
Nov 30 20:03:12 myNode dockerd[19009]: os.ignoringEINTR(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:45
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog.func1(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/syscall_linux_arm.go:129
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Lstat(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/zsyscall_linux_arm.go:1286 +0xb4
Nov 30 20:03:12 myNode dockerd[19009]: syscall.fstatat(0xffffff9c, 0x6908780, 0x71, 0x75dd078, 0x100, 0x1, 0x99fb1c)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/asm_linux_arm.s:45 +0x8
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Syscall6(0x147, 0xffffff9c, 0x6908980, 0x75dd078, 0x100, 0x0, 0x0, 0x0, 0x6908980, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: goroutine 1292 [runnable]:
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:237 +0x1cc
Nov 30 20:03:12 myNode dockerd[19009]: created by github.com/docker/docker/daemon.(*Daemon).restore
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:244 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).restore.func1(0x5a90600, 0x6130000, 0x58c6300, 0x5a90f88, 0x63bada0, 0x67d2a32, 0x40)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/container.go:97 +0x3c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).load(0x58c6300, 0x67d2a32, 0x40, 0x254d748, 0x5e06918, 0x5b63c00)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:133 +0x58
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).FromDisk(0x75fc000, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:356
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).ConfigPath(...)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:340 +0xc8
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).GetRootResourcePath(0x75fc000, 0x20c58d9, 0xe, 0x75f0680, 0x75f0640, 0x754d3c0, 0x754d380)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:28 +0xa0
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.FollowSymlinkInScope(0x6901980, 0x71, 0x75fa380, 0x62, 0x71, 0x753aab0, 0x1d76650, 0x26708c0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:103 +0x294
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.evalSymlinksInScope(0x6901980, 0x71, 0x75fa380, 0x62, 0x0, 0x0, 0x6901580, 0x72)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat.go:22 +0x38
Nov 30 20:03:12 myNode dockerd[19009]: os.Lstat(0x6901b80, 0x71, 0x6901b80, 0x71, 0xf, 0x6901b80)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:44 +0x64
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog(0x6901b80, 0x71, 0x71, 0x6901b80, 0x71, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file_posix.go:245
Nov 30 20:03:12 myNode dockerd[19009]: os.ignoringEINTR(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat_unix.go:45
Nov 30 20:03:12 myNode dockerd[19009]: os.lstatNolog.func1(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/syscall_linux_arm.go:129
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Lstat(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/zsyscall_linux_arm.go:1286 +0xb4
Nov 30 20:03:12 myNode dockerd[19009]: syscall.fstatat(0xffffff9c, 0x6901b80, 0x71, 0x75dcf58, 0x100, 0x1, 0x99fb1c)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/asm_linux_arm.s:45 +0x8
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Syscall6(0x147, 0xffffff9c, 0x6901d80, 0x75dcf58, 0x100, 0x0, 0x0, 0x0, 0x6901d80, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: goroutine 1291 [runnable]:
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:237 +0x1cc
Nov 30 20:03:12 myNode dockerd[19009]: created by github.com/docker/docker/daemon.(*Daemon).restore
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:244 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).restore.func1(0x5a90600, 0x6130000, 0x58c6300, 0x5a90f88, 0x63bada0, 0x6254952, 0x40)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/container.go:97 +0x3c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).load(0x58c6300, 0x6254952, 0x40, 0x254d748, 0x5e06910, 0x5b63bc0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:158 +0x178
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).FromDisk(0x7589e00, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:225 +0x1c0
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).readHostConfig(0x7589e00, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/encoding/json/stream.go:63 +0x5c
Nov 30 20:03:12 myNode dockerd[19009]: encoding/json.(*Decoder).Decode(0x7750f00, 0x24a1468, 0x7589ea0, 0x0, 0x5e07280)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/encoding/json/stream.go:140 +0x1fc
Nov 30 20:03:12 myNode dockerd[19009]: encoding/json.(*Decoder).readValue(0x7750f00, 0x0, 0x0, 0x72)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/encoding/json/stream.go:165 +0xf8
Nov 30 20:03:12 myNode dockerd[19009]: encoding/json.(*Decoder).refill(0x7750f00, 0xac, 0x5d5fc00)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file.go:117 +0x5c
Nov 30 20:03:12 myNode dockerd[19009]: os.(*File).Read(0x5e07280, 0x775d000, 0x200, 0x200, 0x7750f00, 0xc0, 0xb4)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/file_posix.go:31
Nov 30 20:03:12 myNode dockerd[19009]: os.(*File).read(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/internal/poll/fd_unix.go:162 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: internal/poll.(*FD).Read(0x59658c0, 0x775d000, 0x200, 0x200, 0x0, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/internal/poll/fd_unix.go:581
Nov 30 20:03:12 myNode dockerd[19009]: internal/poll.ignoringEINTRIO(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/syscall_unix.go:187
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Read(...)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/zsyscall_linux_arm.go:686 +0x40
Nov 30 20:03:12 myNode dockerd[19009]: syscall.read(0x145, 0x775d000, 0x200, 0x200, 0x0, 0x0, 0x5965801)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/syscall/asm_linux_arm.s:14 +0x8
Nov 30 20:03:12 myNode dockerd[19009]: syscall.Syscall(0x3, 0x145, 0x775d000, 0x200, 0x200, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: goroutine 1290 [runnable]:
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:237 +0x1cc
Nov 30 20:03:12 myNode dockerd[19009]: created by github.com/docker/docker/daemon.(*Daemon).restore
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/daemon.go:244 +0x11c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).restore.func1(0x5a90600, 0x6130000, 0x58c6300, 0x5a90f88, 0x63bada0, 0x6186022, 0x40)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/daemon/container.go:97 +0x3c
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/daemon.(*Daemon).load(0x58c6300, 0x6186022, 0x40, 0x254d748, 0x5e06908, 0x5b63b80)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:133 +0x58
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).FromDisk(0x7589cc0, 0x0, 0x0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:356
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).ConfigPath(...)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/container/container.go:340 +0xc8
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/container.(*Container).GetRootResourcePath(0x7589cc0, 0x20c58d9, 0xe, 0x75f0540, 0x75f0500, 0x754d2c0, 0x754d280)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:28 +0xa0
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.FollowSymlinkInScope(0x6900180, 0x71, 0x75fa2a0, 0x62, 0x71, 0x753aa20, 0x1d76650, 0x26708c0)
Nov 30 20:03:12 myNode dockerd[19009]: /go/src/github.com/docker/docker/vendor/github.com/moby/sys/symlink/fs.go:103 +0x294
Nov 30 20:03:12 myNode dockerd[19009]: github.com/docker/docker/vendor/github.com/moby/sys/symlink.evalSymlinksInScope(0x6900180, 0x71, 0x75fa2a0, 0x62, 0x0, 0x0, 0x68f1d80, 0x72)
Nov 30 20:03:12 myNode dockerd[19009]: /usr/local/go/src/os/stat.go:22 +0x38
Nov 30 20:03:12 myNode dockerd[19009]: os.Lstat(0x6900380, 0x71, 0x6900380, 0x71, 0xf, 0x6900380)Quick update on this, I do now see the word INDEX, but the QR code still shows CONNECTION_STRING as the address and when I manually enter the address it does not connect, I get
java.io IOException: Tor executable file not foundAnd a generate token failed message from the client. The client is the latest version available on the google andriod play store.
Try downloading the app from the GitHub page there are some know issues with the tor library when downloaded from the playstore
They resolved the issue with the version in the play store and I was able to validated it worked by connecting to a Sphinx provided node I am using for testing.
Almost certainly linked to the docker issue? Thought I am not sure why the app installed in the first place.
kevkevinpal
commented
2 years ago Quick update on this, I do now see the word INDEX, but the QR code still shows CONNECTION_STRING as the address and when I manually enter the address it does not connect, I get
java.io IOException: Tor executable file not foundAnd a generate token failed message from the client. The client is the latest version available on the google andriod play store.
Try downloading the app from the GitHub page there are some know issues with the tor library when downloaded from the playstore
They resolved the issue with the version in the play store and I was able to validated it worked by connecting to a Sphinx provided node I am using for testing.
Almost certainly linked to the docker issue? Thought I am not sure why the app installed in the first place.
Are you seeing that Tor issue only when connecting to your node, the sphinx provided nodes may not be using tor which is why you're able to connect
Try downloading from the sphinx-kotlin repo's latest release try connecting and seeing which error it gives you
mjschmidt
commented
2 years ago @kevkevinpal I am running tor on the sphinx node and had a tor address I was able to connect to for the static page.
mjschmidt
commented
2 years ago @kevkevinpal I am working through a docker issue at the moment on my node, I will circle back when that is working again.
mjschmidt
commented
2 years ago sorry to @ you twice. not nice... my bad
kevkevinpal
commented
2 years ago sorry to @ you twice. not nice... my bad
No worries :) whenever you get a chance try connecting to your relay with this android app build
https://github.com/stakwork/sphinx-kotlin/releases/tag/1.0.0-alpha34
It sounds like relay is working for you since you're able to see the index page when going through tor
let me know if you find any issues
mjschmidt
commented
2 years ago I can update, but I have been trying to leverage the google play store for the client of sphinx as this software is still early days.
kevkevinpal
commented
2 years ago I can update, but I have been trying to leverage the google play store for the client of sphinx as this software is still early days.
Yea I just suspect that you might be unable to connect because our google play release is having issues with the tor library which may be why you're unable to connect. But that library is working when we bundle and release on github so it's an ongoing issue.
checkout this thread https://github.com/stakwork/sphinx-relay/issues/243
looks like the java.io.IOException: Tor executable file not found is similar to the error these guys were getting
mjschmidt
commented
2 years ago I think you guys have updated the library since that issue? I was able to connect to my sphinx lite node.
Currently google play version at alpha32 right now only two alpha versions behind.
mjschmidt
commented
2 years ago btw the docker issue was a kernel error being incompatible with docker.
What I really need is to get a second node I use specifically for sphinx ;)
mjschmidt
commented
2 years ago Okay @kevkevinpal this almost certainly looks like a server side error, because this client I am using (post client 19 or so) is at version 32, which yes while its not version 34 when i got a sphix node provided by sphinx directly I was able to connect my client to the sphinx team hosted node, however I was not able to connect my phone app to my self hosted sphinx server on myNode. I don't think the status page for the sphinx chat app showing a static page with a QR code that reads "Connection_Error" mean things are working correctly, but I am also not seeing anything in the logs.
mjschmidt
commented
2 years ago @kevkevinpal what else can I look at here? I am really not sure where to go next with the mynode install. If I uninstall and go with the non mynode install (the sphinx build and install) I would think that should work right? It just may not work with the mynode gui?
mjschmidt
commented
2 years ago @kevkevinpal could it be an nginx issue?
kevkevinpal
commented
2 years ago Let me post in the myNode tribe to see if anyone is able to help out there
mjschmidt
commented
2 years ago Oh there is a myNode tribe?! That is good to know, I do have a rented Sphinx chat node that I can go into.
mjschmidt
commented
2 years ago Doesn't look like anyone is using, myNode for spinx. what type of machine are you using? umbrel?
jorgparis
commented
2 years ago Hello, mynode version 0.2.48 and I have an authentication error with the desktop and android version "Token Generation failed".
kevkevinpal
commented
2 years ago Hello, mynode version 0.2.48 and I have an authentication error with the desktop and android version "Token Generation failed".
Hmm try it one more time and would you be able to grab logs from relay? Ik users have been having issues on myNode I need to set one up myself
jorgparis
commented
2 years ago Although the relay works with npm run web - I have a lot of CORS errors because it's not running on the same machine - and it looks like the web version is outdated - I get messages please update and I can't see my previous chat messages in the chat window
jorgparis
commented
2 years ago This happens on the server side when it fails
jorgparis
commented
2 years ago This happens on the server side when it fails
I have cut the image a little too early
I am running a sphinx relay on a myNode (installed by myNode as I have paid for the full software version).
Node Details: Raspberry pi 4 running myNode software LND hub enabled mempool enabled lightning enabled thunderhub enabled electron enabled tor services enabled
I have not followed this page because I was running under the assumtion that myNode was now handling deployment on my behalf. Maybe this is wrong, I did not follow this page because of what I am seeing in the logs: https://github.com/stakwork/sphinx-relay/blob/master/docs/myNode_deployment.md
Logs look fine to me?: