search

eclipse-fog05 / fog05

End-to-End Compute, Storage and Networking Virtualisation.
http://fog05.io/
Other
56 stars 24 forks source link

Error when I try to use a yaks server on a different machine #206

Closed tommyliverani closed 3 years ago

tommyliverani commented 3 years ago

I'm trying to use a yaks server on a different node in order to enable migration between two nodes.

In my local node I've changed the "ylocator" field in linux and linuxbridge configuration file with the . I've also changed the "yaks" field in agent configuration file in the same way.

The error occurs when i try to restart fog05 and plugins fail to start.

With

api=FIMAPI('') api.node.list()

i can obviously see the remote node id only.

Did I miss something?

gabrik commented 3 years ago

Can you check the output of journalctl -u fos_agent -f on the second node?

tommyliverani commented 3 years ago

MicrosoftTeams-image

gabrik commented 3 years ago

Just to be sure, this is the scenario you have right?


                                                                  Node1

                                                           +-----------------------+
       Node2        +-------------------------------------->                       |
                    |                                      |       YAKS            |
+-------------------+---+                                  +-----------------------+
|                       |                                  |                       |
|                       |                                  |                       |
|      Agent            |                                  |       Agent           |
|      Plugins...       |                                  |       Plugins         |
|                       |                                  |                       |
|                       |                                  |                       |
|                       |                                  |                       |
|                       |                                  +-----------------------+
|                       |                                  |                       |
|                       |                                  |      API              |
|                       |                                  |                       |
+-----------------------+                                  +-----------------------+

And you see only Node1 right?

tommyliverani commented 3 years ago

Yes I see only Node1 but in this scenario I posted the output of journalctl -u fos_agent -f on Node1. Maybe I misunderstood what you meant with "second node" Do you need this output on Node2?

gabrik commented 3 years ago

Yes, the one from node2.

Also journalctl -u fos_linux -f for node2

tommyliverani commented 3 years ago
Cattura
gabrik commented 3 years ago

Ok, this is the one not connecting for some reason.

I guess we need the last 50/100 lines of the log to really understand. You should be able to get them using journalctl -u fos_agent -n 100 --no-pager

tommyliverani commented 3 years ago
Cattura

I think It is looking for the yacks server with the wrong ip. However I've put in this configuration file(src/agent/etc/agent.json) a different ip(not 127.0.0.1)

configurazione
gabrik commented 3 years ago

You modified the wrong file, you should modify /etc/fos/agent.json same for the plugins, the files are in /etc/fos/<plugin name>/<plugin name>.json

tommyliverani commented 3 years ago

Thank you so much! Now I can see both node but I still can't define or migrate instance on node2. The methods migrate and define block my script without printing any error. Any suggestion?

gabrik commented 3 years ago

Which FDU plugin you have on the second machine?

Can you paste the descriptor are you using?

tommyliverani commented 3 years ago

plugin in the second machine: linux, linuxbridge, ctd

Descriptor:

Cattura

I've done some test and I think the problem is in the ctd plugin in the second machine. It's running but it's not visible with api.node.plugins()

That's the output of systemctl status fos_ctd on Node1

mio output

That's the output of systemctl status fos_ctd on Node2

print winny

In this output the ylocator field is correct but I don't see the logs of StartRuntime() function

gabrik commented 3 years ago

Can you share the log of the containerd plugin? journalctl -u fos_ctd -n 50 --no-pager

Maybe it is having bad times in connecting to containerd

tommyliverani commented 3 years ago
Cattura
gabrik commented 3 years ago

I see, did you install it from here: https://github.com/eclipse-fog05/fog05/releases/download/v0.2.2/fog05-plugin-fdu-containerd_0.2.1-1_amd64.deb ?

tommyliverani commented 3 years ago

No I install it from source. If I use a yaks server on localhost it works correctly. Do I have to reinstall it with debian package? In this case how can I unistall the old plugin?

gabrik commented 3 years ago

You can remove:

/etc/fos/plugins/plugin-fdu-containerd
/lib/systemd/system/fos_ctd.service

Then you can just install the one from the debian package

tommyliverani commented 3 years ago

I install the plugin from debian package. The output is a bit different but the behavior is the same.

Cattura
gabrik commented 3 years ago

The error you are getting is related to the containerd daemon, it is connecting but seems that is a different version from what is expecting. Can you check it via: containerd --version It should be 1.3.4 if not you can install that version from: https://github.com/eclipse-fog05/fog05/releases/download/v0.2.2/containerd.io_1.3.4-1_amd64.deb

tommyliverani commented 3 years ago

Yes it is 1.3.4

gabrik commented 3 years ago

Can you copy the whole error stack from the beginning, so we can understand where it actually fails

tommyliverani commented 3 years ago

tommy@tommy-VirtualBox:~/Desktop$ journalctl -u fos_ctd -f -- Logs begin at Fri 2020-11-27 00:12:52 CET. -- nov 30 14:56:55 tommy-VirtualBox fos_ctd[17384]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/stream.go:317 +0x9a5 nov 30 14:56:55 tommy-VirtualBox systemd[1]: fos_ctd.service: Main process exited, code=exited, status=2/INVALIDARGUMENT nov 30 14:56:55 tommy-VirtualBox systemd[1]: fos_ctd.service: Failed with result 'exit-code'. nov 30 14:56:55 tommy-VirtualBox systemd[1]: fos_ctd.service: Scheduled restart job, restart counter is at 19. nov 30 14:56:55 tommy-VirtualBox systemd[1]: Stopped fos_ctd.service. nov 30 14:56:55 tommy-VirtualBox systemd[1]: Started fos_ctd.service. nov 30 14:56:55 tommy-VirtualBox fos_ctd[18193]: [/etc/fos/plugins/plugin-fdu-containerd/containerd_plugin.json] nov 30 14:56:55 tommy-VirtualBox fos_ctd[18193]: YLocator is tcp/192.168.56.101:7447 nov 30 14:56:58 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:56:58+01:00" level=info msg="Connecting to containerd ... " func="main.(ContainerdPlugin).StartRuntime" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:148" nov 30 14:56:58 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:56:58+01:00" level=info msg="Hello from containerd Plugin - PID: 18193" func="main.(ContainerdPlugin).StartRuntime" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:166" nov 30 14:58:43 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:43+01:00" level=info msg="This is define for edefa0b5-0ce1-56cb-a82f-7ee9ff0ccd69 - 78c0ff48-7599-43da-ba9e-d79a79b27827" func="main.(ContainerdPlugin).DefineFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:214" nov 30 14:58:43 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:43+01:00" level=debug msg="Defining a container" func="main.(ContainerdPlugin).DefineFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:215" nov 30 14:58:43 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:43+01:00" level=debug msg="Image Already present: docker.io/gabrik91/loop:latest" func="main.(ContainerdPlugin).DefineFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:246" nov 30 14:58:43 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:43+01:00" level=debug msg="Added image: docker.io/gabrik91/loop:latest" func="main.(ContainerdPlugin).DefineFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:250" nov 30 14:58:43 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:43+01:00" level=info msg="Defined container: 78c0ff48-7599-43da-ba9e-d79a79b27827" func="main.(ContainerdPlugin).DefineFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:260" nov 30 14:58:43 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:43+01:00" level=info msg="Configure container: 78c0ff48-7599-43da-ba9e-d79a79b27827" func="main.(ContainerdPlugin).ConfigureFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:277" nov 30 14:58:43 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:43+01:00" level=debug msg="Creating container namespace: 78c0ff48-7599-43da-ba9e-d79a79b27827" func="main.(ContainerdPlugin).ConfigureFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:294" nov 30 14:58:44 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:44+01:00" level=info msg="Registerting Start/Run/Log/Ls/Get evals for 78c0ff48-7599-43da-ba9e-d79a79b27827" func="main.(ContainerdPlugin).ConfigureFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:465" nov 30 14:58:44 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:44+01:00" level=info msg="Callbacks created, registering... " func="main.(ContainerdPlugin).ConfigureFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:472" nov 30 14:58:44 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:44+01:00" level=info msg="Updated status for evals for 78c0ff48-7599-43da-ba9e-d79a79b27827" func="main.(ContainerdPlugin).ConfigureFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:480" nov 30 14:58:44 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:44+01:00" level=debug msg="Start a container" func="main.(ContainerdPlugin).StartFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:535" nov 30 14:58:44 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:44+01:00" level=debug msg="Creating container: 78c0ff48-7599-43da-ba9e-d79a79b27827" func="main.(ContainerdPlugin).StartFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:578" nov 30 14:58:45 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:45+01:00" level=debug msg="Starting container: 78c0ff48-7599-43da-ba9e-d79a79b27827" func="main.(ContainerdPlugin).StartFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:587" nov 30 14:58:45 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:45+01:00" level=debug msg="Creating task" func="main.(ContainerdPlugin).StartFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:589" nov 30 14:58:45 tommy-VirtualBox fos_ctd[18193]: time="2020-11-30T14:58:45+01:00" level=debug msg="Starting task" func="main.(ContainerdPlugin).StartFDU" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:599" nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: runtime: goroutine stack exceeds 1000000000-byte limit nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: fatal error: stack overflow nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: runtime stack: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: runtime.throw(0x10e56c7, 0xe) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/runtime/panic.go:774 +0x72 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: runtime.newstack() nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/runtime/stack.go:1046 +0x6e9 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: runtime.morestack() nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/runtime/asm_amd64.s:449 +0x8f nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 24 [running]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x74 fp=0xc02044c370 sp=0xc02044c368 pc=0xf05544 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c3a8 sp=0xc02044c370 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c3e0 sp=0xc02044c3a8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c418 sp=0xc02044c3e0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c450 sp=0xc02044c418 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c488 sp=0xc02044c450 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c4c0 sp=0xc02044c488 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c4f8 sp=0xc02044c4c0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c530 sp=0xc02044c4f8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c568 sp=0xc02044c530 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c5a0 sp=0xc02044c568 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c5d8 sp=0xc02044c5a0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c610 sp=0xc02044c5d8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c648 sp=0xc02044c610 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c680 sp=0xc02044c648 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c6b8 sp=0xc02044c680 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c6f0 sp=0xc02044c6b8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c728 sp=0xc02044c6f0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c760 sp=0xc02044c728 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c798 sp=0xc02044c760 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c7d0 sp=0xc02044c798 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c808 sp=0xc02044c7d0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c840 sp=0xc02044c808 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c878 sp=0xc02044c840 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c8b0 sp=0xc02044c878 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c8e8 sp=0xc02044c8b0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c920 sp=0xc02044c8e8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c958 sp=0xc02044c920 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c990 sp=0xc02044c958 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044c9c8 sp=0xc02044c990 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044ca00 sp=0xc02044c9c8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044ca38 sp=0xc02044ca00 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044ca70 sp=0xc02044ca38 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044caa8 sp=0xc02044ca70 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cae0 sp=0xc02044caa8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cb18 sp=0xc02044cae0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cb50 sp=0xc02044cb18 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cb88 sp=0xc02044cb50 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cbc0 sp=0xc02044cb88 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cbf8 sp=0xc02044cbc0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cc30 sp=0xc02044cbf8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cc68 sp=0xc02044cc30 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cca0 sp=0xc02044cc68 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044ccd8 sp=0xc02044cca0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cd10 sp=0xc02044ccd8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cd48 sp=0xc02044cd10 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cd80 sp=0xc02044cd48 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cdb8 sp=0xc02044cd80 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cdf0 sp=0xc02044cdb8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044ce28 sp=0xc02044cdf0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044ce60 sp=0xc02044ce28 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044ce98 sp=0xc02044ce60 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044ced0 sp=0xc02044ce98 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cf08 sp=0xc02044ced0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cf40 sp=0xc02044cf08 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cf78 sp=0xc02044cf40 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cfb0 sp=0xc02044cf78 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044cfe8 sp=0xc02044cfb0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d020 sp=0xc02044cfe8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d058 sp=0xc02044d020 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d090 sp=0xc02044d058 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d0c8 sp=0xc02044d090 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d100 sp=0xc02044d0c8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d138 sp=0xc02044d100 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d170 sp=0xc02044d138 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d1a8 sp=0xc02044d170 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d1e0 sp=0xc02044d1a8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d218 sp=0xc02044d1e0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d250 sp=0xc02044d218 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d288 sp=0xc02044d250 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d2c0 sp=0xc02044d288 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d2f8 sp=0xc02044d2c0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d330 sp=0xc02044d2f8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d368 sp=0xc02044d330 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d3a0 sp=0xc02044d368 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d3d8 sp=0xc02044d3a0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d410 sp=0xc02044d3d8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d448 sp=0xc02044d410 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d480 sp=0xc02044d448 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d4b8 sp=0xc02044d480 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d4f0 sp=0xc02044d4b8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d528 sp=0xc02044d4f0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d560 sp=0xc02044d528 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d598 sp=0xc02044d560 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d5d0 sp=0xc02044d598 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d608 sp=0xc02044d5d0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d640 sp=0xc02044d608 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d678 sp=0xc02044d640 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d6b0 sp=0xc02044d678 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d6e8 sp=0xc02044d6b0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d720 sp=0xc02044d6e8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d758 sp=0xc02044d720 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d790 sp=0xc02044d758 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d7c8 sp=0xc02044d790 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d800 sp=0xc02044d7c8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d838 sp=0xc02044d800 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d870 sp=0xc02044d838 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d8a8 sp=0xc02044d870 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d8e0 sp=0xc02044d8a8 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).MigrateFDU(0xc0000f1080, 0xc000233e30, 0x24, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: :1 +0x51 fp=0xc02044d918 sp=0xc02044d8e0 pc=0xf05521 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: ...additional frames elided... nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by github.com/atolab/yaks-go.(Workspace).Subscribe.func1 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/github.com/atolab/yaks-go@v0.3.0/workspace.go:239 +0x38d nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 1 [chan receive]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).StartRuntime(0xc0000f1080, 0xc000232150, 0x24) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:195 +0x6f4 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: github.com/eclipse-fog05/sdk-go/fog05sdk.(FOSRuntimePluginAbstract).Start(0xc0000f1080) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/github.com/eclipse-fog05/sdk-go@v0.2.0/fog05sdk/runtime_plugin.go:102 +0xcc nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.main() nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/build/fog05-plugin-fdu-containerd-0.2.1/src/plugin.go:48 +0x351 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 6 [syscall]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: os/signal.signal_recv(0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/runtime/sigqueue.go:147 +0x9c nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: os/signal.loop() nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/os/signal/signal_unix.go:23 +0x22 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by os/signal.init.0 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/os/signal/signal_unix.go:29 +0x41 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 7 [syscall]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: github.com/atolab/zenoh-go._Cfunc_z_recv_loop(0x24c00c0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: _cgo_gotypes.go:571 +0x4a nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: github.com/atolab/zenoh-go.ZOpen.func4(0x24c00c0, 0x1) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/github.com/atolab/zenoh-go@v0.3.1/zenoh.go:107 +0x56 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by github.com/atolab/zenoh-go.ZOpen nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/github.com/atolab/zenoh-go@v0.3.1/zenoh.go:107 +0x4e6 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 9 [select]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc.(ccBalancerWrapper).watcher(0xc000287200) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/balancer_conn_wrappers.go:69 +0xc2 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by google.golang.org/grpc.newCCBalancerWrapper nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/balancer_conn_wrappers.go:60 +0x16d nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 10 [chan receive]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc.(addrConn).resetTransport(0xc000151340) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/clientconn.go:1155 +0x6ea nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by google.golang.org/grpc.(addrConn).connect nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/clientconn.go:798 +0x128 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 12 [IO wait]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: internal/poll.runtime_pollWait(0x7fd18c6e9f08, 0x72, 0xffffffffffffffff) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/runtime/netpoll.go:184 +0x55 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: internal/poll.(pollDesc).wait(0xc00032ca18, 0x72, 0x8000, 0x8000, 0xffffffffffffffff) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: internal/poll.(pollDesc).waitRead(...) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: internal/poll.(FD).Read(0xc00032ca00, 0xc000372000, 0x8000, 0x8000, 0x0, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1cf nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: net.(netFD).Read(0xc00032ca00, 0xc000372000, 0x8000, 0x8000, 0x0, 0x800010601, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/net/fd_unix.go:202 +0x4f nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: net.(conn).Read(0xc000010840, 0xc000372000, 0x8000, 0x8000, 0x0, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/net/net.go:184 +0x68 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: bufio.(Reader).Read(0xc00025fda0, 0xc00038a038, 0x9, 0x9, 0x196b160, 0x7fd190149008, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/bufio/bufio.go:226 +0x26a nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: io.ReadAtLeast(0x11e7780, 0xc00025fda0, 0xc00038a038, 0x9, 0x9, 0x9, 0xccbad5, 0xc0003e5c2c, 0xc0000b5de8) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/io/io.go:310 +0x87 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: io.ReadFull(...) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /usr/local/go/src/io/io.go:329 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: golang.org/x/net/http2.readFrameHeader(0xc00038a038, 0x9, 0x9, 0x11e7780, 0xc00025fda0, 0x0, 0xbfe95c8500000000, 0x19997bab53, 0x196a320) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/golang.org/x/net@v0.0.0-20200324143707-d3edc9973b7e/http2/frame.go:237 +0x87 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: golang.org/x/net/http2.(Framer).ReadFrame(0xc00038a000, 0xc0003e5c20, 0xc0003e5c20, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/golang.org/x/net@v0.0.0-20200324143707-d3edc9973b7e/http2/frame.go:492 +0xa1 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc/internal/transport.(http2Client).reader(0xc0000ed6c0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/internal/transport/http2_client.go:1270 +0x183 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by google.golang.org/grpc/internal/transport.newHTTP2Client nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/internal/transport/http2_client.go:300 +0xd23 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 13 [select]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc/internal/transport.(controlBuffer).get(0xc0002889b0, 0x1, 0x0, 0x0, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/internal/transport/controlbuf.go:395 +0x122 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc/internal/transport.(loopyWriter).run(0xc00025fec0, 0x0, 0x0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/internal/transport/controlbuf.go:513 +0x1e3 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0000ed6c0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/internal/transport/http2_client.go:346 +0x7b nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by google.golang.org/grpc/internal/transport.newHTTP2Client nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/internal/transport/http2_client.go:344 +0xedb nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 15 [chan receive]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: main.(ContainerdPlugin).StartRuntime.func1(0xc0000f1080) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:170 +0x3b nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by main.(ContainerdPlugin).StartRuntime nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:169 +0x2c1 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 20 [select]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc.newClientStream.func5(0xc000182700, 0xc0003ebc20, 0x1204880, 0xc0003f2660) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/stream.go:318 +0xd7 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by google.golang.org/grpc.newClientStream nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/stream.go:317 +0x9a5 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 21 [select]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc.newClientStream.func5(0xc000182700, 0xc0003f65a0, 0x1204880, 0xc0003f2e70) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/stream.go:318 +0xd7 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by google.golang.org/grpc.newClientStream nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/stream.go:317 +0x9a5 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 22 [select]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc.newClientStream.func5(0xc000182700, 0xc0003f7560, 0x1204880, 0xc0003f3dd0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/stream.go:318 +0xd7 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by google.golang.org/grpc.newClientStream nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/stream.go:317 +0x9a5 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: goroutine 23 [select]: nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: google.golang.org/grpc.newClientStream.func5(0xc000182700, 0xc0003f7c20, 0x1204880, 0xc0004143c0) nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/stream.go:318 +0xd7 nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: created by google.golang.org/grpc.newClientStream nov 30 14:58:49 tommy-VirtualBox fos_ctd[18193]: /root/go/pkg/mod/google.golang.org/grpc@v1.28.1/stream.go:317 +0x9a5 nov 30 14:58:49 tommy-VirtualBox systemd[1]: fos_ctd.service: Main process exited, code=exited, status=2/INVALIDARGUMENT nov 30 14:58:49 tommy-VirtualBox systemd[1]: fos_ctd.service: Failed with result 'exit-code'. nov 30 14:58:50 tommy-VirtualBox systemd[1]: fos_ctd.service: Scheduled restart job, restart counter is at 20. nov 30 14:58:50 tommy-VirtualBox systemd[1]: Stopped fos_ctd.service. nov 30 14:58:50 tommy-VirtualBox systemd[1]: Started fos_ctd.service. nov 30 14:58:50 tommy-VirtualBox fos_ctd[19488]: [/etc/fos/plugins/plugin-fdu-containerd/containerd_plugin.json] nov 30 14:58:50 tommy-VirtualBox fos_ctd[19488]: YLocator is tcp/192.168.56.101:7447 nov 30 14:58:53 tommy-VirtualBox fos_ctd[19488]: time="2020-11-30T14:58:53+01:00" level=info msg="Connecting to containerd ... " func="main.(ContainerdPlugin).StartRuntime" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:148" nov 30 14:58:53 tommy-VirtualBox fos_ctd[19488]: time="2020-11-30T14:58:53+01:00" level=info msg="Hello from containerd Plugin - PID: 19488" func="main.(*ContainerdPlugin).StartRuntime" file="/root/build/fog05-plugin-fdu-containerd-0.2.1/src/types.go:166"

gabrik commented 3 years ago

Ok, from this log I see that it crashes when calling the migration function, which is expected as the migration is not implemented for the containerd plugin. The only plugins implementing migration are LXD and KVM. For the first one, it may not work because migration in LXD depends on CRIU which is often broken

tommyliverani commented 3 years ago

Ok thank you so much.