snapcore / spread

Spread - Convenient full-system test (task) distribution
GNU General Public License v3.0
99 stars 58 forks source link

LXD backend is incompatible with current LXD (5.x) #151

Open zyga opened 2 years ago

zyga commented 2 years ago

Something in the LXD API had to change, this is what happens on a sample project:

zyga@lambert:~/projects/go-hawkbit$ ~/spread/cmd/spread/spread 
2022-06-24 11:54:26 Project content is packed for delivery (7.94MB).
2022-06-24 11:54:26 Sequence of jobs produced with -seed=1656064466
2022-06-24 11:54:26 If killed, discard servers with: spread -reuse-pid=37750 -discard
2022-06-24 11:54:26 Allocating lxd:ubuntu-22.04...
2022-06-24 11:54:32 Waiting for lxd container spread-71-ubuntu-22-04 to have an address...
2022-06-24 11:54:34 Cannot allocate lxd:ubuntu-22.04: lxd returned invalid JSON listing for "spread-71-ubuntu-22-04": [{"architecture":"x86_64","config":{"image.architecture":"amd64","image.description":"ubuntu 20.04 LTS amd64 (buildd release) (20210921.1)","image.label":"buildd release","image.os":"ubuntu","image.release":"focal","image.serial":"20210921.1","image.type":"tar.gz","image.version":"20.04","raw.idmap":"both 1000 0","security.syscalls.intercept.mknod":"true","volatile.base_image":"0405ea7046c307431754ba0db72da6a8547069f9b7208b80d3429d0106864d7f","volatile.cloud-init.instance-id":"5ccf5e5f-b416-40b0-8972-0b4814d896ec","volatile.eth0.hwaddr":"00:16:3e:f9:bc:c4","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999},{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999},{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"STOPPED","volatile.uuid":"1c1ee13e-860f-490b-bc10-06114a961780"},"devices":{"snapcraft-project":{"path":"/root/project","source":"/home/zyga/projects/hare-snap","type":"disk"}},"ephemeral":false,"profiles":["default"],"stateful":false,"description":"","created_at":"2022-05-27T14:38:30.197980577Z","expanded_config":{"image.architecture":"amd64","image.description":"ubuntu 20.04 LTS amd64 (buildd release) (20210921.1)","image.label":"buildd release","image.os":"ubuntu","image.release":"focal","image.serial":"20210921.1","image.type":"tar.gz","image.version":"20.04","raw.idmap":"both 1000 0","security.syscalls.intercept.mknod":"true","volatile.base_image":"0405ea7046c307431754ba0db72da6a8547069f9b7208b80d3429d0106864d7f","volatile.cloud-init.instance-id":"5ccf5e5f-b416-40b0-8972-0b4814d896ec","volatile.eth0.hwaddr":"00:16:3e:f9:bc:c4","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999},{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999},{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"STOPPED","volatile.uuid":"1c1ee13e-860f-490b-bc10-06114a961780"},"expanded_devices":{"eth0":{"name":"eth0","network":"lxdbr0","type":"nic"},"root":{"path":"/","pool":"default","type":"disk"},"snapcraft-project":{"path":"/root/project","source":"/home/zyga/projects/hare-snap","type":"disk"}},"name":"snapcraft-hare","status":"Stopped","status_code":102,"last_used_at":"2022-05-27T14:38:32.931388064Z","location":"none","type":"container","project":"default","backups":null,"state":{"status":"Stopped","status_code":102,"disk":{},"memory":{"usage":0,"usage_peak":0,"swap_usage":0,"swap_usage_peak":0},"network":null,"pid":0,"processes":0,"cpu":{"usage":0}},"snapshots":null},{"architecture":"x86_64","config":{"image.architecture":"amd64","image.description":"ubuntu 20.04 LTS amd64 (buildd release) (20210921.1)","image.label":"buildd release","image.os":"ubuntu","image.release":"focal","image.serial":"20210921.1","image.type":"tar.gz","image.version":"20.04","raw.idmap":"both 1000 0","security.syscalls.intercept.mknod":"true","volatile.base_image":"0405ea7046c307431754ba0db72da6a8547069f9b7208b80d3429d0106864d7f","volatile.cloud-init.instance-id":"08c77eef-9f68-474f-ad65-bc8b256634ed","volatile.eth0.hwaddr":"00:16:3e:13:c6:a6","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999},{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999},{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"STOPPED","volatile.uuid":"cece0257-feba-4a0f-89e7-2baf25757523"},"devices":{"snapcraft-project":{"path":"/root/project","source":"/home/zyga/projects/go-hawkbit","type":"disk"}},"ephemeral":false,"profiles":["default"],"stateful":false,"description":"","created_at":"2022-05-27T20:33:53.089007048Z","expanded_config":{"image.architecture":"amd64","image.description":"ubuntu 20.04 LTS amd64 (buildd release) (20210921.1)","image.label":"buildd release","image.os":"ubuntu","image.release":"focal","image.serial":"20210921.1","image.type":"tar.gz","image.version":"20.04","raw.idmap":"both 1000 0","security.syscalls.intercept.mknod":"true","volatile.base_image":"0405ea7046c307431754ba0db72da6a8547069f9b7208b80d3429d0106864d7f","volatile.cloud-init.instance-id":"08c77eef-9f68-474f-ad65-bc8b256634ed","volatile.eth0.hwaddr":"00:16:3e:13:c6:a6","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999},{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999},{\"Isuid\":true,\"Isgid\":true,\"Hostid\":1000,\"Nsid\":0,\"Maprange\":1},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000001,\"Nsid\":1,\"Maprange\":999999999}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"STOPPED","volatile.uuid":"cece0257-feba-4a0f-89e7-2baf25757523"},"expanded_devices":{"eth0":{"name":"eth0","network":"lxdbr0","type":"nic"},"root":{"path":"/","pool":"default","type":"disk"},"snapcraft-project":{"path":"/root/project","source":"/home/zyga/projects/go-hawkbit","type":"disk"}},"name":"snapcraft-hawkbitctl","status":"Stopped","status_code":102,"last_used_at":"2022-05-27T20:33:56.088889613Z","location":"none","type":"container","project":"default","backups":null,"state":{"status":"Stopped","status_code":102,"disk":{},"memory":{"usage":0,"usage_peak":0,"swap_usage":0,"swap_usage_peak":0},"network":null,"pid":0,"processes":0,"cpu":{"usage":0}},"snapshots":null},{"architecture":"x86_64","config":{"image.architecture":"amd64","image.description":"ubuntu 22.04 LTS amd64 (release) (20220616)","image.label":"release","image.os":"ubuntu","image.release":"jammy","image.serial":"20220616","image.type":"squashfs","image.version":"22.04","volatile.base_image":"663b22a35c6d1ba98fc638eb8b19e0cbc6db4f2f289332cd12bfbde71d4d8df5","volatile.cloud-init.instance-id":"5d3958a2-2bce-466f-a008-b23351c49a9b","volatile.eth0.host_name":"vethc1ec80ed","volatile.eth0.hwaddr":"00:16:3e:65:95:ab","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"5e96d16b-6454-4d15-abf8-e35bd93ad128"},"devices":{},"ephemeral":true,"profiles":["default"],"stateful":false,"description":"","created_at":"2022-06-24T09:54:26.958389203Z","expanded_config":{"image.architecture":"amd64","image.description":"ubuntu 22.04 LTS amd64 (release) (20220616)","image.label":"release","image.os":"ubuntu","image.release":"jammy","image.serial":"20220616","image.type":"squashfs","image.version":"22.04","volatile.base_image":"663b22a35c6d1ba98fc638eb8b19e0cbc6db4f2f289332cd12bfbde71d4d8df5","volatile.cloud-init.instance-id":"5d3958a2-2bce-466f-a008-b23351c49a9b","volatile.eth0.host_name":"vethc1ec80ed","volatile.eth0.hwaddr":"00:16:3e:65:95:ab","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"5e96d16b-6454-4d15-abf8-e35bd93ad128"},"expanded_devices":{"eth0":{"name":"eth0","network":"lxdbr0","type":"nic"},"root":{"path":"/","pool":"default","type":"disk"}},"name":"spread-71-ubuntu-22-04","status":"Running","status_code":103,"last_used_at":"2022-06-24T09:54:32.436236965Z","location":"none","type":"container","project":"default","backups":null,"state":{"status":"Running","status_code":103,"disk":{},"memory":{"usage":47742976,"usage_peak":0,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet6","address":"fe80::216:3eff:fe65:95ab","netmask":"64","scope":"link"}],"counters":{"bytes_received":0,"bytes_sent":176,"packets_received":0,"packets_sent":2,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"00:16:3e:65:95:ab","host_name":"vethc1ec80ed","mtu":1500,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":38089,"processes":16,"cpu":{"usage":1077669000}},"snapshots":null}]
cjdcordeiro commented 1 year ago

also having the same problem.

Some additional info in https://github.com/snapcore/spread/issues/154#issue-1387285605