Error: Common start logic: Load go-lxc struct: open /tmp/lxd_config_XXXXXXXX: no such file or directory

[falstaff1288]

Required information

• Distribution: Fedora
• Distribution version: 29
• The output of "lxc info"

  config:
  core.https_address: '[::]'
  api_extensions:
  - storage_zfs_remove_snapshots
  - container_host_shutdown_timeout
  - container_stop_priority
  - container_syscall_filtering
  - auth_pki
  - container_last_used_at
  - etag
  - patch
  - usb_devices
  - https_allowed_credentials
  - image_compression_algorithm
  - directory_manipulation
  - container_cpu_time
  - storage_zfs_use_refquota
  - storage_lvm_mount_options
  - network
  - profile_usedby
  - container_push
  - container_exec_recording
  - certificate_update
  - container_exec_signal_handling
  - gpu_devices
  - container_image_properties
  - migration_progress
  - id_map
  - network_firewall_filtering
  - network_routes
  - storage
  - file_delete
  - file_append
  - network_dhcp_expiry
  - storage_lvm_vg_rename
  - storage_lvm_thinpool_rename
  - network_vlan
  - image_create_aliases
  - container_stateless_copy
  - container_only_migration
  - storage_zfs_clone_copy
  - unix_device_rename
  - storage_lvm_use_thinpool
  - storage_rsync_bwlimit
  - network_vxlan_interface
  - storage_btrfs_mount_options
  - entity_description
  - image_force_refresh
  - storage_lvm_lv_resizing
  - id_map_base
  - file_symlinks
  - container_push_target
  - network_vlan_physical
  - storage_images_delete
  - container_edit_metadata
  - container_snapshot_stateful_migration
  - storage_driver_ceph
  - storage_ceph_user_name
  - resource_limits
  - storage_volatile_initial_source
  - storage_ceph_force_osd_reuse
  - storage_block_filesystem_btrfs
  - resources
  - kernel_limits
  - storage_api_volume_rename
  - macaroon_authentication
  - network_sriov
  - console
  - restrict_devlxd
  - migration_pre_copy
  - infiniband
  - maas_network
  - devlxd_events
  - proxy
  - network_dhcp_gateway
  - file_get_symlink
  - network_leases
  - unix_device_hotplug
  - storage_api_local_volume_handling
  - operation_description
  - clustering
  - event_lifecycle
  - storage_api_remote_volume_handling
  - nvidia_runtime
  - container_mount_propagation
  - container_backup
  - devlxd_images
  - container_local_cross_pool_handling
  - proxy_unix
  - proxy_udp
  - clustering_join
  - proxy_tcp_udp_multi_port_handling
  - network_state
  - proxy_unix_dac_properties
  - container_protection_delete
  - unix_priv_drop
  - pprof_http
  - proxy_haproxy_protocol
  - network_hwaddr
  - proxy_nat
  - network_nat_order
  - container_full
  - candid_authentication
  - backup_compression
  - candid_config
  - nvidia_runtime_config
  - storage_api_volume_snapshots
  - storage_unmapped
  - projects
  - candid_config_key
  - network_vxlan_ttl
  - container_incremental_copy
  - usb_optional_vendorid
  - snapshot_scheduling
  - container_copy_project
  - clustering_server_address
  - clustering_image_replication
  - container_protection_shift
  - snapshot_expiry
  - container_backup_override_pool
  - snapshot_expiry_creation
  - network_leases_location
  - resources_cpu_socket
  - resources_gpu
  - resources_numa
  - kernel_features
  - id_map_current
  - event_location
  api_status: stable
  api_version: "1.0"
  auth: trusted
  public: false
  auth_methods:
  - tls
  environment:
  addresses:
  *** PRIVATE ***
  architectures:
  - x86_64
  - i686
  certificate: |
  -----BEGIN CERTIFICATE-----
  MIICHjCCAaSgAwIBAgIQDlvmgMBiX4icdw75imQdajAKBggqhkjOPQQDAzBBMRww
  GgYDVQQKExNsaW51eGNvbnRhaW5lcnMub3JnMSEwHwYDVQQDDBhyb290QFBDMjgz
  LmNyb2VzdXMubG9jYWwwHhcNMTkwMjI3MTU0MTQ1WhcNMjkwMjI0MTU0MTQ1WjBB
  MRwwGgYDVQQKExNsaW51eGNvbnRhaW5lcnMub3JnMSEwHwYDVQQDDBhyb290QFBD
  MjgzLmNyb2VzdXMubG9jYWwwdjAQBgcqhkjOPQIBBgUrgQQAIgNiAAQYODH8PyK/
  4V0oQBdfU96882SWCJF0dGE5/RKmfENs+WpDOmfGsdeRqr8d6msv7AUI3oOeC8I3
  x4lgJ60NZNRaKLsZ1tM7BHjpf5Z/0ynC04ENCcJYYap+JYrBfHPo8JujYTBfMA4G
  A1UdDwEB/wQEAwIFoDATBgNVHSUEDDAKBggrBgEFBQcDATAMBgNVHRMBAf8EAjAA
  MCoGA1UdEQQjMCGCE1BDMjgzLmNyb2VzdXMubG9jYWyHBMCoL8mHBMCoegEwCgYI
  KoZIzj0EAwMDaAAwZQIwCOfCgiqKCClwyuKLNuK+H0rJ15PNrNR83573ZyFwdtAo
  IqrkgyGx+gKf423s+xhRAjEA9Nl/jpCz6J14BjrYUNCp1/PdOerZwfdwzlXLNGQP
  o8M4vjL0dsB92lBKnhHhr/Ge
  -----END CERTIFICATE-----
  certificate_fingerprint: ca7bd8d44197272d699190972a287777a3a100a9b93187a4d43c7020bc58fc9c
  driver: lxc
  driver_version: 3.1.0
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features:
  netnsid_getifaddrs: "true"
  shiftfs: "false"
  uevent_injection: "true"
  unpriv_fscaps: "false"
  kernel_version: 4.20.14-200.fc29.x86_64
  project: default
  server: lxd
  server_clustered: false
  server_pid: 11797
  server_version: "3.12"
  storage: btrfs
  storage_version: "4.4"

Issue description

The snap package for lxd was automatically updated to 3.12. Since then, I am getting the error reported above.

Steps to reproduce

• Using any commands which end results' is to start an instance.
• lxc launch ...
• lxc start ...

Output example

• lxc monitor

location: none
metadata:
  class: task
  created_at: "2019-04-10T09:54:02.229220231-04:00"
  description: Starting container
  err: 'Common start logic: Load go-lxc struct: open /tmp/lxd_config_704842104: no
    such file or directory'
  id: 98296cf9-d885-448a-847a-845aa7ddd642
  location: none
  may_cancel: false
  metadata: null
  resources:
    containers:
    - /1.0/containers/centos7test
  status: Failure
  status_code: 400
  updated_at: "2019-04-10T09:54:02.229220231-04:00"
timestamp: "2019-04-10T09:54:02.234962403-04:00"
type: operation

[stgraber]

The reason for this is that you or some daemon/script on your system decided to cleanup /tmp on the host, removing the snap-specific temporary directory which is used by LXD.

Doing so breaks /tmp in the snap environment and prevents any temporary file from being created by LXD. This causes what you're seeing above as well as a large number of other issues.

There is no way to fix this while LXD is running and snapd doesn't make it easy to fix that even if you stop LXD entirely, the easiest way out of this is to reboot and then make sure you don't have something wipe anything that says snap in /tmp.

[TommyLike]

@stgraber Is there any way to move thoese config file into another folder which won't get cleaned?

[stgraber]

Those aren't config files, they are temporary copies of files being copied in and out of the container.

/tmp is by all definitions the correct location for this. Now if the user or a tool they're using goes and deletes files from the filesystem that they didn't themselves create, it's not too surprising that things may break.

[brauner]

Those aren't config files, they are temporary copies of files being copied in and out of the container.

/tmp is by all definitions the correct location for this. Now if the user or a tool they're using goes and deletes files from the filesystem that they didn't themselves create, it's not too surprising that things may break.

You can check journalctl whether systemd-tmpfiles-clean or similar has run. That would be a suspect.