OSInside / kiwi

KIWI - Appliance Builder Next Generation
https://osinside.github.io/kiwi
GNU General Public License v3.0
307 stars 152 forks source link

Ubuntu 18.04 build fails w/o error #1801

Closed Finkregh closed 3 years ago

Finkregh commented 3 years ago

Problem description

building Ubuntu 18.04 on the same fails w/o proper error, running debootstrap manually works

log:

+ kiwi --debug --color-output --shared-cache-dir=./kiwi-cache --profile=vmware system build --description=descriptions/ubuntu-18.04-amd64-vmware --target-dir=out/ubuntu-18.04-amd64-vmware
[ DEBUG   ]: 14:44:57 | EXEC: [mkdir -p /SOMEDIR]
[ INFO    ]: 14:44:57 | Loading XML description
[ INFO    ]: 14:44:57 | Support for XML markup available
[ INFO    ]: 14:44:58 | --> loaded descriptions/ubuntu-18.04-amd64-vmware/config.xml
[ INFO    ]: 14:44:58 | --> Selected build type: oem
[ INFO    ]: 14:44:58 | --> Selected profiles: vmware
[ INFO    ]: 14:44:58 | Preparing new root system
[ INFO    ]: 14:44:58 | Setup root directory: /SOMEDIR/image-root
[ DEBUG   ]: 14:44:58 | EXEC: [mkdir -p /SOMEDIR/image-root]
[ DEBUG   ]: 14:44:58 | EXEC: [rsync -a --ignore-existing /tmp/kiwi_root.2jic3fqf/ /SOMEDIR/image-root]
[ DEBUG   ]: 14:44:58 | EXEC: [cp /etc/resolv.conf /SOMEDIR/image-root/etc/resolv.conf.kiwi]
[ DEBUG   ]: 14:44:58 | EXEC: [ln -s -f resolv.conf.kiwi /SOMEDIR/image-root/etc/resolv.conf]
[ DEBUG   ]: 14:44:58 | EXEC: [cp /etc/hosts /SOMEDIR/image-root/etc/hosts.kiwi]
[ DEBUG   ]: 14:44:58 | EXEC: [ln -s -f hosts.kiwi /SOMEDIR/image-root/etc/hosts]
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/proc]
[ DEBUG   ]: 14:44:58 | EXEC: [mount -n --bind /proc /SOMEDIR/image-root/proc]
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/dev]
[ DEBUG   ]: 14:44:58 | EXEC: [mount -n --bind /dev /SOMEDIR/image-root/dev]
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/sys]
[ DEBUG   ]: 14:44:58 | EXEC: [mount -n --bind /sys /SOMEDIR/image-root/sys]
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/DIR/kiwi-cache]
[ DEBUG   ]: 14:44:58 | EXEC: [mount -n --bind /DIR/kiwi-cache /SOMEDIR/image-root/DIR/kiwi-cache]
[ DEBUG   ]: 14:44:58 | EXEC: [mkdir -p /DIR/kiwi-cache/apt-get/sources.list.d]
[ DEBUG   ]: 14:44:58 | EXEC: [mkdir -p /DIR/kiwi-cache/apt-get/preferences.d]
[ INFO    ]: 14:44:58 | Setting up repository https://DOMAIN/ubuntu
[ INFO    ]: 14:44:58 | --> Type: apt-deb
[ INFO    ]: 14:44:58 | --> Translated: https://DOMAIN/ubuntu
[ INFO    ]: 14:44:58 | --> Alias: Bionic-security
[ INFO    ]: 14:44:58 | Setting up repository https://DOMAIN/ubuntu
[ INFO    ]: 14:44:58 | --> Type: apt-deb
[ INFO    ]: 14:44:58 | --> Translated: https://DOMAIN/ubuntu
[ INFO    ]: 14:44:58 | --> Alias: Bionic-updates
[ INFO    ]: 14:44:58 | Setting up repository https://DOMAIN/ubuntu
[ INFO    ]: 14:44:58 | --> Type: apt-deb
[ INFO    ]: 14:44:58 | --> Translated: https://DOMAIN/ubuntu
[ INFO    ]: 14:44:58 | --> Alias: Bionic
[ INFO    ]: 14:44:58 | Using package manager backend: apt
[ INFO    ]: 14:44:58 | Installing bootstrap packages
[ INFO    ]: 14:44:58 | --> collection type: onlyRequired
[ INFO    ]: 14:44:58 | --> package: apt
[ INFO    ]: 14:44:58 | --> package: apt-transport-https
[ INFO    ]: 14:44:58 | --> package: apt-utils
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/sys]
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/sys]
[ DEBUG   ]: 14:44:58 | EXEC: [umount -l /SOMEDIR/image-root/sys]
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/dev]
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/dev]
[ DEBUG   ]: 14:44:58 | EXEC: [umount -l /SOMEDIR/image-root/dev]
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/proc]
[ DEBUG   ]: 14:44:58 | EXEC: [mountpoint -q /SOMEDIR/image-root/proc]
[ DEBUG   ]: 14:44:58 | EXEC: [umount -l /SOMEDIR/image-root/proc]
[ DEBUG   ]: 14:44:58 | EXEC: [rm -r -f /SOMEDIR/image-root/dev/fd]
[ DEBUG   ]: 14:44:58 | EXEC: [rm -r -f /SOMEDIR/image-root/dev/pts]
[ DEBUG   ]: 14:44:58 | EXEC: [debootstrap --no-check-gpg --variant=minbase --include=apt-transport-https,apt-utils --components=main,multiverse,restricted,universe bionic /SOMEDIR/image-root https://DOMAIN/ubuntu]
[ INFO    ]: Processing: [                                        ] 0%[ DEBUG   ]: 14:44:58 | bootstrap: I: Retrieving InRelease
[ DEBUG   ]: 14:44:58 | bootstrap: I: Retrieving Packages
[ DEBUG   ]: 14:44:59 | bootstrap: I: Validating Packages
[ DEBUG   ]: 14:45:00 | bootstrap: I: Retrieving Packages
[ DEBUG   ]: 14:45:00 | bootstrap: I: Validating Packages
[ DEBUG   ]: 14:45:00 | bootstrap: I: Retrieving Packages
[ DEBUG   ]: 14:45:01 | bootstrap: I: Validating Packages
[ DEBUG   ]: 14:45:09 | bootstrap: I: Retrieving Packages
[ DEBUG   ]: 14:45:11 | bootstrap: I: Validating Packages
[ DEBUG   ]: 14:45:17 | bootstrap: I: Resolving dependencies of required packages...
[ DEBUG   ]: 14:45:35 | bootstrap: I: Resolving dependencies of base packages...
[ DEBUG   ]: 14:45:35 | bootstrap: I: Found additional base dependencies: adduser gpgv libapt-inst2.0 libapt-pkg5.0 libffi6 libgmp10 libgnutls30 libhogweed4 libidn2-0 libnettle6 libp11-kit0 libseccomp2 libssl1.1 libstdc++6 libtasn1-6 libunistring2 openssl ubuntu-keyring
[ DEBUG   ]: 14:45:35 | bootstrap: I: Checking component main on https://DOMAIN/ubuntu...
[ DEBUG   ]: 14:45:35 | bootstrap: I: Checking component restricted on https://DOMAIN/ubuntu...
[ DEBUG   ]: 14:45:36 | bootstrap: I: Checking component universe on https://DOMAIN/ubuntu...
[ DEBUG   ]: 14:45:36 | bootstrap: I: Retrieving adduser 3.116ubuntu1
[ DEBUG   ]: 14:45:36 | bootstrap: I: Validating adduser 3.116ubuntu1
[ DEBUG   ]: 14:45:36 | bootstrap: I: Retrieving apt 1.6.1
[ DEBUG   ]: 14:45:36 | bootstrap: I: Validating apt 1.6.1
[...]
[ DEBUG   ]: 14:46:42 | bootstrap: I: Retrieving apt-transport-https 1.6.1
[ DEBUG   ]: 14:46:42 | bootstrap: I: Validating apt-transport-https 1.6.1
[ DEBUG   ]: 14:46:42 | bootstrap: I: Chosen extractor for .deb packages: dpkg-deb
[ DEBUG   ]: 14:46:42 | bootstrap: I: Extracting base-files...
[...]
[ DEBUG   ]: 14:46:43 | bootstrap: I: Extracting util-linux...
[ DEBUG   ]: 14:46:43 | bootstrap: I: Extracting zlib1g...
[ INFO    ]: Processing: [########################################] 100%
[ ERROR   ]: 14:46:43 | KiwiBootStrapPhaseFailed: Bootstrap package installation failed:
[ INFO    ]: 14:46:43 | Cleaning up SystemPrepare instance
[...cleanup...]

deboostrap which works: sudo debootstrap --no-check-gpg --variant=minbase --include=apt-transport-https,apt-utils --components=main,multiverse,restricted,universe bionic ./boostrap-test https://REPO/ubuntu

Expected behaviour

image is built

Steps to reproduce the behaviour

kiwi --debug --color-output --shared-cache-dir=./kiwi-cache --profile=vmware system build --description=descriptions/ubuntu-18.04-amd64-vmware --target-dir=out/ubuntu-18.04-amd64-vmware with this xml:

<?xml version="1.0" encoding="utf-8"?>
<image schemaversion="7.3" name="ubuntu-18.04-amd64-CURRENT_BUILD_IMAGETYPE">
  <description type="system">
    <author>foo</author>
    <contact>foo</contact>
    <specification>oem disk build for Ubuntu 18.04</specification>
  </description>
  <profiles>
    <!-- import=true makes the profile the default if you cont choose something different -->
    <profile name="vmware" description="VM image for vmware" import="true"/>
  </profiles>
  <preferences>
    <version>CURRENT_BUILD_VERSION</version>
    <packagemanager>apt-get</packagemanager>
    <bootsplash-theme>sabily</bootsplash-theme>
    <bootloader-theme>ubuntu-text</bootloader-theme>
    <locale>en_US</locale>
    <keytable>us</keytable>
    <timezone>UTC</timezone>
    <rpm-check-signatures>false</rpm-check-signatures>
  </preferences>
  <preferences profiles="vmware">
    <type image="oem" filesystem="ext4" format="vmdk" kernelcmdline="earlyprintk=vga product_name='OpenStack Nova' consoleblank=0" firmware="bios">
      <machine guestOS="ubuntu64guest" arch="x86_64" ovftype="vmware">
        <vmdisk diskmode="streamOptimized"/>
      </machine>
      <bootloader name="grub2" console="console"/>
      <oemconfig>
        <oem-resize>false</oem-resize>
      </oemconfig>
    </type>
  </preferences>
  <users profiles="vmware">
    <user home="/root" name="root" groups="root" password="" pwdformat="plain" shell="/bin/bash"/>
    <user home="/home/user" name="user" groups="user,sudo" password="" pwdformat="plain" shell="/bin/bash"/>
  </users>
  <repository type="apt-deb" alias="Bionic-security" distribution="bionic-security" components="main multiverse restricted universe" imageinclude="false" repository_gpgcheck="false">
    <source path="https://DOMAIN/ubuntu"/>
  </repository>
  <repository type="apt-deb" alias="Bionic-updates" distribution="bionic-updates" components="main multiverse restricted universe" imageinclude="false" repository_gpgcheck="false">
    <source path="https://DOMAIN/ubuntu"/>
  </repository>
  <repository type="apt-deb" alias="Bionic" distribution="bionic" components="main multiverse restricted universe" imageinclude="false" repository_gpgcheck="false">
    <source path="https://DOMAIN/ubuntu"/>
  </repository>
  <packages type="image">
    <package name="acpid"/>
    <package name="adduser"/>
    <package name="apport"/>
    <package name="apt"/>
    <package name="apt-utils"/>
    <package name="at"/>
    <package name="bash-completion"/>
    <package name="bcache-tools"/>
    <package name="btrfs-tools"/>
    <package name="byobu"/>
    <package name="bzip2"/>
    <package name="cloud-init"/>
    <package name="console-setup"/>
    <package name="curl"/>
    <package name="dbus"/>
    <package name="debconf"/>
    <package name="debconf-i18n"/>
    <package name="dirmngr"/>
    <package name="dracut"/>
    <package name="eject"/>
    <package name="ethtool"/>
    <package name="fonts-ubuntu-console"/>
    <package name="gdisk"/>
    <package name="git"/>
    <package name="gnupg"/>
    <package name="grub2"/>
    <package name="htop"/>
    <package name="init"/>
    <package name="iproute2"/>
    <package name="iputils-ping"/>
    <package name="isc-dhcp-client"/>
    <package name="isolinux"/>
    <package name="kbd"/>
    <package name="kmod"/>
    <package name="language-pack-en"/>
    <package name="less"/>
    <package name="linux-generic"/>
    <package name="locales"/>
    <package name="lsb-release"/>
    <package name="lvm2"/>
    <package name="mawk"/>
    <package name="mdadm"/>
    <package name="mount"/>
    <package name="netbase"/>
    <package name="netcat-openbsd"/>
    <package name="networkd-dispatcher"/>
    <package name="nplan"/>
    <package name="open-iscsi"/>
    <package name="open-vm-tools"/>
    <package name="openssh-server"/>
    <package name="passwd"/>
    <package name="patch"/>
    <package name="policykit-1"/>
    <package name="procps"/>
    <package name="python3"/>
    <package name="screen"/>
    <package name="sensible-utils"/>
    <package name="shared-mime-info"/>
    <package name="software-properties-common"/>
    <package name="sosreport"/>
    <package name="ssh-import-id"/>
    <package name="sudo"/>
    <package name="syslinux"/>
    <package name="syslinux-common"/>
    <package name="systemd"/>
    <package name="tmux"/>
    <package name="tzdata"/>
    <package name="ubuntu-advantage-tools"/>
    <package name="ubuntu-keyring"/>
    <package name="ubuntu-standard"/>
    <package name="udev"/>
    <package name="unattended-upgrades"/>
    <package name="update-notifier-common"/>
    <package name="vim"/>
    <package name="whiptail"/>
    <package name="xfsprogs"/>
  </packages>
  <packages type="bootstrap">
    <package name="apt-utils"/>
    <package name="apt-transport-https"/>
  </packages>
</image>

OS and Software information

schaefi commented 3 years ago

From our build tests we could not reproduce this issue. Unfortunately the provided information gives us not much chance to know what happened. My suggestion is we will come up with a solution for #1800 and that should give you an opportunity to provide more information next time.

So we are closing this one in favor of #1800 and I'd like to ask you to open another issue when we have the chance to see more error information. Thanks much