ContainerCraft / kmi

KubeVirt Virtual Machine Disk Image Library
Apache License 2.0
10 stars 1 forks source link

[BUG] Problem with multi-arch images #16

Closed usrbinkat closed 2 years ago

usrbinkat commented 2 years ago

Container Data Importer seems to be unable to handle multi-arch manifests.

We should investigate:

CDI Importer Logs [Alternate log on Pastebin](https://termbin.com/qu8g) ``` I1204 06:24:38.040632 1 importer.go:78] Starting importer I1204 06:24:38.040717 1 importer.go:161] begin import process I1204 06:24:38.040732 1 data-processor.go:340] Calculating available size I1204 06:24:38.040739 1 data-processor.go:352] Checking out file system volume size. I1204 06:24:38.040744 1 data-processor.go:360] Request image size not empty. I1204 06:24:38.040751 1 data-processor.go:365] Target size 64G. I1204 06:24:38.040790 1 data-processor.go:243] New phase: TransferScratch I1204 06:24:38.040802 1 registry-datasource.go:82] Copying registry image to scratch space. I1204 06:24:38.040811 1 transport.go:174] Downloading image from 'docker://docker.io/containercraft/fedora', copying file from 'disk' to '/scratch' E1204 06:24:39.232643 1 transport.go:76] Could not create image reference: Error reading manifest latest in docker.io/containercraft/fedora: manifest unknown: manifest unknown E1204 06:24:39.232729 1 data-processor.go:240] manifest unknown: manifest unknown Error reading manifest latest in docker.io/containercraft/fedora kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.(*dockerImageSource).fetchManifest vendor/github.com/containers/image/v5/docker/docker_image_src.go:196 kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.(*dockerImageSource).ensureManifestIsLoaded vendor/github.com/containers/image/v5/docker/docker_image_src.go:223 kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.newImageSourceAttempt vendor/github.com/containers/image/v5/docker/docker_image_src.go:127 kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.newImageSource vendor/github.com/containers/image/v5/docker/docker_image_src.go:69 kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.dockerReference.NewImageSource vendor/github.com/containers/image/v5/docker/docker_transport.go:144 kubevirt.io/containerized-data-importer/pkg/importer.readImageSource pkg/importer/transport.go:74 kubevirt.io/containerized-data-importer/pkg/importer.copyRegistryImage pkg/importer/transport.go:180 kubevirt.io/containerized-data-importer/pkg/importer.CopyRegistryImage pkg/importer/transport.go:228 kubevirt.io/containerized-data-importer/pkg/importer.(*RegistryDataSource).Transfer pkg/importer/registry-datasource.go:83 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessDataWithPause pkg/importer/data-processor.go:197 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessData pkg/importer/data-processor.go:172 main.main cmd/cdi-importer/importer.go:216 runtime.main GOROOT/src/runtime/proc.go:225 runtime.goexit GOROOT/src/runtime/asm_amd64.s:1371 Could not create image reference kubevirt.io/containerized-data-importer/pkg/importer.readImageSource pkg/importer/transport.go:77 kubevirt.io/containerized-data-importer/pkg/importer.copyRegistryImage pkg/importer/transport.go:180 kubevirt.io/containerized-data-importer/pkg/importer.CopyRegistryImage pkg/importer/transport.go:228 kubevirt.io/containerized-data-importer/pkg/importer.(*RegistryDataSource).Transfer pkg/importer/registry-datasource.go:83 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessDataWithPause pkg/importer/data-processor.go:197 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessData pkg/importer/data-processor.go:172 main.main cmd/cdi-importer/importer.go:216 runtime.main GOROOT/src/runtime/proc.go:225 runtime.goexit GOROOT/src/runtime/asm_amd64.s:1371 Failed to read registry image kubevirt.io/containerized-data-importer/pkg/importer.(*RegistryDataSource).Transfer pkg/importer/registry-datasource.go:85 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessDataWithPause pkg/importer/data-processor.go:197 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessData pkg/importer/data-processor.go:172 main.main cmd/cdi-importer/importer.go:216 runtime.main GOROOT/src/runtime/proc.go:225 runtime.goexit GOROOT/src/runtime/asm_amd64.s:1371 Unable to transfer source data to scratch space kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessDataWithPause pkg/importer/data-processor.go:202 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessData pkg/importer/data-processor.go:172 main.main cmd/cdi-importer/importer.go:216 runtime.main GOROOT/src/runtime/proc.go:225 runtime.goexit GOROOT/src/runtime/asm_amd64.s:1371 E1204 06:24:39.233130 1 importer.go:218] manifest unknown: manifest unknown Error reading manifest latest in docker.io/containercraft/fedora kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.(*dockerImageSource).fetchManifest vendor/github.com/containers/image/v5/docker/docker_image_src.go:196 kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.(*dockerImageSource).ensureManifestIsLoaded vendor/github.com/containers/image/v5/docker/docker_image_src.go:223 kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.newImageSourceAttempt vendor/github.com/containers/image/v5/docker/docker_image_src.go:127 kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.newImageSource vendor/github.com/containers/image/v5/docker/docker_image_src.go:69 kubevirt.io/containerized-data-importer/vendor/github.com/containers/image/v5/docker.dockerReference.NewImageSource vendor/github.com/containers/image/v5/docker/docker_transport.go:144 kubevirt.io/containerized-data-importer/pkg/importer.readImageSource pkg/importer/transport.go:74 kubevirt.io/containerized-data-importer/pkg/importer.copyRegistryImage pkg/importer/transport.go:180 kubevirt.io/containerized-data-importer/pkg/importer.CopyRegistryImage pkg/importer/transport.go:228 kubevirt.io/containerized-data-importer/pkg/importer.(*RegistryDataSource).Transfer pkg/importer/registry-datasource.go:83 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessDataWithPause pkg/importer/data-processor.go:197 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessData pkg/importer/data-processor.go:172 main.main cmd/cdi-importer/importer.go:216 runtime.main GOROOT/src/runtime/proc.go:225 runtime.goexit GOROOT/src/runtime/asm_amd64.s:1371 Could not create image reference kubevirt.io/containerized-data-importer/pkg/importer.readImageSource pkg/importer/transport.go:77 kubevirt.io/containerized-data-importer/pkg/importer.copyRegistryImage pkg/importer/transport.go:180 kubevirt.io/containerized-data-importer/pkg/importer.CopyRegistryImage pkg/importer/transport.go:228 kubevirt.io/containerized-data-importer/pkg/importer.(*RegistryDataSource).Transfer pkg/importer/registry-datasource.go:83 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessDataWithPause pkg/importer/data-processor.go:197 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessData pkg/importer/data-processor.go:172 main.main cmd/cdi-importer/importer.go:216 runtime.main GOROOT/src/runtime/proc.go:225 runtime.goexit GOROOT/src/runtime/asm_amd64.s:1371 Failed to read registry image kubevirt.io/containerized-data-importer/pkg/importer.(*RegistryDataSource).Transfer pkg/importer/registry-datasource.go:85 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessDataWithPause pkg/importer/data-processor.go:197 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessData pkg/importer/data-processor.go:172 main.main cmd/cdi-importer/importer.go:216 runtime.main GOROOT/src/runtime/proc.go:225 runtime.goexit GOROOT/src/runtime/asm_amd64.s:1371 Unable to transfer source data to scratch space kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessDataWithPause pkg/importer/data-processor.go:202 kubevirt.io/containerized-data-importer/pkg/importer.(*DataProcessor).ProcessData pkg/importer/data-processor.go:172 main.main cmd/cdi-importer/importer.go:216 runtime.main GOROOT/src/runtime/proc.go:225 runtime.goexit GOROOT/src/runtime/asm_amd64.s:1371 ```
usrbinkat commented 2 years ago

Notes:

usrbinkat commented 2 years ago

False alarm, user error.