search

open-power-host-os / qemu

OpenPOWER Host OS qemu repository
Other
2 stars 3 forks source link

Power9: VM unable to start #5

Closed sathnaga closed 7 years ago

sathnaga commented 7 years ago

Host Env: 4.13.0-3.rc3.dev.gitec0d270.el7.centos.ppc64le qemu-kvm-2.10.0-1.dev.gitc334a4e.el7.centos.ppc64le

Guest: Latest Hostos Iso.

try to Install guest and it gets stuck.

Steps to reproduce:

$ virsh destroy hostos1;virsh undefine hostos1;/usr/bin/virt-install --connect=qemu:///system --hvm --accelerate --name 'hostos1' --machine pseries --memory=32768 --vcpu=32,sockets=1,cores=32,threads=1 --boot cdrom --nographics --serial pty --memballoon none --controller type=scsi,model=virtio-scsi --disk path=/home/sath/hostos-3.0-ppc64le.qcow2,bus=scsi,size=30,format=qcow2 --network=bridge=virbr0,model=virtio,mac=52:54:00:a3:a7:a5 --noautoconsole --cdrom /home/sath/Host_OS-DVD-ppc64le-20170904T220043.iso;virsh console hostos1
Domain hostos1 destroyed

Domain hostos1 has been undefined

WARNING  No operating system detected, VM performance may suffer. Specify an OS with --os-variant for optimal results.

Starting install...
Creating domain...                                                                                                                                                |    0 B  00:00:00     
Domain installation still in progress. You can reconnect to 
the console to complete the installation process.
Connected to domain hostos1
Escape character is ^]
Populating /vdevice methods
Populating /vdevice/vty@30000000
Populating /vdevice/nvram@71000000
Populating /pci@800000020000000
                     00 0800 (D) : 1af4 1000    virtio [ net ]
                     00 1000 (D) : 1af4 1004    virtio [ scsi ]
Populating /pci@800000020000000/scsi@2
       SCSI: Looking for devices
          100000100000000 CD-ROM   : "QEMU     QEMU CD-ROM      2.5+"
          100000000000000 DISK     : "QEMU     QEMU HARDDISK    2.5+"
                     00 1800 (D) : 1b36 000d    serial bus [ usb-xhci ]
No NVRAM common partition, re-initializing...
Scanning USB 
  XHCI: Initializing
Using default console: /vdevice/vty@30000000

  Welcome to Open Firmware

  Copyright (c) 2004, 2017 IBM Corporation All rights reserved.
  This program and the accompanying materials are made available
  under the terms of the BSD License available at
  http://www.opensource.org/licenses/bsd-license.php

Trying to load:  from: /pci@800000020000000/scsi@2/disk@100000100000000 ...   Successfully loaded

Welcome to the Host_OS 20170904T220043 installer!

      Install Host_OS 20170904T220043 (64-bit kernel)                           
      Test this media & install Host_OS 20170904T220043  (64-bit kernel)       
      Rescue a Host_OS system (64-bit kernel)                                  
      Other options...                                                         

      Use the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   

OF stdout device is: /vdevice/vty@30000000
Preparing to boot Linux version 4.13.0-3.rc3.dev.gitec0d270.el7.centos.ppc64le (mockbuild@host-os-jenkins-slave01.aus.stglabs.ibm.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-17) (GCC)) #1 SMP Mon Sep 4 23:03:21 -03 2017
Detected machine type: 0000000000000101
command line: BOOT_IMAGE=/ppc/ppc64/vmlinuz ro
Max number of cores passed to firmware: 1024 (NR_CPUS = 1024)
Calling ibm,client-architecture-support... done
memory layout at init:
  memory_limit : 0000000000000000 (16 MB aligned)
  alloc_bottom : 0000000005d40000
  alloc_top    : 0000000010000000
  alloc_top_hi : 0000000800000000
  rmo_top      : 0000000010000000
  ram_top      : 0000000800000000
instantiating rtas at 0x000000000daf0000... done
prom_hold_cpus: skipped
copying OF device tree...
Building dt strings...
Building dt structure...
Device tree strings 0x0000000005d50000 -> 0x0000000005d50ae5
Device tree struct  0x0000000005d60000 -> 0x0000000005d70000
Quiescing Open Firmware ...
Booting Linux via __start() @ 0x0000000002000000 ...
Mirrored with LTC bug #158282
sathnaga commented 7 years ago

Reproduce from qemu command line

/usr/bin/qemu-system-ppc64 -machine pseries-2.10,accel=kvm,usb=off,dump-guest-core=off -name guest=hostos1 -display none -no-user-config -cdrom /home/sath/Host_OS-DVD-ppc64le-20170904T220043.iso -drive file=/home/sath/hostos-3.0-ppc64le.qcow2,format=qcow2,if=none -boot menu=on -serial stdio -device qemu-xhci,id=usb,bus=pci.0,addr=0x3 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x2 -display none -vga none

SLOF **********************************************************************
QEMU Starting
 Build Date = Aug 21 2017 22:35:55
 FW Version = mockbuild@ release 20170724
 Press "s" to enter Open Firmware.

Press F12 for boot menu.

Populating /vdevice methods
Populating /vdevice/vty@71000000
Populating /vdevice/nvram@71000001
Populating /vdevice/l-lan@71000002
Populating /vdevice/v-scsi@71000003
       SCSI: Looking for devices
          8200000000000000 CD-ROM   : "QEMU     QEMU CD-ROM      2.5+"
Populating /pci@800000020000000
                     00 1000 (D) : 1af4 1004    virtio [ scsi ]
Populating /pci@800000020000000/scsi@2
       SCSI: Looking for devices
                     00 1800 (D) : 1b36 000d    serial bus [ usb-xhci ]
No NVRAM common partition, re-initializing...
Scanning USB 
  XHCI: Initializing
Using default console: /vdevice/vty@71000000

  Welcome to Open Firmware

  Copyright (c) 2004, 2017 IBM Corporation All rights reserved.
  This program and the accompanying materials are made available
  under the terms of the BSD License available at
  http://www.opensource.org/licenses/bsd-license.php

Trying to load:  from: disk ... 
E3405: No such device
Trying to load:  from: /vdevice/v-scsi@71000003/disk@8200000000000000 ...   Successfully loaded

Welcome to the Host_OS 20170904T220043 installer!

      Install Host_OS 20170904T220043 (64-bit kernel)                           
      Test this media & install Host_OS 20170904T220043  (64-bit kernel)       
      Rescue a Host_OS system (64-bit kernel)                                  
      Other options...                                                         

      Use the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   

OF stdout device is: /vdevice/vty@71000000
Preparing to boot Linux version 4.13.0-3.rc3.dev.gitec0d270.el7.centos.ppc64le (mockbuild@host-os-jenkins-slave01.aus.stglabs.ibm.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-17) (GCC)) #1 SMP Mon Sep 4 23:03:21 -03 2017
Detected machine type: 0000000000000101
command line: BOOT_IMAGE=/ppc/ppc64/vmlinuz ro
Max number of cores passed to firmware: 1024 (NR_CPUS = 1024)
Calling ibm,client-architecture-support... done
memory layout at init:
  memory_limit : 0000000000000000 (16 MB aligned)
  alloc_bottom : 0000000005d40000
  alloc_top    : 0000000010000000
  alloc_top_hi : 0000000020000000
  rmo_top      : 0000000010000000
  ram_top      : 0000000020000000
instantiating rtas at 0x000000000daf0000... done
prom_hold_cpus: skipped
copying OF device tree...
Building dt strings...
Building dt structure...
Device tree strings 0x0000000005d50000 -> 0x0000000005d50b00
Device tree struct  0x0000000005d60000 -> 0x0000000005d70000
Quiescing Open Firmware ...
Booting Linux via __start() @ 0x0000000002000000 ...
cdeadmin commented 7 years ago

------- Comment (attachment only) From satheera@in.ibm.com 2017-09-06 03:01:52 EDT-------

cdeadmin commented 7 years ago

------- Comment From lagarcia@br.ibm.com 2017-09-12 09:59:34 EDT------- I think this is a known issue because POWER9 DD1 are not fully compatible with ISA 3.0. Are you using POWER9 DD1 or DD2 machines in your test?

cdeadmin commented 7 years ago

------- Comment From bssrikanth@in.ibm.com 2017-09-12 23:40:20 EDT------- (In reply to comment #8) > I think this is a known issue because POWER9 DD1 are not fully compatible > with ISA 3.0. Are you using POWER9 DD1 or DD2 machines in your test?

We are using ZZ-L DD2 based server.

cdeadmin commented 7 years ago

------- Comment From joserz@br.ibm.com 2017-09-14 11:41:25 EDT------- Hi, I'm working on this one.

I'm pretty sure that this commit will fix it:

https://github.com/torvalds/linux/commit/c9c98bc5cc2ab4e0d5c9ad58286fa7e1670dfded

But I'll compile HostOS kernel and test it just to make sure.

cdeadmin commented 7 years ago

------- Comment From joserz@br.ibm.com 2017-09-14 15:27:35 EDT------- Hello!

You should be able now to boot your guest by using a custom kernel built and installed in zzfp365-lp1.

[root@zzfp365-lp1 ~]# uname -r 4.13.0-rc3-ziviani+

This kernel has the patch mentioned in #comment 12.

I just sent a backport patch to HostOS mailing list in order to include such patch.

[PowerKVM] [PATCH QEMU HostOS-devel] powerpc/mm: Fix pmd/pte_devmap() on non-leaf entries

cdeadmin commented 7 years ago

------- Comment From bssrikanth@in.ibm.com 2017-09-17 23:57:27 EDT------- (In reply to comment #13) > Hello! > > You should be able now to boot your guest by using a custom kernel built and > installed in zzfp365-lp1. > > [root@zzfp365-lp1 ~]# uname -r > 4.13.0-rc3-ziviani+ > > This kernel has the patch mentioned in #comment 12. > > I just sent a backport patch to HostOS mailing list in order to include such > patch. > > [PowerKVM] [PATCH QEMU HostOS-devel] powerpc/mm: Fix pmd/pte_devmap() on > non-leaf entries

When are we going to have this fix in devel or release branch of hostos?

cdeadmin commented 7 years ago

------- Comment From alexey@au1.ibm.com 2017-09-19 09:55:39 EDT------- This went to hostos-devel as a part of v4.13 merge.

sathnaga commented 7 years ago

VM Start working fine with latest update Env: libvirt-3.6.0-3.dev.gitdd9401b.el7.centos.ppc64le qemu-kvm-2.10.0-2.dev.gitbf0fd83.el7.centos.ppc64le 4.13.0-4.dev.git49564cb.el7.centos.ppc64le