zfsonlinux / pkg-zfs

Native ZFS packaging for Debian and Ubuntu
https://launchpad.net/~zfs-native/+archive/daily
308 stars 55 forks source link

grub-probe / grub-probe: error: unknown filesystem. #75

Closed gorstj closed 11 years ago

gorstj commented 11 years ago

Following the instructions at https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem

Getting the error: grub-probe: error: unknown filesystem.

As requested in the guide here is the output of the apt-get commands and grub-probe -vvv /

The drive with the root zpool (called garageroot) is /dev/disk/by-id/scsi-SATA_SAMSUNG_SP2504CS09QJ1GYB13223 (/dev/sda)

Glad of any help!

root@ubuntu:/# apt-cache search zfs-grub grub-common - GRand Unified Bootloader (common files) root@ubuntu:/# apt-cache show zfs-grub N: Can't select versions from package 'zfs-grub' as it is purely virtual N: No packages found root@ubuntu:/# apt-cache policy grub-common zfs-grub grub-common: Installed: 1.99-21ubuntu3.6+zfs1 Candidate: 1.99-21ubuntu3.6+zfs1 Version table: *\ 1.99-21ubuntu3.6+zfs1 0 1001 http://ppa.launchpad.net/zfs-native/grub/ubuntu/ precise/main amd64 Packages 100 /var/lib/dpkg/status 1.99-21ubuntu3 0 500 http://archive.ubuntu.com/ubuntu/ precise/main amd64 Packages zfs-grub: Installed: (none) Candidate: (none) Version table:

root@ubuntu:/# grub-probe -vvv / grub-probe: info: cannot open /boot/grub/device.map'. util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_SAMSUNG_SP2504CS09QJ1GYB13223 (/dev/sda) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x50000f0015b13223 (/dev/sda) util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_ST9250421ASG_5TH01BJQ (/dev/sdc) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x5000c5000df0e77b (/dev/sdc) util/deviceiter.c:396: Already seen /dev/sda (/dev/sda) util/deviceiter.c:396: Already seen /dev/sdc (/dev/sdc) util/deviceiter.c:396: Already seen /dev/sdd (/dev/sdd) util/deviceiter.c:883: No DM devices found grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd0 grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'. grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/disk.c:338: Closinghd0'. grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd1 grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd1. grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc' in open_device() grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd2 grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd' in open_device() grub-core/kern/disk.c:338: Closinghd2'. grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/disk.c:338: Closinghd2'. grub-probe: info: scanning hd0 for LVM. grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device() grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd1 for LVM. grub-core/kern/disk.c:245: Openinghd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closinghd1'. grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/disk.c:338: Closinghd1'. grub-probe: info: scanning hd2 for LVM. grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device() grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/disk.c:338: Closing hd2'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'. grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/disk.c:338: Closinghd0'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1. grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc' in open_device() grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd' in open_device() grub-core/kern/disk.c:338: Closinghd2'. grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/disk.c:338: Closinghd2'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0. grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device() grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1. grub-core/kern/disk.c:245: Openinghd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd1'. grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/disk.c:338: Closinghd1'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2. grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device() grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/disk.c:338: Closing hd2'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda1' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device() grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda2' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd0'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos2. grub-core/kern/disk.c:245: Opening hd0,msdos2'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/kern/disk.c:338: Closinghd0'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos1 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos1. grub-core/kern/disk.c:245: Opening hd0,msdos1'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda1' in open_device() grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda1' grub-core/kern/disk.c:338: Closinghd0'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1. grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/disk.c:338: Closinghd1'. grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc1' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc2' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0xfeed; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd1'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1,msdos2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1,msdos2. grub-core/kern/disk.c:245: Opening hd1,msdos2'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc2' in open_device() grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1,msdos1 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1,msdos1. grub-core/kern/disk.c:245: Openinghd1,msdos1'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc1' in open_device() grub-core/kern/disk.c:338: Closinghd1'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2. grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/disk.c:338: Closinghd2'. grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd1' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0x143; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0x33ed; wanted 0x4552 grub-core/kern/disk.c:338: Closing hd2'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2,msdos1 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2,msdos1. grub-core/kern/disk.c:245: Openinghd2,msdos1'... grub-probe: info: the size of hd2 is 15731711. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd1' in open_device() grub-core/kern/disk.c:338: Closinghd2'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0. grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device() grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos2. grub-core/kern/disk.c:245: Openinghd0,msdos2'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda2' in open_device() grub-core/kern/disk.c:338: Closinghd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos1. grub-core/kern/disk.c:245: Opening hd0,msdos1'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda1' in open_device() grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1. grub-core/kern/disk.c:245: Openinghd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd1'. grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/apple.c:123: bad magic (found 0xfeed; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd1'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1,msdos2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1,msdos2. grub-core/kern/disk.c:245: Opening hd1,msdos2'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc2' in open_device() grub-core/disk/raid.c:676: Found array md/1 (mdraid1x) grub-probe: info: Found array md/1 (mdraid1x). grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1,msdos1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1,msdos1. grub-core/kern/disk.c:245: Opening hd1,msdos1'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc1' in open_device() grub-core/disk/raid.c:676: Found array md/0 (mdraid1x) grub-probe: info: Found array md/0 (mdraid1x). grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2. grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device() grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/partmap/apple.c:123: bad magic (found 0x143; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0x33ed; wanted 0x4552 grub-core/kern/disk.c:338: Closing hd2'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2,msdos1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2,msdos1. grub-core/kern/disk.c:245: Openinghd2,msdos1'... grub-probe: info: the size of hd2 is 15731711. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd1' in open_device() grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd1' grub-core/kern/disk.c:338: Closing hd2'. grub-probe: info: scanning md/0 for LVM. grub-core/kern/disk.c:245: Openingmd/0'... grub-core/disk/raid.c:177: md/0: total_devs=2, disk_size=19513088 grub-core/disk/raid.c:206: md/0: level=1, total_sectors=19513088 grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdc1' grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closingmd/0'. grub-core/kern/disk.c:245: Opening md/0'... grub-core/disk/raid.c:177: md/0: total_devs=2, disk_size=19513088 grub-core/disk/raid.c:206: md/0: level=1, total_sectors=19513088 grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/kern/disk.c:338: Closingmd/0'. grub-probe: info: scanning md/1 for LVM. grub-core/kern/disk.c:245: Opening md/1'... grub-core/disk/raid.c:177: md/1: total_devs=2, disk_size=214777600 grub-core/disk/raid.c:206: md/1: level=1, total_sectors=214777600 grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdc2' grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing md/1'. grub-core/kern/disk.c:245: Openingmd/1'... grub-core/disk/raid.c:177: md/1: total_devs=2, disk_size=214777600 grub-core/disk/raid.c:206: md/1: level=1, total_sectors=214777600 grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/kern/disk.c:338: Closing md/1'. grub-probe: info: scanning hd0 for LVM. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos2 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos2'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos1'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd1 for LVM. grub-core/kern/disk.c:245: Openinghd1'... grub-probe: info: the size of hd1 is 488397168. grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/apple.c:123: bad magic (found 0xfeed; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd1,msdos2 for LVM. grub-core/kern/disk.c:245: Openinghd1,msdos2'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd1,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd1,msdos1'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd2 for LVM. grub-core/kern/disk.c:245: Openinghd2'... grub-probe: info: the size of hd2 is 15731711. grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/partmap/apple.c:123: bad magic (found 0x143; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0x33ed; wanted 0x4552 grub-core/kern/disk.c:338: Closing hd2'. grub-probe: info: scanning hd2,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd2,msdos1'... grub-probe: info: the size of hd2 is 15731711. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closing hd2'. grub-probe: info: /dev/sda2 starts from 32130. grub-probe: info: opening the device hd0. grub-core/kern/disk.c:245: Openinghd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-probe: info: Partition 0 starts from 63. grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-probe: info: Partition 1 starts from 32130. grub-probe: info: opening hd0,msdos2. grub-core/kern/disk.c:245: Opening hd0,msdos2'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/kern/fs.c:54: Detecting zfs... grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda2' in open_device() grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2' grub-core/fs/zfs/zfs.c:784: label ok 0 grub-core/fs/zfs/zfs.c:789: No uberblock found grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/fs/zfs/zfs.c:784: label ok 1 grub-core/fs/zfs/zfs.c:789: No uberblock found grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2' grub-core/fs/zfs/zfs.c:784: label ok 2 grub-core/fs/zfs/zfs.c:789: No uberblock found grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/fs/zfs/zfs.c:784: label ok 3 grub-core/fs/zfs/zfs.c:789: No uberblock found grub-core/kern/fs.c:60: zfs detection failed. grub-core/kern/fs.c:54: Detecting xfs... grub-core/kern/fs.c:60: xfs detection failed. grub-core/kern/fs.c:54: Detecting ufs2... grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2' grub-core/kern/fs.c:60: ufs2 detection failed. grub-core/kern/fs.c:54: Detecting ufs1... grub-core/kern/fs.c:60: ufs1 detection failed. grub-core/kern/fs.c:54: Detecting udf... grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2' grub-core/kern/fs.c:60: udf detection failed. grub-core/kern/fs.c:54: Detecting tarfs... grub-core/kern/fs.c:60: tarfs detection failed. grub-core/kern/fs.c:54: Detecting squash4... grub-core/kern/fs.c:60: squash4 detection failed. grub-core/kern/fs.c:54: Detecting sfs... grub-core/kern/fs.c:60: sfs detection failed. grub-core/kern/fs.c:54: Detecting reiserfs... grub-core/kern/fs.c:60: reiserfs detection failed. grub-core/kern/fs.c:54: Detecting ntfs... grub-core/kern/fs.c:60: ntfs detection failed. grub-core/kern/fs.c:54: Detecting nilfs2... grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/fs.c:60: nilfs2 detection failed. grub-core/kern/fs.c:54: Detecting minix2... grub-core/kern/fs.c:60: minix2 detection failed. grub-core/kern/fs.c:54: Detecting minix... grub-core/kern/fs.c:60: minix detection failed. grub-core/kern/fs.c:54: Detecting jfs... grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2' grub-core/kern/fs.c:60: jfs detection failed. grub-core/kern/fs.c:54: Detecting iso9660... grub-core/kern/fs.c:60: iso9660 detection failed. grub-core/kern/fs.c:54: Detecting hfsplus... grub-core/kern/fs.c:60: hfsplus detection failed. grub-core/kern/fs.c:54: Detecting hfs... grub-core/kern/fs.c:60: hfs detection failed. grub-core/kern/fs.c:54: Detecting fat... grub-core/kern/fs.c:60: fat detection failed. grub-core/kern/fs.c:54: Detecting ext2... grub-core/kern/fs.c:60: ext2 detection failed. grub-core/kern/fs.c:54: Detecting cpiofs... grub-core/kern/fs.c:60: cpiofs detection failed. grub-core/kern/fs.c:54: Detecting btrfs... grub-core/kern/fs.c:60: btrfs detection failed. grub-core/kern/fs.c:54: Detecting befs_be... grub-core/kern/fs.c:60: befs_be detection failed. grub-core/kern/fs.c:54: Detecting befs... grub-core/kern/fs.c:60: befs detection failed. grub-core/kern/fs.c:54: Detecting afs_be... grub-core/kern/fs.c:60: afs_be detection failed. grub-core/kern/fs.c:54: Detecting afs... grub-core/kern/fs.c:60: afs detection failed. grub-core/kern/fs.c:54: Detecting affs... grub-core/kern/fs.c:60: affs detection failed. grub-probe: error: unknown filesystem.

dajhorn commented 11 years ago

How did you create the pool?

Since feature flags were added to the daily PPA a few days ago, root pools must be created like this:

# zpool create -o version=28 -o ashift=9 tank ...
gorstj commented 11 years ago

I used: zpool create rpool /dev/disk/by-id/scsi-SATA_disk1-part2

I will try the above

gorstj commented 11 years ago

When re-installing using the new zpool command I was asked to setup grub-pc (a pink screen). I chose the small boot partition to install grub on.... was this correct? The output from the console after doing this was:

Setting up grub-pc (1.99-21ubuntu3.6+zfs1) ...

Creating config file /etc/default/grub with new version device node not found device node not found device node not found device node not found device node not found device node not found device node not found device node not found /usr/sbin/grub-setup: warn: Attempting to install GRUB to a partitionless disk or to a partition. This is a BAD idea.. /usr/sbin/grub-setup: warn: Embedding is not possible. GRUB can only be installed in this setup by using blocklists. However, blocklists are UNRELIABLE and their use is discouraged.. Installation finished. No error reported. Generating grub.cfg ...

dajhorn commented 11 years ago

I chose the small boot partition to install grub on.... was this correct?

No, you should choose something like /dev/sda and not /dev/sda1 at that prompt.

But don't worry, if you follow the the HOWTO, then you'll run grub-install later, which does the same thing and will fix any earlier mistakes.

gorstj commented 11 years ago

zpool create -o version=28 -o ashift=9 tank ...

This worked a treat! Thanks. Can the how-to be updated with this?

dajhorn commented 11 years ago

This worked a treat! Thanks.

Welcome.

Can the how-to be updated with this?

It already is. (dajhorn/pkg-zfs#74)

gorstj commented 11 years ago

only problem is grub is not auto-running the default boot option. I need to press enter to run the default, non-recovery, linux installation. Is this normal.

As far as I can tell it should default to this after 10 seconds but it doesn't.

Also what is the best way to plan for disaster recovery? Say a loss of one of a pair of mirrored zpool discs.

I have tested and I have got it to boot using the second disc. (I used dd to copy the MBR and boot partition). It does come up with /boot not mounting, but I was a able to skip through this and should be able to change fstab to point to the second disc.

If I needed recreate a failed disc then I would need to just copy the MBR and boot partition to the new replacement disc and then resilver the root partition?

Is there anything I am missing?

treykyle commented 11 years ago

So what's the easiest way to fix this if I like an idiot updated my zfs pool to the new version and now am unable to boot into the system?

dajhorn commented 11 years ago

The pool upgrade cannot be reverted. Your choices are:

treykyle commented 11 years ago

I'd rather not try to recover the ~8tb of data in the pool. I'll see if I can find info on google for upgrading grub from upstream.

treykyle commented 11 years ago

It's amazing how complicated and poorly documented building a local package from an upstream source is. I'd probably have better luck if I just downloaded the source code and compiled it manually instead of trying to use bzr.

dajhorn commented 11 years ago

Yup.

Instead of building from upstream sources, it may be easier to use the slack space at the end of a pool member (ie: sda9) or a small USB drive to create a temporary ext4 /boot area. Unfortunately, either way, fixing this will be lots of frustration.

treykyle commented 11 years ago

On my current setup I've got 6 2tb drives in a zpool and a small usb drive that has /boot/grub on it. Can you explain a little further what you mean with a temporary ext4 /boot area? If I can just copy over the boot internals of ubuntu to that usb drive and have the rest of the OS mount from the zpool once it is recognizable by ubuntu and not grub that should be much easier.

dajhorn commented 11 years ago

The problem here is that grub-1.99 cannot recognize or read ZFS datasets that have feature flags, which means that it cannot load the /boot/vmlinuz or /boot/initrd files and start the kernel.

If you move all of /boot into a non-ZFS filesystem, and run grub-install on that device, and boot from that device, then GRUB can load the kernel and boot the system normally. The /boot/initrd and /boot/grub/grub.cfg files should still be intact and have the right ZFS boot options.

treykyle commented 11 years ago

I'm making a little progress. At this point I have Ubuntu attempting to boot and getting slightly farther. I think it doesn't see the kernel then tries dropping to busy box where it hangs. At this point I think my next option is to copy the Ubuntu root and all it's files to a large enough ext4 partition and forgo grub recognizing ZFS altogether.

mk01 commented 11 years ago

@dajhorn the menu entries are generated wrong, "zfs-bootfs ($root) bootfs" generates error with wrong label. $root itself is already with brackets. after edit to "zfs-bootfs $root bootfs" it works.

@treykyle it was commented in other issue, if you have root != bootfs (you have kernel and boot image on different partition than the zfs ROOT), you have to edit /boot/grub/grub.cfg. You can either create second variable pointing to the zfs ROOT, not the root as GRUB is expecting vmlinuz and initramfs in. Or you omit the zfs-bootfs line and put the rpool= and bootfs= kernel parameters.

first solution sould look like (grub.cfg) root='(hdX,msdosX)' #disk and partition, where your /boot is stored (your vmlinuz and initramfs) rpool='(hdX,gptX)' #where your zfs with ROOT fs is zfs-bootfs $rpool bootfs

second solution: root= stays zfs-bootfs ... you can delete kernel /vmlinuz boot=zfs rpool=[nameofzfspool with ROOT] bootfs=[nameoffs to be /]

mk01 commented 11 years ago

yesterday upgrade to 0.6.0.95-0ubuntu1, grub is 1.99-21ubuntu3.6+zfs1 and zpool

(22:40) [media:~] mk$ sudo zpool upgrade
This system supports ZFS pool feature flags.

All pools are formatted using feature flags.

Every feature flags pool has all supported features enabled.

grub-probe ok, grub command prompt before boot - zfsinfo works, ls works, zfs-bootfs works, search.fs works and system is loading kernel and initram from /ROOT/boot/@

zfs   feature@async_destroy  enabled                local
zfs   feature@empty_bpobj    active                 local
mk01 commented 11 years ago

after second reboot it's like expected "unknown fs"

@dajhorn just a question, does it mean, that online zpool upgrade does not change all the needed flags and parts of the pool and does it only during export/import??? (even reported as upgraded)

dajhorn commented 11 years ago

@mk01, I think that this happens because the older grub release has brittle label recognition. The failure is random and coincidental depending on flush state.

Try the http://github.com/maxximino/grub2.git patches by @maxximino. This is on my todo list, but it would be helpful to get early feedback from affected systems.

mk01 commented 11 years ago

I will have it by tomorrow maybe, anyhow boot is not so critical. ROOT would be much more bigger prrolem.

c0d3x42 commented 11 years ago

To add some feedback, i hit this problem when upgrading zpool with the current ZFS, system would not boot but the pool was intact. I Built @maxximino grub2 and installed it, took a while to manually recreate the necessary grub.cfg entries as the originals had been over written. There are a few warnings/errros about missing floppy drives but other than that It is now booting up OK for me. Would be good to have a working grub2 package, without it /usr/sbin/update-grub will break the system.

jeff-dagenais commented 11 years ago

getting the same error after upgrade: SPL: Loaded module v0.6.0.97-rc14 ZFS: Loaded module v0.6.0.97-rc14, ZFS pool version 5000, ZFS filesystem version 5 grub-common: Installed: 1.99-21ubuntu3.6+zfs1 Linux 3.2.0-37-generic #58-Ubuntu SMP (had the same problem with 3.2.0-29)

(some of the info here is for my fellow intermediate ZFS users, not the expert as for them this will all be quite obvious, but it's good to put it out there for people who are less expert on the topic.)

Rescued and worked-around by booting a fresh ubuntu install with the zfs ppa, then, using bits of https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem, imported my pool, copied it's whole /boot (with kernel and initrd) on another usb stick, mounted that at /mnt/boot, chrooted into /mnt, then purging some packages:

apt-get purge zfs-grub grub-* ubuntu-zfs zfs-initramfs

Then followed the steps from the howto again (only the grub and zfs packages bits) with "--reinstall" (just to be sure), also apt-get dist-upgrade. Then had to:

apt-get install --reinstall grub-pc

to write my USB stick's boot sector and to get some files to appear onto my new /boot/grub (on the USB stick), then edited (still in the chroot) /etc/default/grub and added the bootfs to the kernel's command line (my pool's name is "a"):

GRUB_CMDLINE_LINUX_DEFAULT="boot=zfs rpool=a bootfs=a/ROOT/ubuntu-1 nosplash noplymouth"

invoked:

grub-update

logout the chroot, unmount all the binds, zfs umount -a, zpool export a, reboot and came back on my feet for now.

Thanks for your great work Darik BTW. Cheers!

jeff-dagenais commented 11 years ago

here's more info:

grub-probe -vvv / &> /tmp/grub-probe-unknown-fs

gives: http://pastebin.com/U2v6WxqU

All my disks were given whole to zpool (i.e. no partition tables). zpool status -v gives: http://pastebin.com/HMFu6Lxe

dajhorn commented 11 years ago

@jeff-dagenais, this line matters:

ZFS: Loaded module v0.6.0.97-rc14, ZFS pool version 5000, ZFS filesystem version 5

The "version 5000" means that the pool has feature flags, which is incompatible with the older grub-1.99 package in the PPA. I'm working on updating the PPA with contributed patches, but you are, unfortunately, stuck until then.

Alternatively, you can try to compile GRUB yourself, but that can be a lot of work if you aren't already familiar with the toolchain.

dajhorn commented 11 years ago

This ticket should be resolved by recent updates to ppa:zfs-native/grub and the tutorial. Please reopen this ticket if the problem persists after a doing a system upgrade and reboot.