Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

grub-probe / grub-probe: error: unknown filesystem. #75

Closed
gorstj opened this issue Jan 17, 2013 · 25 comments
Closed

grub-probe / grub-probe: error: unknown filesystem. #75

gorstj opened this issue Jan 17, 2013 · 25 comments
Labels
Enhancement Erratum Upstream

Comments

@gorstj
Copy link

gorstj commented Jan 17, 2013

Following the instructions at https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem

Getting the error: grub-probe: error: unknown filesystem.

As requested in the guide here is the output of the apt-get commands and grub-probe -vvv /

The drive with the root zpool (called garageroot) is /dev/disk/by-id/scsi-SATA_SAMSUNG_SP2504CS09QJ1GYB13223 (/dev/sda)

Glad of any help!

root@ubuntu:/# apt-cache search zfs-grub
grub-common - GRand Unified Bootloader (common files)
root@ubuntu:/# apt-cache show zfs-grub
N: Can't select versions from package 'zfs-grub' as it is purely virtual
N: No packages found
root@ubuntu:/# apt-cache policy grub-common zfs-grub
grub-common:
Installed: 1.99-21ubuntu3.6+zfs1
Candidate: 1.99-21ubuntu3.6+zfs1
Version table:
*** 1.99-21ubuntu3.6+zfs1 0
1001 http://ppa.launchpad.net/zfs-native/grub/ubuntu/ precise/main amd64 Packages
100 /var/lib/dpkg/status
1.99-21ubuntu3 0
500 http://archive.ubuntu.com/ubuntu/ precise/main amd64 Packages
zfs-grub:
Installed: (none)
Candidate: (none)
Version table:

root@ubuntu:/# grub-probe -vvv /
grub-probe: info: cannot open /boot/grub/device.map'. util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_SAMSUNG_SP2504CS09QJ1GYB13223 (/dev/sda) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x50000f0015b13223 (/dev/sda) util/deviceiter.c:396: Already seen /dev/disk/by-id/scsi-SATA_ST9250421ASG_5TH01BJQ (/dev/sdc) util/deviceiter.c:396: Already seen /dev/disk/by-id/wwn-0x5000c5000df0e77b (/dev/sdc) util/deviceiter.c:396: Already seen /dev/sda (/dev/sda) util/deviceiter.c:396: Already seen /dev/sdc (/dev/sdc) util/deviceiter.c:396: Already seen /dev/sdd (/dev/sdd) util/deviceiter.c:883: No DM devices found grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd0 grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd1
grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 488397168.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for dmraid_nv RAID devices on disk hd2 grub-probe: info: Scanning for dmraid_nv RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 15731711.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/disk.c:338: Closinghd2'.
grub-probe: info: scanning hd0 for LVM.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device()
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd1 for LVM. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 488397168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closinghd1'.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/disk.c:338: Closinghd1'.
grub-probe: info: scanning hd2 for LVM.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 15731711.
grub-core/kern/disk.c:338: Closing hd2'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 488397168.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 15731711.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device()
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 488397168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd1'.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/disk.c:338: Closinghd1'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 15731711.
grub-core/kern/disk.c:338: Closing hd2'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda1' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device()
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda2' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos2
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos2.
grub-core/kern/disk.c:245: Opening hd0,msdos2'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd0,msdos1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd0,msdos1.
grub-core/kern/disk.c:245: Opening hd0,msdos1'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda1' in open_device()
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda1' grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/kern/disk.c:338: Closinghd1'.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc1' in open_device()
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc2' in open_device() grub-core/partmap/apple.c:123: bad magic (found 0xfeed; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd1'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1,msdos2
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1,msdos2.
grub-core/kern/disk.c:245: Opening hd1,msdos2'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc2' in open_device()
grub-core/kern/disk.c:338: Closing hd1'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd1,msdos1 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd1,msdos1. grub-core/kern/disk.c:245: Openinghd1,msdos1'...
grub-probe: info: the size of hd1 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc1' in open_device() grub-core/kern/disk.c:338: Closinghd1'.
grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2
grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/disk.c:338: Closinghd2'.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd1' in open_device()
grub-core/partmap/apple.c:123: bad magic (found 0x143; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0x33ed; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd2'. grub-core/disk/raid.c:740: Scanning for mdraid09 RAID devices on disk hd2,msdos1 grub-probe: info: Scanning for mdraid09 RAID devices on disk hd2,msdos1. grub-core/kern/disk.c:245: Openinghd2,msdos1'...
grub-probe: info: the size of hd2 is 15731711.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd1' in open_device() grub-core/kern/disk.c:338: Closinghd2'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0.
grub-core/kern/disk.c:245: Opening hd0'... grub-probe: info: the size of hd0 is 488397168. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda' in open_device()
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos2 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos2. grub-core/kern/disk.c:245: Openinghd0,msdos2'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sda2' in open_device() grub-core/kern/disk.c:338: Closinghd0'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd0,msdos1
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd0,msdos1.
grub-core/kern/disk.c:245: Opening hd0,msdos1'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda1' in open_device()
grub-core/kern/disk.c:338: Closing hd0'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 488397168.
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdc' in open_device() grub-core/kern/disk.c:338: Closinghd1'.
grub-core/kern/disk.c:245: Opening hd1'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/apple.c:123: bad magic (found 0xfeed; wanted 0x4552 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0 grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552 grub-core/kern/disk.c:338: Closinghd1'.
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1,msdos2
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1,msdos2.
grub-core/kern/disk.c:245: Opening hd1,msdos2'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc2' in open_device()
grub-core/disk/raid.c:676: Found array md/1 (mdraid1x)
grub-probe: info: Found array md/1 (mdraid1x).
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd1,msdos1
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd1,msdos1.
grub-core/kern/disk.c:245: Opening hd1,msdos1'... grub-probe: info: the size of hd1 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000 grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdc1' in open_device()
grub-core/disk/raid.c:676: Found array md/0 (mdraid1x)
grub-probe: info: Found array md/0 (mdraid1x).
grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2
grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2.
grub-core/kern/disk.c:245: Opening hd2'... grub-probe: info: the size of hd2 is 15731711. grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sdd' in open_device()
grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 15731711.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/partmap/apple.c:123: bad magic (found 0x143; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0x33ed; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd2'. grub-core/disk/raid.c:740: Scanning for mdraid1x RAID devices on disk hd2,msdos1 grub-probe: info: Scanning for mdraid1x RAID devices on disk hd2,msdos1. grub-core/kern/disk.c:245: Openinghd2,msdos1'...
grub-probe: info: the size of hd2 is 15731711.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/kern/emu/hostdisk.c:722: opening the device /dev/sdd1' in open_device() grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdd1'
grub-core/kern/disk.c:338: Closing hd2'. grub-probe: info: scanning md/0 for LVM. grub-core/kern/disk.c:245: Openingmd/0'...
grub-core/disk/raid.c:177: md/0: total_devs=2, disk_size=19513088
grub-core/disk/raid.c:206: md/0: level=1, total_sectors=19513088
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sdc1' grub-probe: info: no LVM signature found. grub-core/kern/disk.c:338: Closingmd/0'.
grub-core/kern/disk.c:245: Opening md/0'... grub-core/disk/raid.c:177: md/0: total_devs=2, disk_size=19513088 grub-core/disk/raid.c:206: md/0: level=1, total_sectors=19513088 grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552 grub-core/kern/disk.c:338: Closingmd/0'.
grub-probe: info: scanning md/1 for LVM.
grub-core/kern/disk.c:245: Opening md/1'... grub-core/disk/raid.c:177: md/1: total_devs=2, disk_size=214777600 grub-core/disk/raid.c:206: md/1: level=1, total_sectors=214777600 grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sdc2'
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing md/1'. grub-core/kern/disk.c:245: Openingmd/1'...
grub-core/disk/raid.c:177: md/1: total_devs=2, disk_size=214777600
grub-core/disk/raid.c:206: md/1: level=1, total_sectors=214777600
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/kern/disk.c:338: Closing md/1'. grub-probe: info: scanning hd0 for LVM. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos2 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos2'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd0,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd0,msdos1'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd0'. grub-probe: info: scanning hd1 for LVM. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 488397168.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd1'. grub-core/kern/disk.c:245: Openinghd1'...
grub-probe: info: the size of hd1 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000
grub-core/partmap/apple.c:123: bad magic (found 0xfeed; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000
grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000
grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd1,msdos2 for LVM. grub-core/kern/disk.c:245: Openinghd1,msdos2'...
grub-probe: info: the size of hd1 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000
grub-core/partmap/msdos.c:166: partition 1: flag 0x80, type 0xfd, start 0x12a0800, len 0x1bf25000
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd1,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd1,msdos1'...
grub-probe: info: the size of hd1 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x0, type 0xfd, start 0x800, len 0x12a0000
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd1'. grub-probe: info: scanning hd2 for LVM. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 15731711.
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd2'. grub-core/kern/disk.c:245: Openinghd2'...
grub-probe: info: the size of hd2 is 15731711.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/partmap/apple.c:123: bad magic (found 0x143; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 2: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/msdos.c:166: partition 3: flag 0x0, type 0x0, start 0x0, len 0x0
grub-core/partmap/apple.c:123: bad magic (found 0x33ed; wanted 0x4552
grub-core/kern/disk.c:338: Closing hd2'. grub-probe: info: scanning hd2,msdos1 for LVM. grub-core/kern/disk.c:245: Openinghd2,msdos1'...
grub-probe: info: the size of hd2 is 15731711.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0x17, start 0x40, len 0x15b218
grub-probe: info: no LVM signature found.
grub-core/kern/disk.c:338: Closing hd2'. grub-probe: info: /dev/sda2 starts from 32130. grub-probe: info: opening the device hd0. grub-core/kern/disk.c:245: Openinghd0'...
grub-probe: info: the size of hd0 is 488397168.
grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43
grub-probe: info: Partition 0 starts from 63.
grub-core/partmap/apple.c:123: bad magic (found 0xeb63; wanted 0x4552
grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee
grub-probe: info: Partition 1 starts from 32130.
grub-probe: info: opening hd0,msdos2.
grub-core/kern/disk.c:245: Opening hd0,msdos2'... grub-probe: info: the size of hd0 is 488397168. grub-core/partmap/msdos.c:166: partition 0: flag 0x80, type 0xbe, start 0x3f, len 0x7d43 grub-core/partmap/msdos.c:166: partition 1: flag 0x0, type 0xbf, start 0x7d82, len 0x1d1bdbee grub-core/kern/fs.c:54: Detecting zfs... grub-core/kern/emu/hostdisk.c:722: opening the device/dev/sda2' in open_device()
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2'
grub-core/fs/zfs/zfs.c:784: label ok 0
grub-core/fs/zfs/zfs.c:789: No uberblock found
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2'
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/fs/zfs/zfs.c:784: label ok 1 grub-core/fs/zfs/zfs.c:789: No uberblock found grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2'
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2'
grub-core/fs/zfs/zfs.c:784: label ok 2
grub-core/fs/zfs/zfs.c:789: No uberblock found
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2'
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/fs/zfs/zfs.c:784: label ok 3 grub-core/fs/zfs/zfs.c:789: No uberblock found grub-core/kern/fs.c:60: zfs detection failed. grub-core/kern/fs.c:54: Detecting xfs... grub-core/kern/fs.c:60: xfs detection failed. grub-core/kern/fs.c:54: Detecting ufs2... grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2'
grub-core/kern/fs.c:60: ufs2 detection failed.
grub-core/kern/fs.c:54: Detecting ufs1...
grub-core/kern/fs.c:60: ufs1 detection failed.
grub-core/kern/fs.c:54: Detecting udf...
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2'
grub-core/kern/fs.c:60: udf detection failed.
grub-core/kern/fs.c:54: Detecting tarfs...
grub-core/kern/fs.c:60: tarfs detection failed.
grub-core/kern/fs.c:54: Detecting squash4...
grub-core/kern/fs.c:60: squash4 detection failed.
grub-core/kern/fs.c:54: Detecting sfs...
grub-core/kern/fs.c:60: sfs detection failed.
grub-core/kern/fs.c:54: Detecting reiserfs...
grub-core/kern/fs.c:60: reiserfs detection failed.
grub-core/kern/fs.c:54: Detecting ntfs...
grub-core/kern/fs.c:60: ntfs detection failed.
grub-core/kern/fs.c:54: Detecting nilfs2...
grub-core/kern/emu/hostdisk.c:700: reusing open device /dev/sda2' grub-core/kern/fs.c:60: nilfs2 detection failed. grub-core/kern/fs.c:54: Detecting minix2... grub-core/kern/fs.c:60: minix2 detection failed. grub-core/kern/fs.c:54: Detecting minix... grub-core/kern/fs.c:60: minix detection failed. grub-core/kern/fs.c:54: Detecting jfs... grub-core/kern/emu/hostdisk.c:700: reusing open device/dev/sda2'
grub-core/kern/fs.c:60: jfs detection failed.
grub-core/kern/fs.c:54: Detecting iso9660...
grub-core/kern/fs.c:60: iso9660 detection failed.
grub-core/kern/fs.c:54: Detecting hfsplus...
grub-core/kern/fs.c:60: hfsplus detection failed.
grub-core/kern/fs.c:54: Detecting hfs...
grub-core/kern/fs.c:60: hfs detection failed.
grub-core/kern/fs.c:54: Detecting fat...
grub-core/kern/fs.c:60: fat detection failed.
grub-core/kern/fs.c:54: Detecting ext2...
grub-core/kern/fs.c:60: ext2 detection failed.
grub-core/kern/fs.c:54: Detecting cpiofs...
grub-core/kern/fs.c:60: cpiofs detection failed.
grub-core/kern/fs.c:54: Detecting btrfs...
grub-core/kern/fs.c:60: btrfs detection failed.
grub-core/kern/fs.c:54: Detecting befs_be...
grub-core/kern/fs.c:60: befs_be detection failed.
grub-core/kern/fs.c:54: Detecting befs...
grub-core/kern/fs.c:60: befs detection failed.
grub-core/kern/fs.c:54: Detecting afs_be...
grub-core/kern/fs.c:60: afs_be detection failed.
grub-core/kern/fs.c:54: Detecting afs...
grub-core/kern/fs.c:60: afs detection failed.
grub-core/kern/fs.c:54: Detecting affs...
grub-core/kern/fs.c:60: affs detection failed.
grub-probe: error: unknown filesystem.
@dajhorn
Copy link
Member

dajhorn commented Jan 17, 2013

How did you create the pool?

Since feature flags were added to the daily PPA a few days ago, root pools must be created like this:

# zpool create -o version=28 -o ashift=9 tank ...

@gorstj
Copy link
Author

gorstj commented Jan 17, 2013

I used:
zpool create rpool /dev/disk/by-id/scsi-SATA_disk1-part2

I will try the above

@gorstj
Copy link
Author

gorstj commented Jan 17, 2013

When re-installing using the new zpool command I was asked to setup grub-pc (a pink screen).
I chose the small boot partition to install grub on.... was this correct?
The output from the console after doing this was:

Setting up grub-pc (1.99-21ubuntu3.6+zfs1) ...

Creating config file /etc/default/grub with new version
device node not found
device node not found
device node not found
device node not found
device node not found
device node not found
device node not found
device node not found
/usr/sbin/grub-setup: warn: Attempting to install GRUB to a partitionless disk or to a partition. This is a BAD idea..
/usr/sbin/grub-setup: warn: Embedding is not possible. GRUB can only be installed in this setup by using blocklists. However, blocklists are UNRELIABLE and their use is discouraged..
Installation finished. No error reported.
Generating grub.cfg ...

@dajhorn
Copy link
Member

dajhorn commented Jan 17, 2013

I chose the small boot partition to install grub on.... was this correct?

No, you should choose something like /dev/sda and not /dev/sda1 at that prompt.

But don't worry, if you follow the the HOWTO, then you'll run grub-install later, which does the same thing and will fix any earlier mistakes.

@gorstj
Copy link
Author

gorstj commented Jan 17, 2013

zpool create -o version=28 -o ashift=9 tank ...

This worked a treat! Thanks. Can the how-to be updated with this?

@dajhorn
Copy link
Member

dajhorn commented Jan 17, 2013

This worked a treat! Thanks.

Welcome.

Can the how-to be updated with this?

It already is. (dajhorn/pkg-zfs#74)

@gorstj
Copy link
Author

gorstj commented Jan 18, 2013

only problem is grub is not auto-running the default boot option. I need to press enter to run the default, non-recovery, linux installation. Is this normal.

As far as I can tell it should default to this after 10 seconds but it doesn't.

Also what is the best way to plan for disaster recovery? Say a loss of one of a pair of mirrored zpool discs.

I have tested and I have got it to boot using the second disc. (I used dd to copy the MBR and boot partition). It does come up with /boot not mounting, but I was a able to skip through this and should be able to change fstab to point to the second disc.

If I needed recreate a failed disc then I would need to just copy the MBR and boot partition to the new replacement disc and then resilver the root partition?

Is there anything I am missing?

@treykyle
Copy link

So what's the easiest way to fix this if I like an idiot updated my zfs pool to the new version and now am unable to boot into the system?

@dajhorn
Copy link
Member

dajhorn commented Jan 23, 2013

The pool upgrade cannot be reverted. Your choices are:

  • Destroy and recreate the pool.
  • Build a local package from the upstream grub sources that can recognize the latest pool version.

@treykyle
Copy link

I'd rather not try to recover the ~8tb of data in the pool. I'll see if I can find info on google for upgrading grub from upstream.

@treykyle
Copy link

It's amazing how complicated and poorly documented building a local package from an upstream source is. I'd probably have better luck if I just downloaded the source code and compiled it manually instead of trying to use bzr.

@dajhorn
Copy link
Member

dajhorn commented Jan 23, 2013

Yup.

Instead of building from upstream sources, it may be easier to use the slack space at the end of a pool member (ie: sda9) or a small USB drive to create a temporary ext4 /boot area. Unfortunately, either way, fixing this will be lots of frustration.

@treykyle
Copy link

On my current setup I've got 6 2tb drives in a zpool and a small usb drive that has /boot/grub on it. Can you explain a little further what you mean with a temporary ext4 /boot area? If I can just copy over the boot internals of ubuntu to that usb drive and have the rest of the OS mount from the zpool once it is recognizable by ubuntu and not grub that should be much easier.

@dajhorn
Copy link
Member

dajhorn commented Jan 23, 2013

The problem here is that grub-1.99 cannot recognize or read ZFS datasets that have feature flags, which means that it cannot load the /boot/vmlinuz or /boot/initrd files and start the kernel.

If you move all of /boot into a non-ZFS filesystem, and run grub-install on that device, and boot from that device, then GRUB can load the kernel and boot the system normally. The /boot/initrd and /boot/grub/grub.cfg files should still be intact and have the right ZFS boot options.

@treykyle
Copy link

I'm making a little progress. At this point I have Ubuntu attempting to boot and getting slightly farther. I think it doesn't see the kernel then tries dropping to busy box where it hangs. At this point I think my next option is to copy the Ubuntu root and all it's files to a large enough ext4 partition and forgo grub recognizing ZFS altogether.

@mk01
Copy link

mk01 commented Jan 23, 2013

@dajhorn the menu entries are generated wrong, "zfs-bootfs ($root) bootfs" generates error with wrong label. $root itself is already with brackets. after edit to "zfs-bootfs $root bootfs" it works.

@treykyle it was commented in other issue, if you have root != bootfs (you have kernel and boot image on different partition than the zfs ROOT), you have to edit /boot/grub/grub.cfg. You can either create second variable pointing to the zfs ROOT, not the root as GRUB is expecting vmlinuz and initramfs in. Or you omit the zfs-bootfs line and put the rpool= and bootfs= kernel parameters.

first solution sould look like (grub.cfg)
root='(hdX,msdosX)' #disk and partition, where your /boot is stored (your vmlinuz and initramfs)
rpool='(hdX,gptX)' #where your zfs with ROOT fs is
zfs-bootfs $rpool bootfs

second solution:
root= stays
zfs-bootfs ... you can delete
kernel /vmlinuz boot=zfs rpool=[nameofzfspool with ROOT] bootfs=[nameoffs to be /]

@mk01
Copy link

mk01 commented Feb 1, 2013

yesterday upgrade to 0.6.0.95-0ubuntu1, grub is 1.99-21ubuntu3.6+zfs1 and zpool

(22:40) [media:~] mk$ sudo zpool upgrade
This system supports ZFS pool feature flags.

All pools are formatted using feature flags.

Every feature flags pool has all supported features enabled.

grub-probe ok, grub command prompt before boot - zfsinfo works, ls works, zfs-bootfs works, search.fs works and system is loading kernel and initram from /ROOT/boot/@

zfs   feature@async_destroy  enabled                local
zfs   feature@empty_bpobj    active                 local

@mk01
Copy link

mk01 commented Feb 3, 2013

after second reboot it's like expected "unknown fs"

@dajhorn just a question, does it mean, that online zpool upgrade does not change all the needed flags and parts of the pool and does it only during export/import??? (even reported as upgraded)

@dajhorn
Copy link
Member

dajhorn commented Feb 3, 2013

@mk01, I think that this happens because the older grub release has brittle label recognition. The failure is random and coincidental depending on flush state.

Try the http://github.com/maxximino/grub2.git patches by @maxximino. This is on my todo list, but it would be helpful to get early feedback from affected systems.

@mk01
Copy link

mk01 commented Feb 4, 2013

I will have it by tomorrow maybe, anyhow boot is not so critical. ROOT would be much more bigger prrolem.

@c0d3x42
Copy link

c0d3x42 commented Feb 8, 2013

To add some feedback, i hit this problem when upgrading zpool with the current ZFS, system would not boot but the pool was intact. I Built @maxximino grub2 and installed it, took a while to manually recreate the necessary grub.cfg entries as the originals had been over written. There are a few warnings/errros about missing floppy drives but other than that It is now booting up OK for me.
Would be good to have a working grub2 package, without it /usr/sbin/update-grub will break the system.

@jeff-dagenais
Copy link

getting the same error after upgrade:
SPL: Loaded module v0.6.0.97-rc14
ZFS: Loaded module v0.6.0.97-rc14, ZFS pool version 5000, ZFS filesystem version 5
grub-common:
Installed: 1.99-21ubuntu3.6+zfs1
Linux 3.2.0-37-generic #58-Ubuntu SMP (had the same problem with 3.2.0-29)

(some of the info here is for my fellow intermediate ZFS users, not the expert as for them this will all be quite obvious, but it's good to put it out there for people who are less expert on the topic.)

Rescued and worked-around by booting a fresh ubuntu install with the zfs ppa, then, using bits of https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem, imported my pool, copied it's whole /boot (with kernel and initrd) on another usb stick, mounted that at /mnt/boot, chrooted into /mnt, then purging some packages:

apt-get purge zfs-grub grub-* ubuntu-zfs zfs-initramfs

Then followed the steps from the howto again (only the grub and zfs packages bits) with "--reinstall" (just to be sure), also apt-get dist-upgrade. Then had to:

apt-get install --reinstall grub-pc

to write my USB stick's boot sector and to get some files to appear onto my new /boot/grub (on the USB stick), then edited (still in the chroot) /etc/default/grub and added the bootfs to the kernel's command line (my pool's name is "a"):

GRUB_CMDLINE_LINUX_DEFAULT="boot=zfs rpool=a bootfs=a/ROOT/ubuntu-1 nosplash noplymouth"

invoked:

grub-update

logout the chroot, unmount all the binds, zfs umount -a, zpool export a, reboot and came back on my feet for now.

Thanks for your great work Darik BTW. Cheers!

@jeff-dagenais
Copy link

here's more info:

grub-probe -vvv / &> /tmp/grub-probe-unknown-fs

gives: http://pastebin.com/U2v6WxqU

All my disks were given whole to zpool (i.e. no partition tables).
zpool status -v gives: http://pastebin.com/HMFu6Lxe

@dajhorn
Copy link
Member

dajhorn commented Feb 10, 2013

@jeff-dagenais, this line matters:

ZFS: Loaded module v0.6.0.97-rc14, ZFS pool version 5000, ZFS filesystem version 5

The "version 5000" means that the pool has feature flags, which is incompatible with the older grub-1.99 package in the PPA. I'm working on updating the PPA with contributed patches, but you are, unfortunately, stuck until then.

Alternatively, you can try to compile GRUB yourself, but that can be a lot of work if you aren't already familiar with the toolchain.

@dajhorn
Copy link
Member

dajhorn commented Feb 11, 2013

This ticket should be resolved by recent updates to ppa:zfs-native/grub and the tutorial. Please reopen this ticket if the problem persists after a doing a system upgrade and reboot.

@dajhorn dajhorn closed this as completed Feb 11, 2013
@azeemism azeemism mentioned this issue Jan 30, 2015
Open
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
Enhancement Erratum Upstream
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@c0d3x42 @jeff-dagenais @dajhorn @treykyle @gorstj @mk01