search

openzfs / zfs

OpenZFS on Linux and FreeBSD
https://openzfs.github.io/openzfs-docs
Other
10.55k stars 1.74k forks source link

vdev_id labelling multipath disks as partitions on Ubuntu 14.04 #3675

Closed gdevenyi closed 9 years ago

gdevenyi commented 9 years ago

I have a 60-disk JBOD, connected currently through two SF-8088 connectors, one per HBA card, to a separate IO controller on the HBA, eventually there will also be a crossover connector, but I'm short two cords right now.

My HBAs:

06:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)
81:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)

My /etc/zfs/vdev_id.conf

multipath yes

#       PCI_SLOT HBA PORT  CHANNEL NAME
channel 06:00.0  1         A
channel 06:00.0  0         B
channel 81:00.0  1         A
channel 81:00.0  0         B

(Not all ports are currently connected, I'm short SF-8088 connectors until I retire my old array)

My multipath.conf:

defaults {
#       udev_dir                /dev
#       polling_interval        10
#       selector                "round-robin 0"
       path_grouping_policy    multibus
#       uid_attribute           ID_SERIAL
#       prio                    alua
#       path_checker            readsector0
#       rr_min_io               100
#       max_fds                 8192
#       rr_weight               priorities
#       failback                immediate
#       no_path_retry           fail
       user_friendly_names     yes
       find_multipaths         yes
}

blacklist {
  wwid 35002538870021a9d
  wwid 35002538870021a64
  wwid 35000c500634baa33
  wwid 35000c500634b9f07
  wwid 35000c500634baa2f
  wwid 35000c500634bb453
}

My multipath auto-config:

> multipath -ll
mpath38 (35000039638d111dc) dm-58 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:45:0 sday 67:32  active ready running
  `- 9:0:45:0 sddg 70:224 active ready running
mpath23 (35000039638d11cc0) dm-15 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:16:0 sdv  65:80  active ready running
  `- 9:0:16:0 sdcd 69:16  active ready running
mpath40 (35000039638cb6de8) dm-59 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:46:0 sdaz 67:48  active ready running
  `- 9:0:46:0 sddh 70:240 active ready running
mpath55 (35000039638d11e48) dm-45 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:54:0 sdbh 67:176 active ready running
  `- 9:0:54:0 sddp 71:112 active ready running
mpath37 (35000039638d11c24) dm-29 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:30:0 sdaj 66:48  active ready running
  `- 9:0:30:0 sdcr 69:240 active ready running
mpath22 (35000039638d11b68) dm-14 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:15:0 sdu  65:64  active ready running
  `- 9:0:15:0 sdcc 69:0   active ready running
mpath54 (35000039638d11cf8) dm-44 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:38:0 sdar 66:176 active ready running
  `- 9:0:38:0 sdcz 70:112 active ready running
mpath19 (35000039638d12818) dm-11 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:12:0 sdr  65:16  active ready running
  `- 9:0:12:0 sdbz 68:208 active ready running
mpath36 (35000039638cbf7a4) dm-28 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:29:0 sdai 66:32  active ready running
  `- 9:0:29:0 sdcq 69:224 active ready running
mpath21 (35000039638d10a20) dm-13 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:14:0 sdt  65:48  active ready running
  `- 9:0:14:0 sdcb 68:240 active ready running
mpath53 (35000039638d11ee8) dm-43 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:53:0 sdbg 67:160 active ready running
  `- 9:0:53:0 sddo 71:96  active ready running
mpath18 (35000039638d11c48) dm-10 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:11:0 sdq  65:0   active ready running
  `- 9:0:11:0 sdby 68:192 active ready running
mpath35 (35000039638d11e88) dm-27 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:28:0 sdah 66:16  active ready running
  `- 9:0:28:0 sdcp 69:208 active ready running
mpath20 (35000039638d128f0) dm-12 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:13:0 sds  65:32  active ready running
  `- 9:0:13:0 sdca 68:224 active ready running
mpath67 (35000039638d128c0) dm-57 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:60:0 sdbn 68:16  active ready running
  `- 9:0:60:0 sddv 71:208 active ready running
mpath52 (35000039638d13560) dm-42 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:37:0 sdaq 66:160 active ready running
  `- 9:0:37:0 sdcy 70:96  active ready running
mpath17 (35000039638d11c80) dm-9 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:10:0 sdp  8:240  active ready running
  `- 9:0:10:0 sdbx 68:176 active ready running
mpath49 (35000039638d046b4) dm-39 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:51:0 sdbe 67:128 active ready running
  `- 9:0:51:0 sddm 71:64  active ready running
mpath34 (35000039638d12814) dm-26 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:27:0 sdag 66:0   active ready running
  `- 9:0:27:0 sdco 69:192 active ready running
mpath66 (35000039638d127a4) dm-56 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:44:0 sdax 67:16  active ready running
  `- 9:0:44:0 sddf 70:208 active ready running
mpath51 (35000039638d132b8) dm-41 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:52:0 sdbf 67:144 active ready running
  `- 9:0:52:0 sddn 71:80  active ready running
mpath16 (35000039638d127ec) dm-8 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:9:0  sdo  8:224  active ready running
  `- 9:0:9:0  sdbw 68:160 active ready running
mpath48 (35000039638cb9ce8) dm-37 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:35:0 sdao 66:128 active ready running
  `- 9:0:35:0 sdcw 70:64  active ready running
mpath33 (35000039638d11bb0) dm-25 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:26:0 sdaf 65:240 active ready running
  `- 9:0:26:0 sdcn 69:176 active ready running
mpath65 (35000039638d127ac) dm-55 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:59:0 sdbm 68:0   active ready running
  `- 9:0:59:0 sddu 71:192 active ready running
mpath50 (35000039638d12854) dm-40 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:36:0 sdap 66:144 active ready running
  `- 9:0:36:0 sdcx 70:80  active ready running
mpath9 (35000039638cbf400) dm-1 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:1:0  sdh  8:112  active ready running
  `- 9:0:1:0  sdbp 68:48  active ready running
mpath15 (35000039638d12900) dm-7 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:8:0  sdn  8:208  active ready running
  `- 9:0:8:0  sdbv 68:144 active ready running
mpath47 (35000039638d11f70) dm-38 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:50:0 sdbd 67:112 active ready running
  `- 9:0:50:0 sddl 71:48  active ready running
mpath32 (35000039638d11cb8) dm-24 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:25:0 sdae 65:224 active ready running
  `- 9:0:25:0 sdcm 69:160 active ready running
mpath64 (35000039638d11be4) dm-54 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:43:0 sdaw 67:0   active ready running
  `- 9:0:43:0 sdde 70:192 active ready running
mpath8 (35000039638cb2dfc) dm-0 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:0:0  sdg  8:96   active ready running
  `- 9:0:0:0  sdbo 68:32  active ready running
mpath29 (35000039638d12868) dm-21 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:22:0 sdab 65:176 active ready running
  `- 9:0:22:0 sdcj 69:112 active ready running
mpath14 (35000039638d127a8) dm-6 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:7:0  sdm  8:192  active ready running
  `- 9:0:7:0  sdbu 68:128 active ready running
mpath46 (35000039638d132a8) dm-35 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:34:0 sdan 66:112 active ready running
  `- 9:0:34:0 sdcv 70:48  active ready running
mpath31 (35000039638d0354c) dm-23 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:24:0 sdad 65:208 active ready running
  `- 9:0:24:0 sdcl 69:144 active ready running
mpath63 (35000039638d11ba8) dm-53 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:58:0 sdbl 67:240 active ready running
  `- 9:0:58:0 sddt 71:176 active ready running
mpath28 (35000039638d11f0c) dm-20 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:21:0 sdaa 65:160 active ready running
  `- 9:0:21:0 sdci 69:96  active ready running
mpath13 (35000039638d11b6c) dm-5 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:6:0  sdl  8:176  active ready running
  `- 9:0:6:0  sdbt 68:112 active ready running
mpath45 (35000039638d127a0) dm-36 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:49:0 sdbc 67:96  active ready running
  `- 9:0:49:0 sddk 71:32  active ready running
mpath30 (35000039638d127d0) dm-22 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:23:0 sdac 65:192 active ready running
  `- 9:0:23:0 sdck 69:128 active ready running
mpath62 (35000039638d132a0) dm-52 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:42:0 sdav 66:240 active ready running
  `- 9:0:42:0 sddd 70:176 active ready running
mpath27 (35000039638d11c10) dm-19 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:20:0 sdz  65:144 active ready running
  `- 9:0:20:0 sdch 69:80  active ready running
mpath12 (35000039638d13c94) dm-4 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:5:0  sdk  8:160  active ready running
  `- 9:0:5:0  sdbs 68:96  active ready running
mpath59 (35000039638d11c38) dm-49 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:56:0 sdbj 67:208 active ready running
  `- 9:0:56:0 sddr 71:144 active ready running
mpath44 (35000039638d11ce8) dm-34 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:48:0 sdbb 67:80  active ready running
  `- 9:0:48:0 sddj 71:16  active ready running
mpath61 (35000039638d11c9c) dm-51 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:57:0 sdbk 67:224 active ready running
  `- 9:0:57:0 sdds 71:160 active ready running
mpath26 (35000039638d133ac) dm-18 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:19:0 sdy  65:128 active ready running
  `- 9:0:19:0 sdcg 69:64  active ready running
mpath11 (35000039638d12630) dm-3 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:3:0  sdj  8:144  active ready running
  `- 9:0:3:0  sdbr 68:80  active ready running
mpath58 (35000039638d11200) dm-48 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:40:0 sdat 66:208 active ready running
  `- 9:0:40:0 sddb 70:144 active ready running
mpath43 (35000039638d12884) dm-33 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:33:0 sdam 66:96  active ready running
  `- 9:0:33:0 sdcu 70:32  active ready running
mpath60 (35000039638d11ca8) dm-50 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:41:0 sdau 66:224 active ready running
  `- 9:0:41:0 sddc 70:160 active ready running
mpath25 (35000039638d12908) dm-17 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:18:0 sdx  65:112 active ready running
  `- 9:0:18:0 sdcf 69:48  active ready running
mpath10 (35000039638cb2dd8) dm-2 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:2:0  sdi  8:128  active ready running
  `- 9:0:2:0  sdbq 68:64  active ready running
mpath57 (35000039638d11f18) dm-47 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:55:0 sdbi 67:192 active ready running
  `- 9:0:55:0 sddq 71:128 active ready running
mpath42 (35000039638d136dc) dm-32 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:47:0 sdba 67:64  active ready running
  `- 9:0:47:0 sddi 71:0   active ready running
mpath39 (35000039638d13d40) dm-30 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:31:0 sdak 66:64  active ready running
  `- 9:0:31:0 sdcs 70:0   active ready running
mpath24 (35000039638d12844) dm-16 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:17:0 sdw  65:96  active ready running
  `- 9:0:17:0 sdce 69:32  active ready running
mpath56 (35000039638d125d0) dm-46 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:39:0 sdas 66:192 active ready running
  `- 9:0:39:0 sdda 70:128 active ready running
mpath41 (35000039638d11eec) dm-31 TOSHIBA,MG03SCA400
size=3.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 1:0:32:0 sdal 66:80  active ready running
  `- 9:0:32:0 sdct 70:16  active ready running

And finally /dev/disk/by-vdev

> ls -l
ls -l
total 0
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B0-partath16 -> ../../dm-8
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B10-partath57 -> ../../dm-47
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B11-partath67 -> ../../dm-57
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B12-partath15 -> ../../dm-7
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B13-partath20 -> ../../dm-12
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B14-partath25 -> ../../dm-17
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B15-partath30 -> ../../dm-22
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B16-partath35 -> ../../dm-27
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B17-partath9 -> ../../dm-1
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B18-partath11 -> ../../dm-3
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B19-partath56 -> ../../dm-46
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B1-partath21 -> ../../dm-13
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B20-partath66 -> ../../dm-56
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B21-partath45 -> ../../dm-36
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B22-partath55 -> ../../dm-45
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B23-partath65 -> ../../dm-55
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B24-partath14 -> ../../dm-6
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B25-partath19 -> ../../dm-11
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B26-partath24 -> ../../dm-16
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B27-partath29 -> ../../dm-21
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B28-partath34 -> ../../dm-26
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B29-partath41 -> ../../dm-31
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B2-partath26 -> ../../dm-18
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B30-partath48 -> ../../dm-37
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B31-partath54 -> ../../dm-44
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B32-partath64 -> ../../dm-54
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B33-partath44 -> ../../dm-34
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B34-partath53 -> ../../dm-43
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B35-partath63 -> ../../dm-53
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B36-partath13 -> ../../dm-5
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B37-partath18 -> ../../dm-10
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B38-partath23 -> ../../dm-15
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B39-partath28 -> ../../dm-20
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B3-partath31 -> ../../dm-23
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B40-partath33 -> ../../dm-25
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B41-partath39 -> ../../dm-30
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B42-partath46 -> ../../dm-35
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B43-partath52 -> ../../dm-42
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B44-partath62 -> ../../dm-52
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B45-partath42 -> ../../dm-32
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B46-partath51 -> ../../dm-41
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B47-partath61 -> ../../dm-51
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B48-partath12 -> ../../dm-4
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B49-partath17 -> ../../dm-9
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B4-partath36 -> ../../dm-28
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B50-partath22 -> ../../dm-14
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B51-partath27 -> ../../dm-19
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B52-partath32 -> ../../dm-24
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B53-partath37 -> ../../dm-29
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B54-partath43 -> ../../dm-33
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B55-partath50 -> ../../dm-40
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B56-partath60 -> ../../dm-50
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B57-partath40 -> ../../dm-59
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B58-partath49 -> ../../dm-39
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B59-partath59 -> ../../dm-49
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B5-partath8 -> ../../dm-0
lrwxrwxrwx 1 root root 10 Aug 10 12:47 B6-partath10 -> ../../dm-2
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B7-partath58 -> ../../dm-48
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B8-partath38 -> ../../dm-58
lrwxrwxrwx 1 root root 11 Aug 10 12:47 B9-partath47 -> ../../dm-38

Looks like the disks are being labelled as partitions by vdev_id?

nedbass commented 9 years ago

This bug was also reported in #1692. vdev_id doesn't correctly parse device names containing the letter "p" unless it is a delimiter for a partition number. The workaround is to disable user_friendly_names in multipath.conf.

gdevenyi commented 9 years ago

Hrm, I read that, I missed that that was the problem.

ls -l
total 0
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B0 -> ../../dm-8
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B1 -> ../../dm-13
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B10 -> ../../dm-47
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B11 -> ../../dm-57
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B12 -> ../../dm-7
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B13 -> ../../dm-12
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B14 -> ../../dm-17
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B15 -> ../../dm-22
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B16 -> ../../dm-27
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B17 -> ../../dm-1
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B18 -> ../../dm-3
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B19 -> ../../dm-46
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B2 -> ../../dm-18
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B20 -> ../../dm-56
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B21 -> ../../dm-36
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B22 -> ../../dm-45
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B23 -> ../../dm-55
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B24 -> ../../dm-6
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B25 -> ../../dm-11
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B26 -> ../../dm-16
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B27 -> ../../dm-21
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B28 -> ../../dm-26
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B29 -> ../../dm-31
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B3 -> ../../dm-23
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B30 -> ../../dm-37
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B31 -> ../../dm-44
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B32 -> ../../dm-54
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B33 -> ../../dm-34
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B34 -> ../../dm-43
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B35 -> ../../dm-53
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B36 -> ../../dm-5
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B37 -> ../../dm-10
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B38 -> ../../dm-15
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B39 -> ../../dm-20
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B4 -> ../../dm-28
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B40 -> ../../dm-25
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B41 -> ../../dm-30
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B42 -> ../../dm-35
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B43 -> ../../dm-42
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B44 -> ../../dm-52
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B45 -> ../../dm-32
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B46 -> ../../dm-41
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B47 -> ../../dm-51
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B48 -> ../../dm-4
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B49 -> ../../dm-9
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B5 -> ../../dm-0
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B50 -> ../../dm-14
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B51 -> ../../dm-19
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B52 -> ../../dm-24
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B53 -> ../../dm-29
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B54 -> ../../dm-33
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B55 -> ../../dm-40
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B56 -> ../../dm-50
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B57 -> ../../dm-59
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B58 -> ../../dm-39
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B59 -> ../../dm-49
lrwxrwxrwx 1 root root 10 Aug 10 13:16 B6 -> ../../dm-2
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B7 -> ../../dm-48
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B8 -> ../../dm-58
lrwxrwxrwx 1 root root 11 Aug 10 13:16 B9 -> ../../dm-38

Fixed!

One other question, what does "B" in this case refer to?

nedbass commented 9 years ago

The "B" refers to the channel that you defined in vdev_id.conf.

gdevenyi commented 9 years ago

Duplicate of #1692