search

renzhengeek / issues

0 stars 0 forks source link

cluster-md perf: sd 3:0:0:0: Power-on or device reset occurred #88

Open renzhengeek opened 8 years ago

renzhengeek commented 8 years ago

2016-06-28T21:51:32.204607+08:00 ericsp22 kernel: [16117.275631] sd 3:0:0:0: Power-on or device reset occurred 2016-06-28T21:51:42.204602+08:00 ericsp22 kernel: [16127.272780] sd 3:0:0:0: Power-on or device reset occurred

2016-06-28T22:00:07.108456+08:00 ericsp22 corosync[1801]: [TOTEM ] A processor failed, forming new configuration. 2016-06-28T22:00:13.114900+08:00 ericsp22 corosync[1801]: [TOTEM ] A new membership (192.168.100.158:20) was formed. Members left: 1084777649 2016-06-28T22:00:13.117820+08:00 ericsp22 corosync[1801]: [TOTEM ] Failed to receive the leave message. failed: 1084777649 2016-06-28T22:00:13.118057+08:00 ericsp22 corosync[1801]: [QUORUM] Members[1]: 1084777630 2016-06-28T22:00:13.118253+08:00 ericsp22 corosync[1801]: [MAIN ] Completed service synchronization, ready to provide service.

renzhengeek commented 8 years ago

2016-06-28T21:51:52.203335+08:00 ericsp21 kernel: [16474.896616] sd 2:0:0:0: Device offlined - not ready after error recovery 2016-06-28T21:51:52.203363+08:00 ericsp21 kernel: [16474.896633] sd 2:0:0:0: Device offlined - not ready after error recovery 2016-06-28T21:51:52.203367+08:00 ericsp21 kernel: [16474.896635] sd 2:0:0:0: Device offlined - not ready after error recovery 2016-06-28T21:51:52.203369+08:00 ericsp21 kernel: [16474.896636] sd 2:0:0:0: Device offlined - not ready after error recovery 2016-06-28T21:51:52.203372+08:00 ericsp21 kernel: [16474.896637] sd 2:0:0:0: Device offlined - not ready after error recovery 2016-06-28T21:51:52.203374+08:00 ericsp21 kernel: [16474.896638] sd 2:0:0:0: Device offlined - not ready after error recovery 2016-06-28T21:51:52.203376+08:00 ericsp21 kernel: [16474.896639] sd 2:0:0:0: Device offlined - not ready after error recovery 2016-06-28T21:51:52.203378+08:00 ericsp21 kernel: [16474.896641] sd 2:0:0:0: Device offlined - not ready after error recovery 2016-06-28T21:51:52.203381+08:00 ericsp21 kernel: [16474.896651] sd 2:0:0:0: [sda] tag#0 FAILED Result: hostbyte=DID_ABORT driverbyte=DRIVER_OK 2016-06-28T21:51:52.203383+08:00 ericsp21 kernel: [16474.896654] sd 2:0:0:0: [sda] tag#0 CDB: Write(10) 2a 00 01 3c 31 48 00 00 80 00 2016-06-28T21:51:52.203398+08:00 ericsp21 kernel: [16474.896657] blk_update_request: I/O error, dev sda, sector 20721992 2016-06-28T21:51:52.203400+08:00 ericsp21 kernel: [16474.896683] sd 2:0:0:0: rejecting I/O to offline device 2016-06-28T21:51:52.203402+08:00 ericsp21 kernel: [16474.896690] sd 2:0:0:0: rejecting I/O to offline device 2016-06-28T21:51:52.203407+08:00 ericsp21 kernel: [16474.896694] sd 2:0:0:0: rejecting I/O to offline device 2016-06-28T21:51:52.203410+08:00 ericsp21 kernel: [16474.896719] sd 2:0:0:0: rejecting I/O to offline device 2016-06-28T21:51:52.203411+08:00 ericsp21 kernel: [16474.896726] sd 2:0:0:0: rejecting I/O to offline device

renzhengeek commented 8 years ago

[730759.946192] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730760.736054] iscsi_trgt: cmnd_rx_start(1919) 1 72000000 -7 [730760.736058] iscsi_trgt: cmnd_skip_pdu(472) 72000000 1 2a 8192 [730821.897304] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730821.897693] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730821.898060] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730821.898381] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730861.835011] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730861.835458] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730861.835937] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730861.836368] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730923.746263] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730923.746690] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730923.747125] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730923.747584] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730923.747938] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730923.748143] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730923.748402] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730923.748669] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730933.730633] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730933.731064] iscsi_trgt: Logical Unit Reset (05) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730943.715027] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730943.715389] iscsi_trgt: Target Warm Reset (06) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [730953.699481] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:16325548720325120 (Function Complete) [770662.214367] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770662.528016] iscsi_trgt: cmnd_rx_start(1919) 1 7b000000 -7 [770662.528019] iscsi_trgt: cmnd_skip_pdu(472) 7b000000 1 2a 8192 [770724.181668] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770724.182163] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770724.182677] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770724.183191] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770724.183547] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770724.183898] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770724.184325] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770724.184665] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770755.109459] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770755.109880] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770755.110404] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770755.110881] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770755.111338] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.012311] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.012797] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.013310] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.013836] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.014350] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.014815] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.015196] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.015675] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.016050] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.016376] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.016610] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.016800] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.017094] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.017285] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.017488] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.017711] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770848.017916] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770858.000651] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770858.001119] iscsi_trgt: Logical Unit Reset (05) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770867.985077] iscsi_trgt: Abort Task (01) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete) [770867.985540] iscsi_trgt: Target Warm Reset (06) issued on tid:33 lun:0 by sid:17451448610390528 (Function Complete)