Closed mholl1983 closed 1 year ago
similar messages show up for all sorts of errors related to drives. loose connections can cause it but so can a failing drive or even some types of issue between the drive/controller firmware/drivers.
If this started happening on a device where nothing changed recently it probably means a drive is failing. It might be worth shutting down and pulling/reinserting all the drives to ensure there isn't a bad connection somehow.
it might be trying to show you a recovery shell that you can't see because of all the sata errors. you could try sending ctrl+alt+f2 to see if you can access via an alternate virtual terminal.... I don't actually know if that shell supports that or not but it's worth a try. otherwise the prompt usually says something like "enter root password for recovery shell", you could try blindly typing your root password and hitting enter. If you manage to get to a recovery shell you could comment whatever file system is failing to start etc.
Thank you for the reply! I'll try to reseat the drives and perhaps first use compressed air to blow out any dust/debris that may be in the connections.
Interesting about the recovery shell. I'll give that a spin if I continue to have issues. Will report back with results. Thank you!
Thinking of contingency plans in the meantime. I'd likely build a mid-tower with Linux or Windows to replace the TS, though I hope I can still squeeze a bit more life out of the TS. Still, I'm aware it's an older piece of kit and it won't last forever, but it's just such a formidable little tank!
Anyways, I have a fairly recent backup on a USB drive (lesson learned after losing some data in the past, as you know!) But if I can't get back into the TS box, it'd be nice to try to retrieve data from the 4 drives/raid array. Did you say if I wanted to do that, I'd have to hook up all 4 to a computer running Linux?
you could try sending ctrl+alt+f2 to see if you can access via an alternate virtual terminal
When would I do this command, btw? At any particular point during the serial connection output?
I isolated drive 1 as what seems to be the "problem drive". It was making a loud clicking noise the last time I tried a boot. IIRC, RAID 5 can handle 1 drive failure and continue to work?
Currently, the TS is going through its boot process and seems to be proceeding. Very interesting!
I now see this prompt.
And I'm now in emergency mode and can access fstab, etc. Not sure what to check for, but at least it's something!
I guess my raid5 will work in degraded mode, so I could potentially back up everything just to be safe and then check the health of the drives in the TS/replace as needed.
Nice!
I'm guessing the reason it didn't boot all the way is that the degraded array didn't start which prevented it from being mounted which in turn prevented boot because it isn't listed as optional in the fstab.
What I would probably do:
/etc/fstab
and comment out the RAID5 array temporarilymdadm --detail
to figure out what's going on with the arraySounds like a good plan! I packed it in for the day, but will definitely follow suit on this tomorrow or shortly after.
If I replace a failed drive and rebuild the array, I shouldn't lose my files?
Thanks again!
Thinking of contingency plans in the meantime. I'd likely build a mid-tower with Linux or Windows to replace the TS, though I hope I can still squeeze a bit more life out of the TS. Still, I'm aware it's an older piece of kit and it won't last forever, but it's just such a formidable little tank!
Anyways, I have a fairly recent backup on a USB drive (lesson learned after losing some data in the past, as you know!) But if I can't get back into the TS box, it'd be nice to try to retrieve data from the 4 drives/raid array. Did you say if I wanted to do that, I'd have to hook up all 4 to a computer running Linux?
Sorry, just noticed the previous messages. Once you're in you should be able to force start the array which you could then access normally to retrieve any data etc. You could then replace the drive and re-sync etc.
Someone (possibly even me) should probably develop a better set of best practices for these devices. I can see why it might default to not starting a degraded RAID5....but for a device with no console that does way more harm than good. Same for non-optional filsystems though that depends heavily on what the filesystem does.
Fairly recently I repurposed some old PC parts into a sort of NAS/files server which has proved to be an interesting experiment for me. It's now my main storage system which backs itself up to some Terastations. I find they complement each other will since I can enable some more CPU intensive features on the PC/NAS and am getting surprisingly good backup performance by limiting the TS to just receiving those backups etc.
Sounds like a good plan! I packed it in for the day, but will definitely follow suit on this tomorrow or shortly after.
If I replace a failed drive and rebuild the array, I shouldn't lose my files?
Thanks again!
Like you said, RAID5 can handle a single drive failure. Re-syncing can take a long time and does stress the other drives, so if you don't have a full backup you should probably do that first once you get the array started and mounted again.
So, gave your suggestion a try and I was able to get the device to boot while bypassing the array. Yay! Great tip!
Here's the result of mdadm --detail
on the array:
This is with all 4 drives nestled in the bays. I was expecting 3 active devices, not 2. Is this related to the array not starting up or is something else going on? Thanks again.
Here's the output for lsblk
, too, in case it helps:
Hmm, that is worrying. The partitions on sda don’t appear to be active in their arrays, the question is: when did that happen?
could be something that happened while you were troubleshooting the sdd problems. If so you can probably force assemble your RAID5 and move forward.
If this happened a long time ago and you didn’t notice the the array might have been degraded for a long time until failing with the death of sdd. That might explain why it failed to boot the way it did. Hopefully not since that might not be recoverable.
First thing I would do is see what mdadm says about sda. Try: mdadm —examine /dev/sda6
that should tell you the state of that part of the array, you should be able to compare that to the output from for the other two
Thanks for writing and for the tips!
Here's what the command shows. I'm guessing I missed something.
guessing something about the command is mangled, maybe the double-hyphen. Here's output from one of my boxes (my disk isn't partitioned but it should otherwise be the same)
# mdadm --examine /dev/sda
/dev/sda:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 60497d:2e957a:fda249:022cc6
Name : md99
Creation Time : Tue Jan 18 19:57:30 2022
Raid Level : raid5
Raid Devices : 7
Avail Dev Size : 7813776048 (3725.90 GiB 4000.65 GB)
Array Size : 23441316864 (22355.38 GiB 24003.91 GB)
Used Dev Size : 7813772288 (3725.90 GiB 4000.65 GB)
Data Offset : 261120 sectors
Super Offset : 8 sectors
Unused Space : before=261040 sectors, after=3760 sectors
State : clean
Device UUID : 19ebc0:0d0e82:34210cfc:1a38fdc
Internal Bitmap : 8 sectors from superblock
Update Time : Thu Dec 8 11:45:16 2022
Bad Block Log : 512 entries available at offset 24 sectors
Checksum : 1366004 - correct
Events : 103301
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
D'oh! It was that, apologies. Here's the output:
marc@debian:~$ sudo mdadm --examine /dev/sda6
/dev/sda6:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 46c1d87e:e7b2970a:3edd105f:c51f08fe
Name : TS-XEL02C:2
Creation Time : Sat Sep 26 15:27:40 2020
Raid Level : raid5
Raid Devices : 4
Avail Dev Size : 1923497952 sectors (917.20 GiB 984.83 GB)
Array Size : 2885245440 KiB (2.69 TiB 2.95 TB)
Used Dev Size : 1923496960 sectors (917.19 GiB 984.83 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
Unused Space : before=1968 sectors, after=992 sectors
State : active
Device UUID : 18ae8cf5:e463c0b7:824d70b5:b88498c3
Internal Bitmap : 8 sectors from superblock
Update Time : Sat Nov 26 14:46:23 2022
Checksum : e8dd79b4 - correct
Events : 39140
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAAA ('A' == active, '.' == missing, 'R' == replacing)
Deja vu!
marc@debian:~$ sudo mdadm --assemble /dev/md2 /dev/sda6 /dev/sdb6 /dev/sdc6 --force
mdadm: forcing event count in /dev/sda6(1) from 39140 up to 39795
mdadm: Marking array /dev/md2 as 'clean'
mdadm: /dev/md2 has been started with 3 drives (out of 4).
marc@debian:~$ sudo mdadm --detail /dev/md1/
mdadm: cannot open /dev/md1/: Not a directory
marc@debian:~$ sudo mdadm --detail /dev/md2
/dev/md2:
Version : 1.2
Creation Time : Sat Sep 26 15:27:40 2020
Raid Level : raid5
Array Size : 2885245440 (2.69 TiB 2.95 TB)
Used Dev Size : 961748480 (917.19 GiB 984.83 GB)
Raid Devices : 4
Total Devices : 3
Persistence : Superblock is persistent
Intent Bitmap : Internal
Update Time : Sat Nov 26 14:46:23 2022
State : clean, degraded
Active Devices : 3
Working Devices : 3
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 512K
Consistency Policy : bitmap
Name : TS-XEL02C:2
UUID : 46c1d87e:e7b2970a:3edd105f:c51f08fe
Events : 39795
Number Major Minor RaidDevice State
- 0 0 0 removed
1 8 6 1 active sync /dev/sda6
2 8 22 2 active sync /dev/sdb6
3 8 38 3 active sync /dev/sdc6
Now I'm a little worried. sudo mdadm --detail /dev/md2
gives a "no such file or directory" error. I feel I should leave it for now, as I don't want to muck things up further.
mdadm --detail --scan
will list all the arrays it knows about, it might have started as /dev/md127
or something like that.
If it's still active I'd recommend mounting it and backing up any data you care about before you worry about anything else.
Last login: Fri Dec 9 09:25:46 2022 from 192.168.50.125
marc@debian:~$ sudo mdadm --detail --scan
[sudo] password for marc:
ARRAY /dev/md0 metadata=0.90 UUID=e7194c7c:f3579d9d:529ae12f:b827b7aa
ARRAY /dev/md/10 metadata=1.2 name=TS-XEL-EM02C:10 UUID=db00a7ae:43c0dfeb:89959a8c:b4b581b3
ARRAY /dev/md/1 metadata=1.2 name=TS-XEL-EM02C:1 UUID=d6c17ec0:cc93ec32:218a896f:4358e4cf
INACTIVE-ARRAY /dev/md2 metadata=1.2 name=TS-XEL02C:2 UUID=46c1d87e:e7b2970a:3edd105f:c51f08fe
marc@debian:~$ stopped /dev/md1
-bash: stopped: command not found
marc@debian:~$ sudo mdadm -S /dev/md2
mdadm: stopped /dev/md2
marc@debian:~$ sudo mdadm --assemble /dev/md2 /dev/sdb6 /dev/sdc6 /dev/sdd6 --force
mdadm: forcing event count in /dev/sdb6(1) from 39797 up to 39799
mdadm: /dev/md2 has been started with 3 drives (out of 4).
marc@debian:~$ mount /dev/md2 /mnt/array
mount: /mnt/array: must be superuser to use mount.
dmesg(1) may have more information after failed mount system call.
marc@debian:~$ sudo mount /dev/md2 /mnt/array
mount: /mnt/array: special device /dev/md2 does not exist.
dmesg(1) may have more information after failed mount system call.
marc@debian:~$ mount /dev/md2 /mnt/array
mount: /mnt/array: must be superuser to use mount.
dmesg(1) may have more information after failed mount system call.
marc@debian:~$ su
Password:
root@debian:/home/marc# mount /dev/md2 /mnt/array
mount: /mnt/array: special device /dev/md2 does not exist.
dmesg(1) may have more information after failed mount system call.
root@debian:/home/marc# mdadm --detail --scan
bash: mdadm: command not found
root@debian:/home/marc# mdadm --detail --scan
bash: mdadm: command not found
root@debian:/home/marc# sudo mdadm
Usage: mdadm --help
for help
root@debian:/home/marc# sudo mdadm --detail --scan
ARRAY /dev/md0 metadata=0.90 UUID=e7194c7c:f3579d9d:529ae12f:b827b7aa
ARRAY /dev/md/10 metadata=1.2 name=TS-XEL-EM02C:10 UUID=db00a7ae:43c0dfeb:89959a8c:b4b581b3
ARRAY /dev/md/1 metadata=1.2 name=TS-XEL-EM02C:1 UUID=d6c17ec0:cc93ec32:218a896f:4358e4cf
Seems like I'm able to force build the array but can't mount it, and then it seems to disappear? Let me know if I am missing something. Like you suggested, just trying to make it active w/ 3 drives to try to do a full backup or as much as possible at this point. Thanks again!
take a look at dmesg
also, if your data is worth thousands of dollars you might consider taking all your drives to one of those data recovery companies.
you may want to get a full root shell to make this a bit easier, sudo su -
ls /sys/block
Thanks! It'll be sad, but not the end of the world if I lose any or all data. I made a point of keeping our important files elsewhere on my main computer and backed up to an external USB drive. The TS-XEL raid array houses all of our media, so it's kind of a local "streaming box", as I affectionately call it.
Will try what you suggested above and let you know how it goes. I have a new Seagate drive on the way, but I have a feeling there's more damage than just one drive going bad. Thanks so much again and I'll keep you posted!
Output from ls /sys/block
md0 md1 md10 mtdblock0 mtdblock1 sdc sdd
Output from dmesg (sorry for the long message!)
root@debian:/home/marc# dmesg
[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 6.0.0-5-marvell (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-9) 12.2.0, GNU ld (GNU Binutils for Debian) 2.39) #1 Debian 6.0.10-2 (2022-12-01)
[ 0.000000] CPU: Feroceon 88FR131 [56251311] revision 1 (ARMv5TE), cr=0005317f
[ 0.000000] CPU: VIVT data cache, VIVT instruction cache
[ 0.000000] OF: fdt: Machine model: Buffalo Terastation TS-XEL
[ 0.000000] Memory policy: Data cache writeback
[ 0.000000] Zone ranges:
[ 0.000000] Normal [mem 0x0000000000000000-0x000000000fffffff]
[ 0.000000] HighMem empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000000000-0x000000000fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000000fffffff]
[ 0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[ 0.000000] pcpu-alloc: [0] 0
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 65024
[ 0.000000] Kernel command line: console=ttyS0,115200
[ 0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes, linear)
[ 0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes, linear)
[ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off
[ 0.000000] Memory: 244732K/262144K available (5031K kernel code, 833K rwdata, 1508K rodata, 320K init, 246K bss, 17412K reserved, 0K cma-reserved, 0K highmem)
[ 0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] ftrace: allocating 24229 entries in 72 pages
[ 0.000000] ftrace: allocated 71 pages with 4 groups
[ 0.000000] trace event string verifier disabled
[ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[ 0.000000] clocksource: orion_clocksource: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 9556302233 ns
[ 0.000002] sched_clock: 32 bits at 200MHz, resolution 5ns, wraps every 10737418237ns
[ 0.000042] Switching to timer-based delay loop, resolution 5ns
[ 0.000287] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
[ 0.000318] pid_max: default: 32768 minimum: 301
[ 0.000922] LSM: Security Framework initializing
[ 0.001274] landlock: Up and running.
[ 0.001285] Yama: disabled by default; enable with sysctl kernel.yama.*
[ 0.001581] AppArmor: AppArmor initialized
[ 0.001962] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.001996] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.004131] CPU: Testing write buffer coherency: ok
[ 0.006581] cblist_init_generic: Setting adjustable number of callback queues.
[ 0.006598] cblist_init_generic: Setting shift to 0 and lim to 1.
[ 0.006891] cblist_init_generic: Setting shift to 0 and lim to 1.
[ 0.007266] Setting up static identity map for 0x8220 - 0x825c
[ 0.007563] mvebu-soc-id: MVEBU SoC ID=0x6281, Rev=0x3
[ 0.009272] devtmpfs: initialized
[ 0.015204] VFP support v0.3: not present
[ 0.015382] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 0.015423] futex hash table entries: 256 (order: -1, 3072 bytes, linear)
[ 0.015646] pinctrl core: initialized pinctrl subsystem
[ 0.018097] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[ 0.018890] DMA: preallocated 256 KiB pool for atomic coherent allocations
[ 0.019926] audit: initializing netlink subsys (disabled)
[ 0.020419] audit: type=2000 audit(0.020:1): state=initialized audit_enabled=0 res=1
[ 0.021350] thermal_sys: Registered thermal governor 'fair_share'
[ 0.021366] thermal_sys: Registered thermal governor 'bang_bang'
[ 0.021375] thermal_sys: Registered thermal governor 'step_wise'
[ 0.021381] thermal_sys: Registered thermal governor 'user_space'
[ 0.021479] cpuidle: using governor ladder
[ 0.021845] Feroceon L2: Enabling L2
[ 0.021881] Feroceon L2: Cache support initialised.
[ 0.031035] No ATAGs?
[ 0.071452] clocksource: Switched to clocksource orion_clocksource
[ 0.072354] VFS: Disk quotas dquot_6.6.0
[ 0.072448] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[ 0.073369] AppArmor: AppArmor Filesystem Enabled
[ 0.075123] NET: Registered PF_INET protocol family
[ 0.079614] IP idents hash table entries: 4096 (order: 3, 32768 bytes, linear)
[ 0.081116] tcp_listen_portaddr_hash hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.081387] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 0.081414] TCP established hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.081462] TCP bind hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.081500] TCP: Hash tables configured (established 2048 bind 2048)
[ 0.081784] MPTCP token hash table entries: 512 (order: 0, 6144 bytes, linear)
[ 0.081885] UDP hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 0.081922] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 0.082232] NET: Registered PF_UNIX/PF_LOCAL protocol family
[ 0.082319] PCI: CLS 0 bytes, default 32
[ 0.088123] Trying to unpack rootfs image as initramfs...
[ 0.156197] Initialise system trusted keyrings
[ 0.156295] Key type blacklist registered
[ 0.157645] workingset: timestamp_bits=30 max_order=16 bucket_order=0
[ 0.165514] Key type asymmetric registered
[ 0.165533] Asymmetric key parser 'x509' registered
[ 1.674504] Freeing initrd memory: 6908K
[ 1.717213] alg: self-tests for CTR-KDF (hmac(sha256)) passed
[ 1.717513] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[ 1.720383] kirkwood-pinctrl f1010000.pin-controller: registered pinctrl driver
[ 1.723386] mv_xor f1060800.xor: Marvell shared XOR driver
[ 1.761310] mv_xor f1060800.xor: Marvell XOR (Registers Mode): ( xor cpy intr )
[ 1.761645] mv_xor f1060900.xor: Marvell shared XOR driver
[ 1.797284] mv_xor f1060900.xor: Marvell XOR (Registers Mode): ( xor cpy intr )
[ 1.797896] Serial: 8250/16550 driver, 2 ports, IRQ sharing disabled
[ 1.799384] printk: console [ttyS0] disabled
[ 1.799520] f1012000.serial: ttyS0 at MMIO 0xf1012000 (irq = 27, base_baud = 12500000) is a 16550A
[ 2.355595] printk: console [ttyS0] enabled
[ 2.360724] f1012100.serial: ttyS1 at MMIO 0xf1012100 (irq = 28, base_baud = 12500000) is a 16550A
[ 2.371228] i2c_dev: i2c /dev entries driver
[ 2.376731] ledtrig-cpu: registered to indicate activity on CPUs
[ 2.384089] registered taskstats version 1
[ 2.388287] Loading compiled-in X.509 certificates
[ 2.435698] Loaded X.509 cert 'Debian Secure Boot CA: 6ccece7e4c6c0d1f6149f3dd27dfcc5cbb419ea1'
[ 2.444763] Loaded X.509 cert 'Debian Secure Boot Signer 2022 - linux: 14011249c2675ea8e5148542202005810584b25f'
[ 2.495338] Key type encrypted registered
[ 2.499719] AppArmor: AppArmor sha1 policy hashing enabled
[ 2.510516] debugfs: Directory 'USB Power' with parent 'regulator' already present!
[ 2.523057] Freeing unused kernel image (initmem) memory: 320K
[ 2.528975] Kernel memory protection not selected by kernel config.
[ 2.535413] Run /init as init process
[ 2.539114] with arguments:
[ 2.539125] /init
[ 2.539133] with environment:
[ 2.539139] HOME=/
[ 2.539147] TERM=linux
[ 3.157151] rtc-mv f1010300.rtc: registered as rtc0
[ 3.182790] rtc-mv f1010300.rtc: setting system clock to 2022-12-09T12:49:55 UTC (1670590195)
[ 3.277059] SCSI subsystem initialized
[ 3.375742] libata version 3.00 loaded.
[ 3.381784] sata_mv f1080000.sata: version 1.28
[ 3.383764] sata_mv f1080000.sata: slots 32 ports 1
[ 3.392680] scsi host0: sata_mv
[ 3.398414] ata1: SATA max UDMA/133 irq 30
[ 3.875477] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 3.882584] ata1.15: Port Multiplier 1.2, 0x11ab:0x4140 r193, 4 ports, feat 0x5/0x1f
[ 3.902819] ata1.00: hard resetting link
[ 4.383755] ata1.01: hard resetting link
[ 4.923752] ata1.02: hard resetting link
[ 5.463752] ata1.03: hard resetting link
[ 6.006136] ata1.00: failed to read native max address (err_mask=0x1)
[ 6.012629] ata1.00: HPA support seems broken, skipping HPA handling
[ 6.019029] ata1.00: ATA-8: ST1000NM0033, 0001, max UDMA/133
[ 6.024754] ata1.00: 8089950 sectors, multi 16: LBA48 NCQ (depth 31/32)
[ 6.033852] ata1.00: configured for UDMA/133
[ 6.042672] ata1.01: ATA-9: ST1000NM0033-9ZM173, 0001, max UDMA/133
[ 6.048993] ata1.01: 1953525168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[ 6.064791] ata1.01: configured for UDMA/133
[ 6.073620] ata1.02: ATA-9: ST1000NM0033-9ZM173, 0001, max UDMA/133
[ 6.079940] ata1.02: 1953525168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[ 6.095735] ata1.02: configured for UDMA/133
[ 6.104543] ata1.03: ATA-9: ST1000NM0033-9ZM173, 0001, max UDMA/133
[ 6.110870] ata1.03: 1953525168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[ 6.126665] ata1.03: configured for UDMA/133
[ 6.131183] ata1: EH complete
[ 6.134702] scsi 0:0:0:0: Direct-Access ATA ST1000NM0033 0001 PQ: 0 ANSI: 5
[ 6.154195] scsi 0:1:0:0: Direct-Access ATA ST1000NM0033-9ZM 0001 PQ: 0 ANSI: 5
[ 6.165625] scsi 0:2:0:0: Direct-Access ATA ST1000NM0033-9ZM 0001 PQ: 0 ANSI: 5
[ 6.177118] scsi 0:3:0:0: Direct-Access ATA ST1000NM0033-9ZM 0001 PQ: 0 ANSI: 5
[ 6.369067] sd 0:0:0:0: [sda] 8089950 512-byte logical blocks: (4.14 GB/3.86 GiB)
[ 6.377497] sd 0:1:0:0: [sdb] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[ 6.386044] sd 0:2:0:0: [sdc] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[ 6.397712] sd 0:3:0:0: [sdd] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[ 6.406012] sd 0:0:0:0: [sda] Write Protect is off
[ 6.410872] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[ 6.410907] sd 0:2:0:0: [sdc] Write Protect is off
[ 6.415752] sd 0:2:0:0: [sdc] Mode Sense: 00 3a 00 00
[ 6.415785] sd 0:1:0:0: [sdb] Write Protect is off
[ 6.420625] sd 0:1:0:0: [sdb] Mode Sense: 00 3a 00 00
[ 6.420722] sd 0:3:0:0: [sdd] Write Protect is off
[ 6.425564] sd 0:3:0:0: [sdd] Mode Sense: 00 3a 00 00
[ 6.425937] sd 0:1:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 6.435080] sd 0:2:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 6.444216] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 6.453465] sd 0:3:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 6.463098] sd 0:2:0:0: [sdc] Preferred minimum I/O size 512 bytes
[ 6.469359] sd 0:0:0:0: [sda] Preferred minimum I/O size 512 bytes
[ 6.475612] sd 0:1:0:0: [sdb] Preferred minimum I/O size 512 bytes
[ 6.482029] sd 0:3:0:0: [sdd] Preferred minimum I/O size 512 bytes
[ 6.501124] ata1: mv_handle_fbs_ncq_dev_err: pmp_map=0001 qc_map=2800 failed_links=1 nr_active_links=2
[ 6.510499] ata1: mv_handle_fbs_ncq_dev_err: waiting
[ 6.515511] ata1: mv_handle_fbs_ncq_dev_err: pmp_map=0001 qc_map=2000 failed_links=1 nr_active_links=1
[ 6.524869] ata1: mv_handle_fbs_ncq_dev_err: done
[ 6.539924] ata1.00: Read log 0x10 page 0x00 failed, Emask 0x1
[ 6.545842] ata1.00: failed to read log page 10h (errno=-5)
[ 6.551482] ata1.00: failed to read SCR 1 (Emask=0x40)
[ 6.556676] ata1.01: failed to read SCR 1 (Emask=0x40)
[ 6.561858] ata1.02: failed to read SCR 1 (Emask=0x40)
[ 6.567045] ata1.03: failed to read SCR 1 (Emask=0x40)
[ 6.572238] ata1.00: exception Emask 0x1 SAct 0x2000 SErr 0x0 action 0x6 frozen
[ 6.579608] ata1.00: dev err
[ 6.582512] ata1.00: failed command: READ FPDMA QUEUED
[ 6.587693] ata1.00: cmd 60/02:68:00:00:00/00:00:00:00:00/40 tag 13 ncq dma 1024 in
res 51/04:68:00:00:00/04:00:00:00:00/40 Emask 0x1 (device error)
[ 6.603283] ata1.00: status: { DRDY ERR }
[ 6.607327] ata1.00: error: { ABRT }
[ 7.083481] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 7.090872] ata1.00: hard resetting link
[ 9.184591] ata1.00: configured for UDMA/133
[ 9.200271] ata1.01: configured for UDMA/133
[ 9.215959] ata1.02: configured for UDMA/133
[ 9.231625] ata1.03: configured for UDMA/133
[ 9.236176] ata1: EH complete
[ 9.239235] ata1: mv_handle_fbs_ncq_dev_err: pmp_map=0001 qc_map=4000 failed_links=1 nr_active_links=1
[ 9.248596] ata1: mv_handle_fbs_ncq_dev_err: done
[ 9.263620] ata1.00: Read log 0x10 page 0x00 failed, Emask 0x1
[ 9.269517] ata1.00: failed to read log page 10h (errno=-5)
[ 9.275147] ata1.00: failed to read SCR 1 (Emask=0x40)
[ 9.280337] ata1.00: NCQ disabled due to excessive errors
[ 9.285791] ata1.01: failed to read SCR 1 (Emask=0x40)
[ 9.290973] ata1.02: failed to read SCR 1 (Emask=0x40)
[ 9.296162] ata1.03: failed to read SCR 1 (Emask=0x40)
[ 9.301352] ata1.00: exception Emask 0x1 SAct 0x4000 SErr 0x0 action 0x6 frozen
[ 9.308715] ata1.00: dev err
[ 9.311633] ata1.00: failed command: READ FPDMA QUEUED
[ 9.316815] ata1.00: cmd 60/02:70:02:00:00/00:00:00:00:00/40 tag 14 ncq dma 1024 in
res 51/04:70:02:00:00/04:00:00:00:00/40 Emask 0x1 (device error)
[ 9.332406] ata1.00: status: { DRDY ERR }
[ 9.336452] ata1.00: error: { ABRT }
[ 9.811509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 9.818852] ata1.00: hard resetting link
[ 11.912589] ata1.00: configured for UDMA/133
[ 11.928320] ata1.01: configured for UDMA/133
[ 11.944058] ata1.02: configured for UDMA/133
[ 11.959769] ata1.03: configured for UDMA/133
[ 11.964351] ata1: EH complete
[ 11.979933] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 11.986450] ata1.00: SError: { RecovComm }
[ 11.990608] ata1.00: failed command: READ DMA
[ 11.995007] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 12.010250] ata1.00: status: { DRDY ERR }
[ 12.014303] ata1.00: error: { ABRT }
[ 12.487508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 12.494844] ata1.00: hard resetting link
[ 14.588572] ata1.00: configured for UDMA/133
[ 14.604282] ata1.01: configured for UDMA/133
[ 14.620041] ata1.02: configured for UDMA/133
[ 14.635742] ata1.03: configured for UDMA/133
[ 14.640325] ata1: EH complete
[ 14.643897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 14.650412] ata1.00: SError: { RecovComm }
[ 14.654562] ata1.00: failed command: READ DMA
[ 14.658957] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 14.674204] ata1.00: status: { DRDY ERR }
[ 14.678254] ata1.00: error: { ABRT }
[ 15.151507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 15.158844] ata1.00: hard resetting link
[ 17.252574] ata1.00: configured for UDMA/133
[ 17.268278] ata1.01: configured for UDMA/133
[ 17.284042] ata1.02: configured for UDMA/133
[ 17.299749] ata1.03: configured for UDMA/133
[ 17.304325] ata1: EH complete
[ 17.307899] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 17.314416] ata1.00: SError: { RecovComm }
[ 17.318566] ata1.00: failed command: READ DMA
[ 17.322961] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 17.338203] ata1.00: status: { DRDY ERR }
[ 17.342249] ata1.00: error: { ABRT }
[ 17.815508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 17.822851] ata1.00: hard resetting link
[ 19.916570] ata1.00: configured for UDMA/133
[ 19.932271] ata1.01: configured for UDMA/133
[ 19.948034] ata1.02: configured for UDMA/133
[ 19.963739] ata1.03: configured for UDMA/133
[ 19.968321] ata1: EH complete
[ 19.971892] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 19.978411] ata1.00: SError: { RecovComm }
[ 19.982561] ata1.00: failed command: READ DMA
[ 19.986956] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 20.002200] ata1.00: status: { DRDY ERR }
[ 20.006244] ata1.00: error: { ABRT }
[ 20.479507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 20.486845] ata1.00: hard resetting link
[ 22.580567] ata1.00: configured for UDMA/133
[ 22.596272] ata1.01: configured for UDMA/133
[ 22.612037] ata1.02: configured for UDMA/133
[ 22.627744] ata1.03: configured for UDMA/133
[ 22.632324] ata1: EH complete
[ 22.635893] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 22.642405] ata1.00: SError: { RecovComm }
[ 22.646554] ata1.00: failed command: READ DMA
[ 22.650951] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 22.666201] ata1.00: status: { DRDY ERR }
[ 22.670248] ata1.00: error: { ABRT }
[ 23.143507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 23.150841] ata1.00: hard resetting link
[ 25.244568] ata1.00: configured for UDMA/133
[ 25.260271] ata1.01: configured for UDMA/133
[ 25.276031] ata1.02: configured for UDMA/133
[ 25.291741] ata1.03: configured for UDMA/133
[ 25.296319] ata1: EH complete
[ 25.299890] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 25.306399] ata1.00: SError: { RecovComm }
[ 25.310550] ata1.00: failed command: READ DMA
[ 25.314946] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 25.330188] ata1.00: status: { DRDY ERR }
[ 25.334234] ata1.00: error: { ABRT }
[ 25.807507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 25.814843] ata1.00: hard resetting link
[ 27.908571] ata1.00: configured for UDMA/133
[ 27.924270] ata1.01: configured for UDMA/133
[ 27.940033] ata1.02: configured for UDMA/133
[ 27.955736] ata1.03: configured for UDMA/133
[ 27.960313] ata1: EH complete
[ 27.963890] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 27.970403] ata1.00: SError: { RecovComm }
[ 27.974554] ata1.00: failed command: READ DMA
[ 27.978949] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 27.994196] ata1.00: status: { DRDY ERR }
[ 27.998248] ata1.00: error: { ABRT }
[ 28.471507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 28.478848] ata1.00: hard resetting link
[ 30.572569] ata1.00: configured for UDMA/133
[ 30.588274] ata1.01: configured for UDMA/133
[ 30.604041] ata1.02: configured for UDMA/133
[ 30.619748] ata1.03: configured for UDMA/133
[ 30.624328] ata1: EH complete
[ 30.627894] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 30.634406] ata1.00: SError: { RecovComm }
[ 30.638557] ata1.00: failed command: READ DMA
[ 30.642954] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 30.658195] ata1.00: status: { DRDY ERR }
[ 30.662241] ata1.00: error: { ABRT }
[ 31.135506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 31.142842] ata1.00: hard resetting link
[ 33.236570] ata1.00: configured for UDMA/133
[ 33.252282] ata1.01: configured for UDMA/133
[ 33.268041] ata1.02: configured for UDMA/133
[ 33.283742] ata1.03: configured for UDMA/133
[ 33.288321] ata1: EH complete
[ 33.291891] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 33.298402] ata1.00: SError: { RecovComm }
[ 33.302552] ata1.00: failed command: READ DMA
[ 33.306947] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 33.322191] ata1.00: status: { DRDY ERR }
[ 33.326236] ata1.00: error: { ABRT }
[ 33.799507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 33.806847] ata1.00: hard resetting link
[ 35.900571] ata1.00: configured for UDMA/133
[ 35.916274] ata1.01: configured for UDMA/133
[ 35.932035] ata1.02: configured for UDMA/133
[ 35.947735] ata1.03: configured for UDMA/133
[ 35.952317] ata1: EH complete
[ 35.955888] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 35.962405] ata1.00: SError: { RecovComm }
[ 35.966557] ata1.00: failed command: READ DMA
[ 35.970952] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 35.986194] ata1.00: status: { DRDY ERR }
[ 35.990239] ata1.00: error: { ABRT }
[ 36.463507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 36.470848] ata1.00: hard resetting link
[ 38.564571] ata1.00: configured for UDMA/133
[ 40.496621] ata1.01: configured for UDMA/133
[ 40.512282] ata1.02: configured for UDMA/133
[ 40.527965] ata1.03: configured for UDMA/133
[ 40.532510] ata1: EH complete
[ 40.536080] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 40.542584] ata1.00: SError: { RecovComm }
[ 40.546746] ata1.00: failed command: READ DMA
[ 40.551142] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 40.566384] ata1.00: status: { DRDY ERR }
[ 40.570428] ata1.00: error: { ABRT }
[ 41.043505] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 41.050847] ata1.00: hard resetting link
[ 43.144568] ata1.00: configured for UDMA/133
[ 43.160278] ata1.01: configured for UDMA/133
[ 43.176056] ata1.02: configured for UDMA/133
[ 43.191764] ata1.03: configured for UDMA/133
[ 43.196340] ata1: EH complete
[ 43.199915] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 43.206432] ata1.00: SError: { RecovComm }
[ 43.210587] ata1.00: failed command: READ DMA
[ 43.214978] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 43.230220] ata1.00: status: { DRDY ERR }
[ 43.234267] ata1.00: error: { ABRT }
[ 43.707508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 43.714840] ata1.00: hard resetting link
[ 45.808570] ata1.00: configured for UDMA/133
[ 45.824280] ata1.01: configured for UDMA/133
[ 45.840040] ata1.02: configured for UDMA/133
[ 45.855740] ata1.03: configured for UDMA/133
[ 45.860320] ata1: EH complete
[ 45.863893] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 45.870408] ata1.00: SError: { RecovComm }
[ 45.874561] ata1.00: failed command: READ DMA
[ 45.878955] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 45.894202] ata1.00: status: { DRDY ERR }
[ 45.898253] ata1.00: error: { ABRT }
[ 46.371506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 46.378845] ata1.00: hard resetting link
[ 47.515481] random: crng init done
[ 48.472573] ata1.00: configured for UDMA/133
[ 48.504538] ata1.01: configured for UDMA/133
[ 48.520240] ata1.02: configured for UDMA/133
[ 48.536007] ata1.03: configured for UDMA/133
[ 48.540588] ata1: EH complete
[ 48.544156] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 48.550658] ata1.00: SError: { RecovComm }
[ 48.554820] ata1.00: failed command: READ DMA
[ 48.559215] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 13 dma 1024 in
res 51/04:02:00:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 48.574457] ata1.00: status: { DRDY ERR }
[ 48.578501] ata1.00: error: { ABRT }
[ 49.051507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 49.058849] ata1.00: hard resetting link
[ 51.152570] ata1.00: configured for UDMA/133
[ 51.168278] ata1.01: configured for UDMA/133
[ 51.184044] ata1.02: configured for UDMA/133
[ 51.199744] ata1.03: configured for UDMA/133
[ 51.204340] sd 0:0:0:0: [sda] tag#13 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=44s
[ 51.213567] sd 0:0:0:0: [sda] tag#13 Sense Key : Illegal Request [current]
[ 51.220590] sd 0:0:0:0: [sda] tag#13 Add. Sense: Unaligned write command
[ 51.227355] sd 0:0:0:0: [sda] tag#13 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[ 51.234809] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 51.242963] Buffer I/O error on dev sda, logical block 0, async page read
[ 51.249823] ata1: EH complete
[ 51.260129] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 51.266655] ata1.00: SError: { RecovComm }
[ 51.270814] ata1.00: failed command: READ DMA
[ 51.275207] ata1.00: cmd c8/00:02:02:00:00/00:00:00:00:00/e0 tag 14 dma 1024 in
res 51/04:02:02:00:00/04:00:00:00:00/e0 Emask 0x1 (device error)
[ 51.290448] ata1.00: status: { DRDY ERR }
[ 51.294494] ata1.00: error: { ABRT }
[ 51.767508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 51.774854] ata1.00: hard resetting link
[ 55.668585] ata1.00: configured for UDMA/133
[ 55.684295] ata1.01: configured for UDMA/133
[ 55.700048] ata1.02: configured for UDMA/133
[ 55.715751] ata1.03: configured for UDMA/133
[ 55.720348] sd 0:0:0:0: [sda] tag#14 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=49s
[ 55.729575] sd 0:0:0:0: [sda] tag#14 Sense Key : Illegal Request [current]
[ 55.736599] sd 0:0:0:0: [sda] tag#14 Add. Sense: Unaligned write command
[ 55.743363] sd 0:0:0:0: [sda] tag#14 CDB: Read(10) 28 00 00 00 00 02 00 00 02 00
[ 55.750809] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 55.758964] Buffer I/O error on dev sda, logical block 1, async page read
[ 55.765824] ata1: EH complete
[ 55.769384] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 55.775906] ata1.00: SError: { RecovComm }
[ 55.780063] ata1.00: failed command: READ DMA
[ 55.784458] ata1.00: cmd c8/00:04:04:00:00/00:00:00:00:00/e0 tag 18 dma 2048 in
res 51/04:04:04:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 55.799699] ata1.00: status: { DRDY ERR }
[ 55.803745] ata1.00: error: { ABRT }
[ 56.279478] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 56.286847] ata1.00: hard resetting link
[ 60.180549] ata1.00: configured for UDMA/133
[ 60.196215] ata1.01: configured for UDMA/133
[ 60.211897] ata1.02: configured for UDMA/133
[ 60.227560] ata1.03: configured for UDMA/133
[ 60.232112] sd 0:0:0:0: [sda] tag#18 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=50s
[ 60.241336] sd 0:0:0:0: [sda] tag#18 Sense Key : Illegal Request [current]
[ 60.248366] sd 0:0:0:0: [sda] tag#18 Add. Sense: Unaligned write command
[ 60.255126] sd 0:0:0:0: [sda] tag#18 CDB: Read(10) 28 00 00 00 00 04 00 00 04 00
[ 60.262572] I/O error, dev sda, sector 4 op 0x0:(READ) flags 0x0 phys_seg 2 prio class 2
[ 60.270726] Buffer I/O error on dev sda, logical block 2, async page read
[ 60.277571] Buffer I/O error on dev sda, logical block 3, async page read
[ 60.284435] ata1: EH complete
[ 60.315924] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 60.322446] ata1.00: SError: { RecovComm }
[ 60.326603] ata1.00: failed command: READ DMA
[ 60.330996] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 60.346239] ata1.00: status: { DRDY ERR }
[ 60.350284] ata1.00: error: { ABRT }
[ 60.823509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 60.830854] ata1.00: hard resetting link
[ 62.924584] ata1.00: configured for UDMA/133
[ 62.940297] ata1.01: configured for UDMA/133
[ 62.956047] ata1.02: configured for UDMA/133
[ 62.971748] ata1.03: configured for UDMA/133
[ 62.976333] ata1: EH complete
[ 62.991936] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 62.998450] ata1.00: SError: { RecovComm }
[ 63.002609] ata1.00: failed command: READ DMA
[ 63.007007] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 63.022250] ata1.00: status: { DRDY ERR }
[ 63.026295] ata1.00: error: { ABRT }
[ 63.499506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 63.506842] ata1.00: hard resetting link
[ 65.600573] ata1.00: configured for UDMA/133
[ 65.616284] ata1.01: configured for UDMA/133
[ 65.632043] ata1.02: configured for UDMA/133
[ 65.647749] ata1.03: configured for UDMA/133
[ 65.652335] ata1: EH complete
[ 65.655912] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 65.662431] ata1.00: SError: { RecovComm }
[ 65.666581] ata1.00: failed command: READ DMA
[ 65.670975] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 65.686219] ata1.00: status: { DRDY ERR }
[ 65.690263] ata1.00: error: { ABRT }
[ 66.163507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 66.170849] ata1.00: hard resetting link
[ 68.264616] ata1.00: configured for UDMA/133
[ 68.280371] ata1.01: configured for UDMA/133
[ 68.296080] ata1.02: configured for UDMA/133
[ 68.311783] ata1.03: configured for UDMA/133
[ 68.316372] ata1: EH complete
[ 68.319979] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 68.326487] ata1.00: SError: { RecovComm }
[ 68.330648] ata1.00: failed command: READ DMA
[ 68.335042] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 68.350283] ata1.00: status: { DRDY ERR }
[ 68.354327] ata1.00: error: { ABRT }
[ 68.827509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 68.834854] ata1.00: hard resetting link
[ 70.928574] ata1.00: configured for UDMA/133
[ 70.944283] ata1.01: configured for UDMA/133
[ 70.960040] ata1.02: configured for UDMA/133
[ 70.975739] ata1.03: configured for UDMA/133
[ 70.980323] ata1: EH complete
[ 70.983897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 70.990411] ata1.00: SError: { RecovComm }
[ 70.994562] ata1.00: failed command: READ DMA
[ 70.998957] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 71.014200] ata1.00: status: { DRDY ERR }
[ 71.018244] ata1.00: error: { ABRT }
[ 71.491508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 71.498847] ata1.00: hard resetting link
[ 73.592572] ata1.00: configured for UDMA/133
[ 73.608274] ata1.01: configured for UDMA/133
[ 73.624035] ata1.02: configured for UDMA/133
[ 73.639736] ata1.03: configured for UDMA/133
[ 73.644317] ata1: EH complete
[ 73.647898] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 73.654413] ata1.00: SError: { RecovComm }
[ 73.658566] ata1.00: failed command: READ DMA
[ 73.662960] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 73.678205] ata1.00: status: { DRDY ERR }
[ 73.682258] ata1.00: error: { ABRT }
[ 74.155506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 74.162840] ata1.00: hard resetting link
[ 76.256571] ata1.00: configured for UDMA/133
[ 76.272278] ata1.01: configured for UDMA/133
[ 76.288041] ata1.02: configured for UDMA/133
[ 76.303747] ata1.03: configured for UDMA/133
[ 76.308330] ata1: EH complete
[ 76.311905] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 76.318417] ata1.00: SError: { RecovComm }
[ 76.322570] ata1.00: failed command: READ DMA
[ 76.326964] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 76.342206] ata1.00: status: { DRDY ERR }
[ 76.346251] ata1.00: error: { ABRT }
[ 76.819507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 76.826844] ata1.00: hard resetting link
[ 78.920565] ata1.00: configured for UDMA/133
[ 78.936272] ata1.01: configured for UDMA/133
[ 78.952034] ata1.02: configured for UDMA/133
[ 78.967738] ata1.03: configured for UDMA/133
[ 78.972311] ata1: EH complete
[ 78.975886] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 78.982404] ata1.00: SError: { RecovComm }
[ 78.986555] ata1.00: failed command: READ DMA
[ 78.990949] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 79.006192] ata1.00: status: { DRDY ERR }
[ 79.010237] ata1.00: error: { ABRT }
[ 79.483506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 79.490847] ata1.00: hard resetting link
[ 81.584571] ata1.00: configured for UDMA/133
[ 81.600275] ata1.01: configured for UDMA/133
[ 81.616036] ata1.02: configured for UDMA/133
[ 81.631739] ata1.03: configured for UDMA/133
[ 81.636322] ata1: EH complete
[ 81.639894] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 81.646406] ata1.00: SError: { RecovComm }
[ 81.650559] ata1.00: failed command: READ DMA
[ 81.654954] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 81.670197] ata1.00: status: { DRDY ERR }
[ 81.674242] ata1.00: error: { ABRT }
[ 82.147505] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 82.154843] ata1.00: hard resetting link
[ 84.248570] ata1.00: configured for UDMA/133
[ 84.264267] ata1.01: configured for UDMA/133
[ 84.280033] ata1.02: configured for UDMA/133
[ 84.295739] ata1.03: configured for UDMA/133
[ 84.300319] ata1: EH complete
[ 84.303898] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 84.310411] ata1.00: SError: { RecovComm }
[ 84.314563] ata1.00: failed command: READ DMA
[ 84.318958] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 84.334200] ata1.00: status: { DRDY ERR }
[ 84.338244] ata1.00: error: { ABRT }
[ 84.811509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 84.818845] ata1.00: hard resetting link
[ 86.912568] ata1.00: configured for UDMA/133
[ 86.928272] ata1.01: configured for UDMA/133
[ 86.944038] ata1.02: configured for UDMA/133
[ 86.959744] ata1.03: configured for UDMA/133
[ 86.964326] ata1: EH complete
[ 86.967898] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 86.974413] ata1.00: SError: { RecovComm }
[ 86.978565] ata1.00: failed command: READ DMA
[ 86.982961] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 86.998207] ata1.00: status: { DRDY ERR }
[ 87.002258] ata1.00: error: { ABRT }
[ 87.475507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 87.482839] ata1.00: hard resetting link
[ 89.576569] ata1.00: configured for UDMA/133
[ 89.592280] ata1.01: configured for UDMA/133
[ 89.608041] ata1.02: configured for UDMA/133
[ 89.623746] ata1.03: configured for UDMA/133
[ 89.628348] sd 0:0:0:0: [sda] tag#23 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=29s
[ 89.637576] sd 0:0:0:0: [sda] tag#23 Sense Key : Illegal Request [current]
[ 89.644598] sd 0:0:0:0: [sda] tag#23 Add. Sense: Unaligned write command
[ 89.651363] sd 0:0:0:0: [sda] tag#23 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[ 89.658818] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 89.666971] Buffer I/O error on dev sda, logical block 0, async page read
[ 89.673833] ata1: EH complete
[ 89.688027] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 89.694553] ata1.00: SError: { RecovComm }
[ 89.698712] ata1.00: failed command: READ DMA
[ 89.703108] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 25 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 89.718356] ata1.00: status: { DRDY ERR }
[ 89.722399] ata1.00: error: { ABRT }
[ 90.195504] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 90.202849] ata1.00: hard resetting link
[ 92.296575] ata1.00: configured for UDMA/133
[ 92.312285] ata1.01: configured for UDMA/133
[ 92.328047] ata1.02: configured for UDMA/133
[ 92.343745] ata1.03: configured for UDMA/133
[ 92.348342] sd 0:0:0:0: [sda] tag#25 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=32s
[ 92.357560] sd 0:0:0:0: [sda] tag#25 Sense Key : Illegal Request [current]
[ 92.364584] sd 0:0:0:0: [sda] tag#25 Add. Sense: Unaligned write command
[ 92.371348] sd 0:0:0:0: [sda] tag#25 CDB: Read(10) 28 00 00 00 00 02 00 00 06 00
[ 92.378794] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[ 92.386947] Buffer I/O error on dev sda, logical block 1, async page read
[ 92.393786] Buffer I/O error on dev sda, logical block 2, async page read
[ 92.400629] Buffer I/O error on dev sda, logical block 3, async page read
[ 92.407499] ata1: EH complete
[ 92.439948] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 92.446471] ata1.00: SError: { RecovComm }
[ 92.450631] ata1.00: failed command: READ DMA
[ 92.455024] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 92.470178] ata1.00: status: { DRDY ERR }
[ 92.474222] ata1.00: error: { ABRT }
[ 92.947508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 92.954855] ata1.00: hard resetting link
[ 95.048582] ata1.00: configured for UDMA/133
[ 95.064295] ata1.01: configured for UDMA/133
[ 95.080050] ata1.02: configured for UDMA/133
[ 95.095759] ata1.03: configured for UDMA/133
[ 95.100342] ata1: EH complete
[ 95.115939] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 95.122450] ata1.00: SError: { RecovComm }
[ 95.126609] ata1.00: failed command: READ DMA
[ 95.131000] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 95.146154] ata1.00: status: { DRDY ERR }
[ 95.150199] ata1.00: error: { ABRT }
[ 95.623506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 95.630842] ata1.00: hard resetting link
[ 97.724573] ata1.00: configured for UDMA/133
[ 97.740281] ata1.01: configured for UDMA/133
[ 97.756045] ata1.02: configured for UDMA/133
[ 97.771751] ata1.03: configured for UDMA/133
[ 97.776334] ata1: EH complete
[ 97.779910] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 97.786420] ata1.00: SError: { RecovComm }
[ 97.790571] ata1.00: failed command: READ DMA
[ 97.794968] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 97.810122] ata1.00: status: { DRDY ERR }
[ 97.814167] ata1.00: error: { ABRT }
[ 98.287508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 98.294846] ata1.00: hard resetting link
[ 100.388571] ata1.00: configured for UDMA/133
[ 100.404276] ata1.01: configured for UDMA/133
[ 100.420038] ata1.02: configured for UDMA/133
[ 100.435745] ata1.03: configured for UDMA/133
[ 100.440325] ata1: EH complete
[ 100.443907] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 100.450424] ata1.00: SError: { RecovComm }
[ 100.454573] ata1.00: failed command: READ DMA
[ 100.458970] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 100.474125] ata1.00: status: { DRDY ERR }
[ 100.478171] ata1.00: error: { ABRT }
[ 100.951506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 100.958841] ata1.00: hard resetting link
[ 103.052571] ata1.00: configured for UDMA/133
[ 103.068279] ata1.01: configured for UDMA/133
[ 103.084042] ata1.02: configured for UDMA/133
[ 103.099746] ata1.03: configured for UDMA/133
[ 103.104324] ata1: EH complete
[ 103.107899] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 103.114410] ata1.00: SError: { RecovComm }
[ 103.118560] ata1.00: failed command: READ DMA
[ 103.122960] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 103.138121] ata1.00: status: { DRDY ERR }
[ 103.142175] ata1.00: error: { ABRT }
[ 103.615506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 103.622844] ata1.00: hard resetting link
[ 105.716569] ata1.00: configured for UDMA/133
[ 105.732277] ata1.01: configured for UDMA/133
[ 105.748036] ata1.02: configured for UDMA/133
[ 105.763736] ata1.03: configured for UDMA/133
[ 105.768316] ata1: EH complete
[ 105.771896] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 105.778414] ata1.00: SError: { RecovComm }
[ 105.782563] ata1.00: failed command: READ DMA
[ 105.786960] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 105.802115] ata1.00: status: { DRDY ERR }
[ 105.806161] ata1.00: error: { ABRT }
[ 106.279507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 106.286849] ata1.00: hard resetting link
[ 108.380569] ata1.00: configured for UDMA/133
[ 108.396280] ata1.01: configured for UDMA/133
[ 108.412038] ata1.02: configured for UDMA/133
[ 108.427741] ata1.03: configured for UDMA/133
[ 108.432324] ata1: EH complete
[ 108.435896] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 108.442408] ata1.00: SError: { RecovComm }
[ 108.446559] ata1.00: failed command: READ DMA
[ 108.450956] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 108.466110] ata1.00: status: { DRDY ERR }
[ 108.470156] ata1.00: error: { ABRT }
[ 108.943508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 108.950844] ata1.00: hard resetting link
[ 111.044567] ata1.00: configured for UDMA/133
[ 111.060273] ata1.01: configured for UDMA/133
[ 111.076037] ata1.02: configured for UDMA/133
[ 111.091740] ata1.03: configured for UDMA/133
[ 111.096323] ata1: EH complete
[ 111.099904] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 111.106421] ata1.00: SError: { RecovComm }
[ 111.110571] ata1.00: failed command: READ DMA
[ 111.114968] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 111.130127] ata1.00: status: { DRDY ERR }
[ 111.134178] ata1.00: error: { ABRT }
[ 111.607506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 111.614845] ata1.00: hard resetting link
[ 113.708569] ata1.00: configured for UDMA/133
[ 113.724277] ata1.01: configured for UDMA/133
[ 113.740037] ata1.02: configured for UDMA/133
[ 113.755736] ata1.03: configured for UDMA/133
[ 113.760320] ata1: EH complete
[ 113.763894] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 113.770406] ata1.00: SError: { RecovComm }
[ 113.774557] ata1.00: failed command: READ DMA
[ 113.778954] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 113.794109] ata1.00: status: { DRDY ERR }
[ 113.798154] ata1.00: error: { ABRT }
[ 114.271507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 114.278842] ata1.00: hard resetting link
[ 116.372571] ata1.00: configured for UDMA/133
[ 116.388284] ata1.01: configured for UDMA/133
[ 116.404042] ata1.02: configured for UDMA/133
[ 116.419749] ata1.03: configured for UDMA/133
[ 116.424328] ata1: EH complete
[ 116.427909] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 116.434421] ata1.00: SError: { RecovComm }
[ 116.438569] ata1.00: failed command: READ DMA
[ 116.442966] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 116.458121] ata1.00: status: { DRDY ERR }
[ 116.462166] ata1.00: error: { ABRT }
[ 116.935507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 116.942844] ata1.00: hard resetting link
[ 119.036571] ata1.00: configured for UDMA/133
[ 119.052274] ata1.01: configured for UDMA/133
[ 119.068037] ata1.02: configured for UDMA/133
[ 119.083735] ata1.03: configured for UDMA/133
[ 119.088321] ata1: EH complete
[ 119.091894] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 119.098406] ata1.00: SError: { RecovComm }
[ 119.102555] ata1.00: failed command: READ DMA
[ 119.106953] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 7 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 119.122108] ata1.00: status: { DRDY ERR }
[ 119.126152] ata1.00: error: { ABRT }
[ 119.599508] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 119.606848] ata1.00: hard resetting link
[ 121.700571] ata1.00: configured for UDMA/133
[ 121.716279] ata1.01: configured for UDMA/133
[ 121.732040] ata1.02: configured for UDMA/133
[ 121.747738] ata1.03: configured for UDMA/133
[ 121.752334] sd 0:0:0:0: [sda] tag#7 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=29s
[ 121.761471] sd 0:0:0:0: [sda] tag#7 Sense Key : Illegal Request [current]
[ 121.768407] sd 0:0:0:0: [sda] tag#7 Add. Sense: Unaligned write command
[ 121.775084] sd 0:0:0:0: [sda] tag#7 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[ 121.782452] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 121.790604] Buffer I/O error on dev sda, logical block 0, async page read
[ 121.797455] ata1: EH complete
[ 121.824038] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 121.830562] ata1.00: SError: { RecovComm }
[ 121.834726] ata1.00: failed command: READ DMA
[ 121.839121] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 8 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 121.854279] ata1.00: status: { DRDY ERR }
[ 121.858330] ata1.00: error: { ABRT }
[ 122.331503] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 122.338850] ata1.00: hard resetting link
[ 124.432599] ata1.00: configured for UDMA/133
[ 124.448351] ata1.01: configured for UDMA/133
[ 124.464052] ata1.02: configured for UDMA/133
[ 124.479754] ata1.03: configured for UDMA/133
[ 124.484369] sd 0:0:0:0: [sda] tag#8 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=32s
[ 124.493510] sd 0:0:0:0: [sda] tag#8 Sense Key : Illegal Request [current]
[ 124.500453] sd 0:0:0:0: [sda] tag#8 Add. Sense: Unaligned write command
[ 124.507131] sd 0:0:0:0: [sda] tag#8 CDB: Read(10) 28 00 00 00 00 02 00 00 06 00
[ 124.514498] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[ 124.522652] Buffer I/O error on dev sda, logical block 1, async page read
[ 124.529498] Buffer I/O error on dev sda, logical block 2, async page read
[ 124.536342] Buffer I/O error on dev sda, logical block 3, async page read
[ 124.543209] ata1: EH complete
[ 124.583940] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 124.590468] ata1.00: SError: { RecovComm }
[ 124.594624] ata1.00: failed command: READ DMA
[ 124.599019] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 124.614261] ata1.00: status: { DRDY ERR }
[ 124.618305] ata1.00: error: { ABRT }
[ 125.091523] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 125.098870] ata1.00: hard resetting link
[ 127.192591] ata1.00: configured for UDMA/133
[ 127.208322] ata1.01: configured for UDMA/133
[ 127.224056] ata1.02: configured for UDMA/133
[ 127.239760] ata1.03: configured for UDMA/133
[ 127.244347] ata1: EH complete
[ 127.259939] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 127.266456] ata1.00: SError: { RecovComm }
[ 127.270611] ata1.00: failed command: READ DMA
[ 127.275004] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 127.290245] ata1.00: status: { DRDY ERR }
[ 127.294290] ata1.00: error: { ABRT }
[ 127.767507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 127.774848] ata1.00: hard resetting link
[ 129.868576] ata1.00: configured for UDMA/133
[ 129.884292] ata1.01: configured for UDMA/133
[ 129.900049] ata1.02: configured for UDMA/133
[ 129.915754] ata1.03: configured for UDMA/133
[ 129.920343] ata1: EH complete
[ 129.923923] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 129.930442] ata1.00: SError: { RecovComm }
[ 129.934598] ata1.00: failed command: READ DMA
[ 129.938989] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 129.954232] ata1.00: status: { DRDY ERR }
[ 129.958276] ata1.00: error: { ABRT }
[ 130.431506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 130.438843] ata1.00: hard resetting link
[ 132.532569] ata1.00: configured for UDMA/133
[ 132.548271] ata1.01: configured for UDMA/133
[ 132.564037] ata1.02: configured for UDMA/133
[ 132.579741] ata1.03: configured for UDMA/133
[ 132.584319] ata1: EH complete
[ 132.587906] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 132.594419] ata1.00: SError: { RecovComm }
[ 132.598571] ata1.00: failed command: READ DMA
[ 132.602966] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 132.618209] ata1.00: status: { DRDY ERR }
[ 132.622253] ata1.00: error: { ABRT }
[ 133.095509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 133.102844] ata1.00: hard resetting link
[ 135.196569] ata1.00: configured for UDMA/133
[ 135.212275] ata1.01: configured for UDMA/133
[ 135.228032] ata1.02: configured for UDMA/133
[ 135.243736] ata1.03: configured for UDMA/133
[ 135.248319] ata1: EH complete
[ 135.251892] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 135.258406] ata1.00: SError: { RecovComm }
[ 135.262556] ata1.00: failed command: READ DMA
[ 135.266953] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 135.282199] ata1.00: status: { DRDY ERR }
[ 135.286250] ata1.00: error: { ABRT }
[ 135.759506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 135.766839] ata1.00: hard resetting link
[ 137.860568] ata1.00: configured for UDMA/133
[ 137.876271] ata1.01: configured for UDMA/133
[ 137.892033] ata1.02: configured for UDMA/133
[ 137.907743] ata1.03: configured for UDMA/133
[ 137.912319] ata1: EH complete
[ 137.915899] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 137.922409] ata1.00: SError: { RecovComm }
[ 137.926560] ata1.00: failed command: READ DMA
[ 137.930955] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 137.946198] ata1.00: status: { DRDY ERR }
[ 137.950244] ata1.00: error: { ABRT }
[ 138.423507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 138.430846] ata1.00: hard resetting link
[ 140.524566] ata1.00: configured for UDMA/133
[ 140.540272] ata1.01: configured for UDMA/133
[ 140.556037] ata1.02: configured for UDMA/133
[ 140.571740] ata1.03: configured for UDMA/133
[ 140.576317] ata1: EH complete
[ 140.579888] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 140.586405] ata1.00: SError: { RecovComm }
[ 140.590555] ata1.00: failed command: READ DMA
[ 140.594951] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 140.610193] ata1.00: status: { DRDY ERR }
[ 140.614238] ata1.00: error: { ABRT }
[ 141.087507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 141.094850] ata1.00: hard resetting link
[ 143.188570] ata1.00: configured for UDMA/133
[ 143.204277] ata1.01: configured for UDMA/133
[ 143.220036] ata1.02: configured for UDMA/133
[ 143.235735] ata1.03: configured for UDMA/133
[ 143.240315] ata1: EH complete
[ 143.243897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 143.250415] ata1.00: SError: { RecovComm }
[ 143.254568] ata1.00: failed command: READ DMA
[ 143.258963] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 143.274206] ata1.00: status: { DRDY ERR }
[ 143.278255] ata1.00: error: { ABRT }
[ 143.751507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 143.758842] ata1.00: hard resetting link
[ 145.852571] ata1.00: configured for UDMA/133
[ 145.868274] ata1.01: configured for UDMA/133
[ 145.884034] ata1.02: configured for UDMA/133
[ 145.899742] ata1.03: configured for UDMA/133
[ 145.904324] ata1: EH complete
[ 145.907895] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 145.914410] ata1.00: SError: { RecovComm }
[ 145.918562] ata1.00: failed command: READ DMA
[ 145.922958] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 145.938200] ata1.00: status: { DRDY ERR }
[ 145.942246] ata1.00: error: { ABRT }
[ 146.415506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 146.422848] ata1.00: hard resetting link
[ 148.516566] ata1.00: configured for UDMA/133
[ 148.532268] ata1.01: configured for UDMA/133
[ 148.548028] ata1.02: configured for UDMA/133
[ 148.563728] ata1.03: configured for UDMA/133
[ 148.568305] ata1: EH complete
[ 148.571886] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 148.578398] ata1.00: SError: { RecovComm }
[ 148.582547] ata1.00: failed command: READ DMA
[ 148.586944] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 148.602189] ata1.00: status: { DRDY ERR }
[ 148.606241] ata1.00: error: { ABRT }
[ 149.079507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 149.086843] ata1.00: hard resetting link
[ 151.180569] ata1.00: configured for UDMA/133
[ 151.196270] ata1.01: configured for UDMA/133
[ 151.212036] ata1.02: configured for UDMA/133
[ 151.227737] ata1.03: configured for UDMA/133
[ 151.232314] ata1: EH complete
[ 151.235887] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 151.242402] ata1.00: SError: { RecovComm }
[ 151.246552] ata1.00: failed command: READ DMA
[ 151.250947] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 15 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 151.266191] ata1.00: status: { DRDY ERR }
[ 151.270235] ata1.00: error: { ABRT }
[ 151.743507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 151.750844] ata1.00: hard resetting link
[ 153.844568] ata1.00: configured for UDMA/133
[ 153.860278] ata1.01: configured for UDMA/133
[ 153.876035] ata1.02: configured for UDMA/133
[ 153.891735] ata1.03: configured for UDMA/133
[ 153.896332] sd 0:0:0:0: [sda] tag#15 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=29s
[ 153.905555] sd 0:0:0:0: [sda] tag#15 Sense Key : Illegal Request [current]
[ 153.912585] sd 0:0:0:0: [sda] tag#15 Add. Sense: Unaligned write command
[ 153.919350] sd 0:0:0:0: [sda] tag#15 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[ 153.926805] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 153.934957] Buffer I/O error on dev sda, logical block 0, async page read
[ 153.941808] ata1: EH complete
[ 153.968039] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 153.974563] ata1.00: SError: { RecovComm }
[ 153.978717] ata1.00: failed command: READ DMA
[ 153.983108] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 16 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 153.998350] ata1.00: status: { DRDY ERR }
[ 154.002394] ata1.00: error: { ABRT }
[ 154.475503] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 154.482840] ata1.00: hard resetting link
[ 156.576582] ata1.00: configured for UDMA/133
[ 156.592285] ata1.01: configured for UDMA/133
[ 156.608036] ata1.02: configured for UDMA/133
[ 156.623731] ata1.03: configured for UDMA/133
[ 156.628327] sd 0:0:0:0: [sda] tag#16 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=32s
[ 156.637555] sd 0:0:0:0: [sda] tag#16 Sense Key : Illegal Request [current]
[ 156.644578] sd 0:0:0:0: [sda] tag#16 Add. Sense: Unaligned write command
[ 156.651342] sd 0:0:0:0: [sda] tag#16 CDB: Read(10) 28 00 00 00 00 02 00 00 06 00
[ 156.658789] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[ 156.666943] Buffer I/O error on dev sda, logical block 1, async page read
[ 156.673789] Buffer I/O error on dev sda, logical block 2, async page read
[ 156.680633] Buffer I/O error on dev sda, logical block 3, async page read
[ 156.687496] ata1: EH complete
[ 156.690602] ldm_validate_partition_table(): Disk read failed.
[ 156.731945] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 156.738473] ata1.00: SError: { RecovComm }
[ 156.742634] ata1.00: failed command: READ DMA
[ 156.747025] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 156.762267] ata1.00: status: { DRDY ERR }
[ 156.766311] ata1.00: error: { ABRT }
[ 157.239506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 157.246845] ata1.00: hard resetting link
[ 159.340578] ata1.00: configured for UDMA/133
[ 159.356285] ata1.01: configured for UDMA/133
[ 159.372051] ata1.02: configured for UDMA/133
[ 159.387748] ata1.03: configured for UDMA/133
[ 159.392332] ata1: EH complete
[ 159.407939] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 159.414452] ata1.00: SError: { RecovComm }
[ 159.418613] ata1.00: failed command: READ DMA
[ 159.423009] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 159.438252] ata1.00: status: { DRDY ERR }
[ 159.442297] ata1.00: error: { ABRT }
[ 159.915507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 159.922846] ata1.00: hard resetting link
[ 162.016572] ata1.00: configured for UDMA/133
[ 162.032279] ata1.01: configured for UDMA/133
[ 162.048044] ata1.02: configured for UDMA/133
[ 162.063743] ata1.03: configured for UDMA/133
[ 162.068328] ata1: EH complete
[ 162.071900] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 162.078415] ata1.00: SError: { RecovComm }
[ 162.082566] ata1.00: failed command: READ DMA
[ 162.086959] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 162.102203] ata1.00: status: { DRDY ERR }
[ 162.106248] ata1.00: error: { ABRT }
[ 162.579506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 162.586841] ata1.00: hard resetting link
[ 164.680571] ata1.00: configured for UDMA/133
[ 164.696284] ata1.01: configured for UDMA/133
[ 164.712049] ata1.02: configured for UDMA/133
[ 164.727755] ata1.03: configured for UDMA/133
[ 164.732333] ata1: EH complete
[ 164.735910] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 164.742425] ata1.00: SError: { RecovComm }
[ 164.746579] ata1.00: failed command: READ DMA
[ 164.750972] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 164.766214] ata1.00: status: { DRDY ERR }
[ 164.770260] ata1.00: error: { ABRT }
[ 165.243507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 165.250845] ata1.00: hard resetting link
[ 167.344567] ata1.00: configured for UDMA/133
[ 167.360273] ata1.01: configured for UDMA/133
[ 167.376031] ata1.02: configured for UDMA/133
[ 167.391732] ata1.03: configured for UDMA/133
[ 167.396318] ata1: EH complete
[ 167.399887] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 167.406402] ata1.00: SError: { RecovComm }
[ 167.410555] ata1.00: failed command: READ DMA
[ 167.414951] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 167.430196] ata1.00: status: { DRDY ERR }
[ 167.434247] ata1.00: error: { ABRT }
[ 167.907506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 167.914848] ata1.00: hard resetting link
[ 170.008568] ata1.00: configured for UDMA/133
[ 170.024280] ata1.01: configured for UDMA/133
[ 170.040040] ata1.02: configured for UDMA/133
[ 170.055745] ata1.03: configured for UDMA/133
[ 170.060325] ata1: EH complete
[ 170.063905] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 170.070417] ata1.00: SError: { RecovComm }
[ 170.074569] ata1.00: failed command: READ DMA
[ 170.078962] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 170.094205] ata1.00: status: { DRDY ERR }
[ 170.098249] ata1.00: error: { ABRT }
[ 170.571506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 170.578844] ata1.00: hard resetting link
[ 172.672569] ata1.00: configured for UDMA/133
[ 172.688270] ata1.01: configured for UDMA/133
[ 172.704033] ata1.02: configured for UDMA/133
[ 172.719758] ata1.03: configured for UDMA/133
[ 172.724341] ata1: EH complete
[ 172.727916] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 172.734428] ata1.00: SError: { RecovComm }
[ 172.738585] ata1.00: failed command: READ DMA
[ 172.742975] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 172.758216] ata1.00: status: { DRDY ERR }
[ 172.762261] ata1.00: error: { ABRT }
[ 173.235506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 173.242845] ata1.00: hard resetting link
[ 175.336572] ata1.00: configured for UDMA/133
[ 175.352273] ata1.01: configured for UDMA/133
[ 175.368037] ata1.02: configured for UDMA/133
[ 175.383746] ata1.03: configured for UDMA/133
[ 175.388320] ata1: EH complete
[ 175.391897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 175.398415] ata1.00: SError: { RecovComm }
[ 175.402566] ata1.00: failed command: READ DMA
[ 175.406962] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 175.422203] ata1.00: status: { DRDY ERR }
[ 175.426248] ata1.00: error: { ABRT }
[ 175.899506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 175.906841] ata1.00: hard resetting link
[ 178.000571] ata1.00: configured for UDMA/133
[ 178.016281] ata1.01: configured for UDMA/133
[ 178.032038] ata1.02: configured for UDMA/133
[ 178.047740] ata1.03: configured for UDMA/133
[ 178.052323] ata1: EH complete
[ 178.055895] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 178.062409] ata1.00: SError: { RecovComm }
[ 178.066561] ata1.00: failed command: READ DMA
[ 178.070956] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 178.086198] ata1.00: status: { DRDY ERR }
[ 178.090243] ata1.00: error: { ABRT }
[ 178.563506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 178.570845] ata1.00: hard resetting link
[ 180.664573] ata1.00: configured for UDMA/133
[ 180.680283] ata1.01: configured for UDMA/133
[ 180.696045] ata1.02: configured for UDMA/133
[ 180.711750] ata1.03: configured for UDMA/133
[ 180.716333] ata1: EH complete
[ 180.719913] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 180.726429] ata1.00: SError: { RecovComm }
[ 180.730586] ata1.00: failed command: READ DMA
[ 180.734977] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 180.750222] ata1.00: status: { DRDY ERR }
[ 180.754274] ata1.00: error: { ABRT }
[ 181.227507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 181.234848] ata1.00: hard resetting link
[ 183.328570] ata1.00: configured for UDMA/133
[ 183.344275] ata1.01: configured for UDMA/133
[ 183.360040] ata1.02: configured for UDMA/133
[ 183.375746] ata1.03: configured for UDMA/133
[ 183.380327] ata1: EH complete
[ 183.383902] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 183.390416] ata1.00: SError: { RecovComm }
[ 183.394568] ata1.00: failed command: READ DMA
[ 183.398963] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 23 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 183.414205] ata1.00: status: { DRDY ERR }
[ 183.418250] ata1.00: error: { ABRT }
[ 183.891507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 183.898842] ata1.00: hard resetting link
[ 185.992570] ata1.00: configured for UDMA/133
[ 186.008271] ata1.01: configured for UDMA/133
[ 186.024052] ata1.02: configured for UDMA/133
[ 186.039759] ata1.03: configured for UDMA/133
[ 186.044354] sd 0:0:0:0: [sda] tag#23 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=29s
[ 186.053578] sd 0:0:0:0: [sda] tag#23 Sense Key : Illegal Request [current]
[ 186.060601] sd 0:0:0:0: [sda] tag#23 Add. Sense: Unaligned write command
[ 186.067365] sd 0:0:0:0: [sda] tag#23 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[ 186.074812] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 186.082965] Buffer I/O error on dev sda, logical block 0, async page read
[ 186.089824] ata1: EH complete
[ 186.109327] sdc: sdc1 sdc2 sdc3 sdc4 sdc5 sdc6
[ 186.119849] sd 0:2:0:0: [sdc] Attached SCSI disk
[ 186.137871] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 186.144408] ata1.00: SError: { RecovComm }
[ 186.148565] ata1.00: failed command: READ DMA
[ 186.152959] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 24 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 186.168204] ata1.00: status: { DRDY ERR }
[ 186.172254] ata1.00: error: { ABRT }
[ 186.647501] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 186.654852] ata1.00: hard resetting link
[ 188.748596] ata1.00: configured for UDMA/133
[ 188.764341] ata1.01: configured for UDMA/133
[ 188.780045] ata1.02: configured for UDMA/133
[ 188.795739] ata1.03: configured for UDMA/133
[ 188.800353] sd 0:0:0:0: [sda] tag#24 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=32s
[ 188.809577] sd 0:0:0:0: [sda] tag#24 Sense Key : Illegal Request [current]
[ 188.816599] sd 0:0:0:0: [sda] tag#24 Add. Sense: Unaligned write command
[ 188.823365] sd 0:0:0:0: [sda] tag#24 CDB: Read(10) 28 00 00 00 00 02 00 00 06 00
[ 188.830820] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[ 188.838975] Buffer I/O error on dev sda, logical block 1, async page read
[ 188.845821] Buffer I/O error on dev sda, logical block 2, async page read
[ 188.852663] Buffer I/O error on dev sda, logical block 3, async page read
[ 188.859535] ata1: EH complete
[ 188.899979] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 188.906511] ata1.00: SError: { RecovComm }
[ 188.910669] ata1.00: failed command: READ DMA
[ 188.915062] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 188.930217] ata1.00: status: { DRDY ERR }
[ 188.934261] ata1.00: error: { ABRT }
[ 189.407511] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 189.414896] ata1.00: hard resetting link
[ 191.508598] ata1.00: configured for UDMA/133
[ 191.524340] ata1.01: configured for UDMA/133
[ 191.540057] ata1.02: configured for UDMA/133
[ 191.555765] ata1.03: configured for UDMA/133
[ 191.560353] ata1: EH complete
[ 191.575942] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 191.582455] ata1.00: SError: { RecovComm }
[ 191.586610] ata1.00: failed command: READ DMA
[ 191.591003] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 191.606157] ata1.00: status: { DRDY ERR }
[ 191.610203] ata1.00: error: { ABRT }
[ 192.083507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 192.090847] ata1.00: hard resetting link
[ 194.184577] ata1.00: configured for UDMA/133
[ 194.200286] ata1.01: configured for UDMA/133
[ 194.216063] ata1.02: configured for UDMA/133
[ 194.231765] ata1.03: configured for UDMA/133
[ 194.236350] ata1: EH complete
[ 194.239935] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 194.246450] ata1.00: SError: { RecovComm }
[ 194.250603] ata1.00: failed command: READ DMA
[ 194.254997] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 194.270151] ata1.00: status: { DRDY ERR }
[ 194.274198] ata1.00: error: { ABRT }
[ 194.747506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 194.754841] ata1.00: hard resetting link
[ 196.848571] ata1.00: configured for UDMA/133
[ 196.864282] ata1.01: configured for UDMA/133
[ 196.880041] ata1.02: configured for UDMA/133
[ 196.895746] ata1.03: configured for UDMA/133
[ 196.900328] ata1: EH complete
[ 196.903911] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 196.910426] ata1.00: SError: { RecovComm }
[ 196.914581] ata1.00: failed command: READ DMA
[ 196.918975] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 196.934129] ata1.00: status: { DRDY ERR }
[ 196.938174] ata1.00: error: { ABRT }
[ 197.411507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 197.418844] ata1.00: hard resetting link
[ 199.512569] ata1.00: configured for UDMA/133
[ 199.528274] ata1.01: configured for UDMA/133
[ 199.544039] ata1.02: configured for UDMA/133
[ 199.559743] ata1.03: configured for UDMA/133
[ 199.564328] ata1: EH complete
[ 199.567896] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 199.574413] ata1.00: SError: { RecovComm }
[ 199.578562] ata1.00: failed command: READ DMA
[ 199.582960] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 199.598119] ata1.00: status: { DRDY ERR }
[ 199.602170] ata1.00: error: { ABRT }
[ 200.075507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 200.082848] ata1.00: hard resetting link
[ 202.176571] ata1.00: configured for UDMA/133
[ 202.192278] ata1.01: configured for UDMA/133
[ 202.208039] ata1.02: configured for UDMA/133
[ 202.223737] ata1.03: configured for UDMA/133
[ 202.228317] ata1: EH complete
[ 202.231897] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 202.238409] ata1.00: SError: { RecovComm }
[ 202.242557] ata1.00: failed command: READ DMA
[ 202.246955] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 202.262110] ata1.00: status: { DRDY ERR }
[ 202.266155] ata1.00: error: { ABRT }
[ 202.739507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 202.746846] ata1.00: hard resetting link
[ 204.840566] ata1.00: configured for UDMA/133
[ 204.856270] ata1.01: configured for UDMA/133
[ 204.872032] ata1.02: configured for UDMA/133
[ 204.887730] ata1.03: configured for UDMA/133
[ 204.892318] ata1: EH complete
[ 204.895889] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 204.902406] ata1.00: SError: { RecovComm }
[ 204.906552] ata1.00: failed command: READ DMA
[ 204.910941] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 204.926096] ata1.00: status: { DRDY ERR }
[ 204.930142] ata1.00: error: { ABRT }
[ 205.403507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 205.410846] ata1.00: hard resetting link
[ 207.504567] ata1.00: configured for UDMA/133
[ 207.520268] ata1.01: configured for UDMA/133
[ 207.536045] ata1.02: configured for UDMA/133
[ 207.551745] ata1.03: configured for UDMA/133
[ 207.556327] ata1: EH complete
[ 207.559905] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 207.566418] ata1.00: SError: { RecovComm }
[ 207.570564] ata1.00: failed command: READ DMA
[ 207.574962] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 207.590117] ata1.00: status: { DRDY ERR }
[ 207.594163] ata1.00: error: { ABRT }
[ 208.067507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 208.074842] ata1.00: hard resetting link
[ 210.168572] ata1.00: configured for UDMA/133
[ 210.184281] ata1.01: configured for UDMA/133
[ 210.200041] ata1.02: configured for UDMA/133
[ 210.215741] ata1.03: configured for UDMA/133
[ 210.220325] ata1: EH complete
[ 210.223899] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 210.230410] ata1.00: SError: { RecovComm }
[ 210.234559] ata1.00: failed command: READ DMA
[ 210.238957] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 210.254112] ata1.00: status: { DRDY ERR }
[ 210.258157] ata1.00: error: { ABRT }
[ 210.731507] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 210.738846] ata1.00: hard resetting link
[ 212.832568] ata1.00: configured for UDMA/133
[ 212.848269] ata1.01: configured for UDMA/133
[ 212.864027] ata1.02: configured for UDMA/133
[ 212.879724] ata1.03: configured for UDMA/133
[ 212.884306] ata1: EH complete
[ 212.887886] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 212.894397] ata1.00: SError: { RecovComm }
[ 212.898545] ata1.00: failed command: READ DMA
[ 212.902935] ata1.00: cmd c8/00:06:02:00:00/00:00:00:00:00/e0 tag 2 dma 3072 in
res 51/04:06:02:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 212.918094] ata1.00: status: { DRDY ERR }
[ 212.922145] ata1.00: error: { ABRT }
[ 213.395506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 213.402840] ata1.00: hard resetting link
[ 215.496570] ata1.00: configured for UDMA/133
[ 215.528538] ata1.01: configured for UDMA/133
[ 215.544243] ata1.02: configured for UDMA/133
[ 215.560004] ata1.03: configured for UDMA/133
[ 215.564586] ata1: EH complete
[ 215.568155] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x2 action 0x0
[ 215.574664] ata1.00: SError: { RecovComm }
[ 215.578822] ata1.00: failed command: READ DMA
[ 215.583220] ata1.00: cmd c8/00:02:00:00:00/00:00:00:00:00/e0 tag 1 dma 1024 in
res 51/04:02:00:00:00/00:00:00:00:00/e0 Emask 0x1 (device error)
[ 215.598373] ata1.00: status: { DRDY ERR }
[ 215.602419] ata1.00: error: { ABRT }
[ 216.075506] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 216.082847] ata1.00: hard resetting link
[ 218.183230] ata1.01: configured for UDMA/133
[ 218.198940] ata1.02: configured for UDMA/133
[ 218.214625] ata1.03: configured for UDMA/133
[ 221.667510] ata1.00: hard resetting link
[ 227.043497] ata1.00: hard resetting link
[ 227.364854] ata1.00: disable device
[ 227.368737] sd 0:0:0:0: [sda] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=38s
[ 227.377879] sd 0:0:0:0: [sda] tag#1 Sense Key : Illegal Request [current]
[ 227.384821] sd 0:0:0:0: [sda] tag#1 Add. Sense: Unaligned write command
[ 227.391498] sd 0:0:0:0: [sda] tag#1 CDB: Read(10) 28 00 00 00 00 00 00 00 02 00
[ 227.398865] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 227.407020] Buffer I/O error on dev sda, logical block 0, async page read
[ 227.413884] ata1: EH complete
[ 227.416987] sd 0:0:0:0: rejecting I/O to offline device
[ 227.422268] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[ 227.430427] Buffer I/O error on dev sda, logical block 1, async page read
[ 227.437269] Buffer I/O error on dev sda, logical block 2, async page read
[ 227.444114] Buffer I/O error on dev sda, logical block 3, async page read
[ 227.451120] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 227.459288] Buffer I/O error on dev sda, logical block 0, async page read
[ 227.466336] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 2
[ 227.474503] Buffer I/O error on dev sda, logical block 1, async page read
[ 227.481361] Buffer I/O error on dev sda, logical block 2, async page read
[ 227.488203] Buffer I/O error on dev sda, logical block 3, async page read
[ 227.499788] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 4 prio class 2
[ 227.507978] Buffer I/O error on dev sda, logical block 0, async page read
[ 227.514826] Buffer I/O error on dev sda, logical block 1, async page read
[ 227.521838] Dev sda: unable to read RDB block 0
[ 227.526838] sdb: sdb1 sdb2 sdb3 sdb4 sdb5 sdb6
[ 227.532134] sdd: sdd1 sdd2 sdd3 sdd4 sdd5 sdd6
[ 227.539633] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 227.547871] I/O error, dev sda, sector 2 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 227.556075] I/O error, dev sda, sector 4 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 227.564283] I/O error, dev sda, sector 6 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 227.572511] I/O error, dev sda, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2
[ 227.588218] sd 0:1:0:0: [sdb] Attached SCSI disk
[ 227.593742] sd 0:3:0:0: [sdd] Attached SCSI disk
[ 227.608079] sda: unable to read partition table
[ 227.623202] sd 0:0:0:0: [sda] Attached SCSI disk
[ 227.650491] ata1.00: detaching (SCSI 0:0:0:0)
[ 227.660097] sd 0:0:0:0: [sda] Synchronizing SCSI cache
[ 227.703629] sd 0:0:0:0: [sda] Synchronize Cache(10) failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[ 227.713966] sd 0:0:0:0: [sda] Stopping disk
[ 227.762656] sd 0:0:0:0: [sda] Start/Stop Unit failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[ 228.379491] raid6: int32x8 gen() 120 MB/s
[ 228.451650] raid6: int32x4 gen() 99 MB/s
[ 228.523551] raid6: int32x2 gen() 138 MB/s
[ 228.595528] raid6: int32x1 gen() 100 MB/s
[ 228.599833] raid6: using algorithm int32x2 gen() 138 MB/s
[ 228.671589] raid6: .... xor() 81 MB/s, rmw enabled
[ 228.676423] raid6: using intx1 recovery algorithm
[ 229.014940] md/raid1:md0: active with 2 out of 2 mirrors
[ 229.020411] md/raid1:md1: active with 2 out of 2 mirrors
[ 229.025904] md0: detected capacity change from 0 to 2000768
[ 229.069399] async_tx: api initialized (async)
[ 229.077301] xor: measuring software checksum speed
[ 229.091129] arm4regs : 1106 MB/sec
[ 229.110221] 8regs : 669 MB/sec
[ 229.124984] 32regs : 948 MB/sec
[ 229.129381] xor: using function: arm4regs (1106 MB/sec)
[ 229.137220] md1: detected capacity change from 0 to 9998312
[ 229.291746] md/raid1:md10: active with 2 out of 2 mirrors
[ 229.367779] md10: detected capacity change from 0 to 2000872
[ 230.308342] EXT4-fs (md1): mounted filesystem with ordered data mode. Quota mode: none.
[ 231.437752] systemd[1]: Inserted module 'autofs4'
[ 231.500164] NET: Registered PF_INET6 protocol family
[ 231.570591] Segment Routing with IPv6
[ 231.574521] In-situ OAM (IOAM) with IPv6
[ 231.666946] systemd[1]: systemd 252.2-1 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[ 231.699125] systemd[1]: Detected architecture arm.
[ 231.754858] systemd[1]: Hostname set to <debian>.
[ 233.926808] systemd[1]: /etc/systemd/system/micon_boot.service:5: Unknown key name 'Restart' in section 'Unit', ignoring.
[ 233.937984] systemd[1]: /etc/systemd/system/micon_boot.service:6: Unknown key name 'RestartSec' in section 'Unit', ignoring.
[ 234.699154] systemd[1]: Queued start job for default target Graphical Interface.
[ 234.723117] systemd[1]: Created slice Slice /system/getty.
[ 234.747059] systemd[1]: Created slice Slice /system/modprobe.
[ 234.771036] systemd[1]: Created slice Slice /system/postfix.
[ 234.795003] systemd[1]: Created slice Slice /system/serial-getty.
[ 234.819058] systemd[1]: Created slice Slice /system/systemd-fsck.
[ 234.841491] systemd[1]: Created slice User and Session Slice.
[ 234.864419] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[ 234.892336] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[ 234.917597] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[ 234.944688] systemd[1]: Reached target Local Encrypted Volumes.
[ 234.968214] systemd[1]: Reached target Local Integrity Protected Volumes.
[ 234.992428] systemd[1]: Reached target Host and Network Name Lookups.
[ 235.015872] systemd[1]: Reached target Path Units.
[ 235.036344] systemd[1]: Reached target Slice Units.
[ 235.056330] systemd[1]: Reached target Local Verity Protected Volumes.
[ 235.081344] systemd[1]: Listening on RPCbind Server Activation Socket.
[ 235.105606] systemd[1]: Listening on Syslog Socket.
[ 235.125064] systemd[1]: Listening on fsck to fsckd communication Socket.
[ 235.148495] systemd[1]: Listening on initctl Compatibility Named Pipe.
[ 235.176226] systemd[1]: Listening on Journal Audit Socket.
[ 235.200989] systemd[1]: Listening on Journal Socket (/dev/log).
[ 235.225140] systemd[1]: Listening on Journal Socket.
[ 235.246220] systemd[1]: Listening on udev Control Socket.
[ 235.269076] systemd[1]: Listening on udev Kernel Socket.
[ 235.293456] systemd[1]: Huge Pages File System was skipped because of an unmet condition check (ConditionPathExists=/sys/kernel/mm/hugepages).
[ 235.313273] systemd[1]: Mounting POSIX Message Queue File System...
[ 235.348691] systemd[1]: Mounting NFSD configuration filesystem...
[ 235.392201] systemd[1]: Mounting Kernel Debug File System...
[ 235.436196] systemd[1]: Mounting Kernel Trace File System...
[ 235.468295] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).
[ 235.522918] systemd[1]: Starting Restore / save the current clock...
[ 235.628727] systemd[1]: Starting Create List of Static Device Nodes...
[ 235.688462] systemd[1]: Starting Load Kernel Module configfs...
[ 235.745107] RPC: Registered named UNIX socket transport module.
[ 235.751127] RPC: Registered udp transport module.
[ 235.755870] RPC: Registered tcp transport module.
[ 235.760610] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 235.768648] systemd[1]: Starting Load Kernel Module drm...
[ 235.822721] systemd[1]: Starting Load Kernel Module efi_pstore...
[ 235.881860] systemd[1]: Starting Load Kernel Module fuse...
[ 235.923226] systemd[1]: File System Check on Root Device was skipped because of an unmet condition check (ConditionPathExists=!/run/initramfs/fsck-root).
[ 235.957055] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ 235.988645] fuse: init (API version 7.36)
[ 235.999064] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ 236.031536] systemd[1]: Starting Journal Service...
[ 236.093804] systemd[1]: Starting Load Kernel Modules...
[ 236.153436] systemd[1]: Starting Remount Root and Kernel File Systems...
[ 236.200477] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met.
[ 236.274272] systemd[1]: Starting Coldplug All udev Devices...
[ 236.401490] systemd[1]: Mounted POSIX Message Queue File System.
[ 236.449500] systemd[1]: Mounted NFSD configuration filesystem.
[ 236.492973] systemd[1]: Mounted Kernel Debug File System.
[ 236.536928] systemd[1]: Mounted Kernel Trace File System.
[ 236.578489] systemd[1]: Finished Restore / save the current clock.
[ 236.618396] systemd[1]: Finished Create List of Static Device Nodes.
[ 236.639568] EXT4-fs (md1): re-mounted. Quota mode: none.
[ 236.686823] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[ 236.719735] systemd[1]: Finished Load Kernel Module configfs.
[ 236.750723] systemd[1]: modprobe@drm.service: Deactivated successfully.
[ 236.772959] systemd[1]: Finished Load Kernel Module drm.
[ 236.798791] systemd[1]: modprobe@efi_pstore.service: Deactivated successfully.
[ 236.824928] systemd[1]: Finished Load Kernel Module efi_pstore.
[ 236.866701] systemd[1]: modprobe@fuse.service: Deactivated successfully.
[ 236.892970] systemd[1]: Finished Load Kernel Module fuse.
[ 236.934278] systemd[1]: Finished Load Kernel Modules.
[ 236.970081] systemd[1]: Finished Remount Root and Kernel File Systems.
[ 237.032204] systemd[1]: Mounting FUSE Control File System...
[ 237.088426] systemd[1]: Mounting Kernel Configuration File System...
[ 237.136449] systemd[1]: First Boot Wizard was skipped because of an unmet condition check (ConditionFirstBoot=yes).
[ 237.164319] systemd[1]: Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore).
[ 237.236782] systemd[1]: Starting Load/Save Random Seed...
[ 237.296781] systemd[1]: Starting Apply Kernel Variables...
[ 237.373680] systemd[1]: Starting Create System Users...
[ 237.543166] systemd[1]: Mounted FUSE Control File System.
[ 237.608818] systemd[1]: Mounted Kernel Configuration File System.
[ 237.702713] systemd[1]: Finished Apply Kernel Variables.
[ 238.036685] systemd[1]: Finished Load/Save Random Seed.
[ 238.070441] systemd[1]: Finished Coldplug All udev Devices.
[ 238.104334] systemd[1]: First Boot Complete was skipped because of an unmet condition check (ConditionFirstBoot=yes).
[ 238.144368] systemd[1]: Starting Helper to synchronize boot up for ifupdown...
[ 238.190172] systemd[1]: Finished Create System Users.
[ 238.241943] systemd[1]: Starting Create Static Device Nodes in /dev...
[ 238.269484] systemd-journald[240]: Data hash table of /run/log/journal/ebb5a33ac15a42c49f241fd201a8dfb7/system.journal has a fill level at 75.0 (1536 of 2047 items, 524288 file size, 341 bytes per hash table item), suggesting rotation.
[ 238.342830] systemd-journald[240]: /run/log/journal/ebb5a33ac15a42c49f241fd201a8dfb7/system.journal: Journal header limits reached or header out-of-date, rotating.
[ 238.519719] systemd[1]: Started Journal Service.
[ 238.694023] systemd-journald[240]: Received client request to flush runtime journal.
[ 239.872342] sd 0:1:0:0: Attached scsi generic sg0 type 0
[ 239.945773] sd 0:2:0:0: Attached scsi generic sg1 type 0
[ 240.011825] sd 0:3:0:0: Attached scsi generic sg2 type 0
[ 240.629818] input: gpio-keys as /devices/platform/gpio-keys/input/input0
[ 240.898853] spi-nor spi0.0: m25p40 (512 Kbytes)
[ 241.056154] kirkwood-pinctrl f1010000.pin-controller: pin PIN0 already requested by f1010600.spi; cannot claim for f4000000.nand
[ 241.067862] kirkwood-pinctrl f1010000.pin-controller: pin-0 (f4000000.nand) status -22
[ 241.075853] kirkwood-pinctrl f1010000.pin-controller: could not request pin 0 (PIN0) from group mpp0 on device f1010000.pin-controller
[ 241.088108] orion_nand f4000000.nand: Error applying setting, reverse things back
[ 241.505755] 2 fixed-partitions partitions found on MTD device spi0.0
[ 241.512216] Creating 2 MTD partitions on "spi0.0":
[ 241.622557] 0x000000000000-0x000000070000 : "u-boot"
[ 241.720257] 0x000000070000-0x000000080000 : "u-boot-env"
[ 242.129867] orion_wdt: Initial timeout 21 sec
[ 242.282998] marvell-cesa f1030000.crypto: CESA device successfully registered
[ 242.344239] mv643xx_eth: MV-643xx 10/100/1000 ethernet driver version 1.4
[ 242.594759] usbcore: registered new interface driver usbfs
[ 242.683657] usbcore: registered new interface driver hub
[ 242.728820] mv643xx_eth_port mv643xx_eth_port.0 eth0: port 0 with MAC address 10:6f:3f:b9:50:2c
[ 242.763692] usbcore: registered new device driver usb
[ 242.846883] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 242.983378] ehci-orion: EHCI orion driver
[ 243.000698] mv643xx_eth_port mv643xx_eth_port.1 eth1: port 0 with MAC address 10:6f:3f:b9:50:2d
[ 243.058533] orion-ehci f1050000.ehci: EHCI Host Controller
[ 243.127573] orion-ehci f1050000.ehci: new USB bus registered, assigned bus number 1
[ 243.219336] orion-ehci f1050000.ehci: irq 41, io mem 0xf1050000
[ 243.311559] orion-ehci f1050000.ehci: USB 2.0 started, EHCI 1.00
[ 243.364913] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.00
[ 243.373288] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 243.380584] usb usb1: Product: EHCI Host Controller
[ 243.385507] usb usb1: Manufacturer: Linux 6.0.0-5-marvell ehci_hcd
[ 243.391740] usb usb1: SerialNumber: f1050000.ehci
[ 243.737783] hub 1-0:1.0: USB hub found
[ 243.787584] hub 1-0:1.0: 1 port detected
[ 244.103538] usb 1-1: new high-speed USB device number 2 using orion-ehci
[ 244.320238] usb 1-1: New USB device found, idVendor=0424, idProduct=2512, bcdDevice= b.b3
[ 244.328523] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 244.488198] hub 1-1:1.0: USB hub found
[ 244.547565] hub 1-1:1.0: 2 ports detected
[ 247.228380] Adding 1000432k swap on /dev/md10. Priority:-2 extents:1 across:1000432k
[ 248.175559] EXT4-fs (md0): mounting ext3 file system using the ext4 subsystem
[ 248.257562] EXT4-fs (md0): mounted filesystem with ordered data mode. Quota mode: none.
[ 248.280552] ext3 filesystem being mounted at /boot supports timestamps until 2038 (0x7fffffff)
[ 249.131804] audit: type=1400 audit(1670590441.448:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=361 comm="apparmor_parser"
[ 249.215919] audit: type=1400 audit(1670590441.532:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=362 comm="apparmor_parser"
[ 249.269912] audit: type=1400 audit(1670590441.532:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=362 comm="apparmor_parser"
[ 249.396064] audit: type=1400 audit(1670590441.712:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=363 comm="apparmor_parser"
[ 249.457729] audit: type=1400 audit(1670590441.712:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=363 comm="apparmor_parser"
[ 249.552470] audit: type=1400 audit(1670590441.712:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=363 comm="apparmor_parser"
[ 249.660918] audit: type=1400 audit(1670590441.976:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cups-browsed" pid=367 comm="apparmor_parser"
[ 249.926589] audit: type=1400 audit(1670590442.240:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/cups/backend/cups-pdf" pid=372 comm="apparmor_parser"
[ 249.958369] audit: type=1400 audit(1670590442.240:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cupsd" pid=372 comm="apparmor_parser"
[ 249.978737] audit: type=1400 audit(1670590442.240:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cupsd//third_party" pid=372 comm="apparmor_parser"
[ 253.163649] NFSD: Using nfsdcld client tracking operations.
[ 253.169319] NFSD: no clients to reclaim, skipping NFSv4 grace period (net f0000000)
[ 253.920796] mv643xx_eth_port mv643xx_eth_port.0 eth0: link up, 1000 Mb/s, full duplex, flow control disabled
[ 253.930866] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[19661.996096] md: md2 stopped.
[19671.219470] md: md2 stopped.
[19671.417367] md/raid:md2: device sdb6 operational as raid disk 1
[19671.423388] md/raid:md2: device sdd6 operational as raid disk 3
[19671.429388] md/raid:md2: device sdc6 operational as raid disk 2
[19671.466126] md/raid:md2: raid level 5 active with 3 out of 4 devices, algorithm 2
[19671.482838] md2: bitmap file is out of date (39797 < 39799) -- forcing full recovery
[19671.498258] md2: bitmap file is out of date, doing full recovery
[19671.738418] md2: detected capacity change from 0 to 5770490880
[19675.028926] ata1: mv_handle_fbs_ncq_dev_err: pmp_map=0002 qc_map=0060 failed_links=1 nr_active_links=1
[19675.038307] ata1: mv_handle_fbs_ncq_dev_err: done
[19690.309577] ata1.01: qc timeout (cmd 0x47)
[19690.313866] ata1.01: Read log 0x10 page 0x00 failed, Emask 0x40
[19690.319849] ata1.01: failed to read log page 10h (errno=-5)
[19690.325492] ata1.00: failed to read SCR 1 (Emask=0x40)
[19690.330699] ata1.01: failed to read SCR 1 (Emask=0x40)
[19690.335889] ata1.02: failed to read SCR 1 (Emask=0x40)
[19690.341074] ata1.03: failed to read SCR 1 (Emask=0x40)
[19690.346274] ata1.01: exception Emask 0x1 SAct 0x60 SErr 0x0 action 0x6 frozen
[19690.353471] ata1.01: dev err
[19690.356388] ata1.01: failed command: READ FPDMA QUEUED
[19690.361571] ata1.01: cmd 60/00:28:a0:c8:d5/02:00:00:00:00/40 tag 5 ncq dma 262144 in
res 43/40:30:00:07:7c/40:00:73:00:00/40 Emask 0x9 (media error)
[19690.377250] ata1.01: status: { DRDY SENSE ERR }
[19690.381841] ata1.01: error: { UNC }
[19690.385356] ata1.01: failed command: READ FPDMA QUEUED
[19690.390540] ata1.01: cmd 60/08:30:00:07:7c/00:00:73:00:00/40 tag 6 ncq dma 4096 in
res 43/40:30:00:07:7c/40:00:73:00:00/40 Emask 0x9 (media error)
[19690.405964] ata1.01: status: { DRDY SENSE ERR }
[19690.410541] ata1.01: error: { UNC }
[19690.889871] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[19691.215191] ata1.01: hard resetting link
[19696.733821] ata1.15: link is slow to respond, please be patient (ready=0)
[19701.237800] ata1.01: SRST failed (errno=-16)
[19704.373756] ata1.15: qc timeout (cmd 0xe4)
[19704.377951] ata1.01: failed to read SCR 0 (Emask=0x4)
[19704.383055] ata1.01: reset failed, giving up
[19704.387375] ata1.15: hard resetting link
[19704.861761] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[19704.869124] ata1.01: hard resetting link
[19710.389697] ata1.15: link is slow to respond, please be patient (ready=0)
[19714.893656] ata1.01: SRST failed (errno=-16)
[19717.941626] ata1.15: qc timeout (cmd 0xe4)
[19717.945816] ata1.01: failed to read SCR 0 (Emask=0x4)
[19717.950921] ata1.01: reset failed, giving up
[19717.955240] ata1.15: hard resetting link
[19718.429641] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[19718.755041] ata1.01: hard resetting link
[19724.273544] ata1.15: link is slow to respond, please be patient (ready=0)
[19728.777504] ata1.01: SRST failed (errno=-16)
[19732.021494] ata1.15: qc timeout (cmd 0xe4)
[19732.025678] ata1.01: failed to read SCR 0 (Emask=0x4)
[19732.030782] ata1.01: reset failed, giving up
[19732.035087] ata1.01: failed to recover link after 3 tries, disabling
[19732.041494] ata1.01: disable device
[19732.045013] ata1.15: hard resetting link
[19732.521492] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[19732.853494] sd 0:1:0:0: rejecting I/O to offline device
[19732.858800] blk_print_req_error: 11 callbacks suppressed
[19732.858812] I/O error, dev sdb, sector 14008336 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 2
[19732.873155] md: super_written gets error=-5
[19732.877363] md/raid:md2: Disk failure on sdb6, disabling device.
[19732.883399] md/raid:md2: Cannot continue operation (2/4 failed).
[19733.927109] ata1.02: configured for UDMA/133
[19733.942852] ata1.03: configured for UDMA/133
[19733.948194] sd 0:1:0:0: [sdb] tag#5 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=61s
[19733.957349] sd 0:1:0:0: [sdb] tag#5 Sense Key : Medium Error [current]
[19733.964032] sd 0:1:0:0: [sdb] tag#5 Add. Sense: Unrecovered read error - auto reallocate failed
[19733.972816] sd 0:1:0:0: [sdb] tag#5 CDB: Read(10) 28 00 00 d5 c8 a0 00 02 00 00
[19733.980182] I/O error, dev sdb, sector 14010528 op 0x0:(READ) flags 0x0 phys_seg 64 prio class 2
[19733.989046] md/raid:md2: read error not correctable (sector 2208 on sdb6).
[19733.995993] md/raid:md2: read error not correctable (sector 2216 on sdb6).
[19734.002925] md/raid:md2: read error not correctable (sector 2224 on sdb6).
[19734.009862] md/raid:md2: read error not correctable (sector 2232 on sdb6).
[19734.016788] md/raid:md2: read error not correctable (sector 2240 on sdb6).
[19734.023726] md/raid:md2: read error not correctable (sector 2248 on sdb6).
[19734.030664] md/raid:md2: read error not correctable (sector 2256 on sdb6).
[19734.037604] md/raid:md2: read error not correctable (sector 2264 on sdb6).
[19734.044536] md/raid:md2: read error not correctable (sector 2272 on sdb6).
[19734.051468] md/raid:md2: read error not correctable (sector 2280 on sdb6).
[19734.058531] sd 0:1:0:0: [sdb] tag#6 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=61s
[19734.067657] sd 0:1:0:0: [sdb] tag#6 Sense Key : Medium Error [current]
[19734.074340] sd 0:1:0:0: [sdb] tag#6 Add. Sense: Unrecovered read error - auto reallocate failed
[19734.083113] sd 0:1:0:0: [sdb] tag#6 CDB: Read(10) 28 00 73 7c 07 00 00 00 08 00
[19734.090480] I/O error, dev sdb, sector 1937508096 op 0x0:(READ) flags 0x800 phys_seg 1 prio class 2
[19734.099613] ata1: EH complete
[19734.103050] I/O error, dev sdb, sector 1937508304 op 0x0:(READ) flags 0x800 phys_seg 1 prio class 2
[19734.121891] buffer_io_error: 18 callbacks suppressed
[19734.121912] Buffer I/O error on dev md2, logical block 32, async page read
[19734.170053] ata1.01: detaching (SCSI 0:1:0:0)
[19734.189647] sd 0:1:0:0: [sdb] Synchronizing SCSI cache
[19734.215123] sd 0:1:0:0: [sdb] Synchronize Cache(10) failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[19734.225416] sd 0:1:0:0: [sdb] Stopping disk
[19734.273491] sd 0:1:0:0: [sdb] Start/Stop Unit failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[19734.888262] md2: detected capacity change from 5770490880 to 0
[19734.894197] md: md2 stopped.
[19744.644300] /dev/md2: Can't open blockdev
[19763.213036] /dev/md2: Can't open blockdev
Of note are some errors that are called out where "md2" is referenced.
I rebooted and did ls /sys/block, and md2 is back
md0 md1 md10 md2 mtdblock0 mtdblock1 sda sdb sdc
And I'm able to force assemble, but then right after, the array disappears until I reboot and try again.
I should note I'm booting with drives 2, 3, and 4 in the bays. Drive 1 is not in there, because it prevents me from booting.
looks like one of your drives is throwing IO errors.
[ 9.263620] ata1.00: Read log 0x10 page 0x00 failed, Emask 0x1
[ 9.269517] ata1.00: failed to read log page 10h (errno=-5)
[ 9.275147] ata1.00: failed to read SCR 1 (Emask=0x40)
[ 9.280337] ata1.00: NCQ disabled due to excessive errors
[ 9.285791] ata1.01: failed to read SCR 1 (Emask=0x40)
[ 9.290973] ata1.02: failed to read SCR 1 (Emask=0x40)
[ 9.296162] ata1.03: failed to read SCR 1 (Emask=0x40)
[ 9.301352] ata1.00: exception Emask 0x1 SAct 0x4000 SErr 0x0 action 0x6 frozen
[ 9.308715] ata1.00: dev err
[ 9.311633] ata1.00: failed command: READ FPDMA QUEUED
[ 9.316815] ata1.00: cmd 60/02:70:02:00:00/00:00:00:00:00/40 tag 14 ncq dma 1024 in
res 51/04:70:02:00:00/04:00:00:00:00/40 Emask 0x1 (device error)
[ 9.332406] ata1.00: status: { DRDY ERR }
[ 9.336452] ata1.00: error: { ABRT }
[ 9.811509] ata1.15: SATA link up 3.0 Gbps (SStatus 123 SControl F300)
[ 9.818852] ata1.00: hard resetting link
It also seems to complain about some bad data in the MD device, not shocking since you had to force it to assemble.
md/raid:md2: read error not correctable (sector 2280 on sdb6).
another thing to look at is the SMART data. You could reboot and before you mess with MD2 try getting the smart data smartctl -a
from all the drives, particularly the one that now seems to have trouble.
if the drive is still mostly working you might be able to clone it to a new drive and then force add that to the array. There might even be a way to make mdadm ignore a few data errors so you can try to recover what's left. To be honest I've never gotten to that point personally.
Cool, thanks. Interesting about cloning to a new drive. I'm guessing I'd have to try that outside of the TS box itself? Like on a Linux desktop or something. Will cross that bridge if and when I have to, but it's a good suggestion.
I'll try for the SMART data now, momentarily, and post back here.
sdd:
smartctl 7.3 2022-02-28 r5338 [armv5tel-linux-6.0.0-5-marvell] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Seagate Constellation ES.3
Device Model: ST1000NM0033-9ZM173
Serial Number: Z1W0MD3D
LU WWN Device Id: 5 000c50 064cad930
Firmware Version: 0001
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Device is: In smartctl database 7.3/5319
ATA Version is: ACS-2 (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 1.5 Gb/s)
Local Time is: Fri Dec 9 17:27:36 2022 NST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: FAILED!
Drive failure expected in less than 24 hours. SAVE ALL DATA.
See vendor-specific Attribute list for failed Attributes.
General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 592) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off supp ort.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 116) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x50bd) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_ FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 037 036 044 Pre-fail Always FAILI NG_NOW 12263131
3 Spin_Up_Time 0x0003 097 097 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 617
5 Reallocated_Sector_Ct 0x0033 077 077 010 Pre-fail Always - 1285
7 Seek_Error_Rate 0x000f 090 060 030 Pre-fail Always - 1179813657
9 Power_On_Hours 0x0032 062 062 000 Old_age Always - 33422
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 615
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 099 000 Old_age Always - 4295032833
189 High_Fly_Writes 0x003a 093 093 000 Old_age Always - 7
190 Airflow_Temperature_Cel 0x0022 070 047 045 Old_age Always - 30 (Min/Max 29/30)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 611
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 617
194 Temperature_Celsius 0x0022 030 053 000 Old_age Always - 30 (0 12 0 0 0)
195 Hardware_ECC_Recovered 0x001a 012 012 000 Old_age Always - 12263131
197 Current_Pending_Sector 0x0012 095 095 000 Old_age Always - 856
198 Offline_Uncorrectable 0x0010 095 095 000 Old_age Offline - 856
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA _of_first_error
# 1 Short offline Completed without error 00% 15256 -
# 2 Short offline Completed without error 00% 3 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
sdc:
smartctl 7.3 2022-02-28 r5338 [armv5tel-linux-6.0.0-5-marvell] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Seagate Constellation ES.3
Device Model: ST1000NM0033-9ZM173
Serial Number: Z1W03Z5C
LU WWN Device Id: 5 000c50 050ace05a
Firmware Version: 0001
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Device is: In smartctl database 7.3/5319
ATA Version is: ACS-2 (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Fri Dec 9 17:28:43 2022 NST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 600) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 127) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x50bd) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 081 059 044 Pre-fail Always - 156575972
3 Spin_Up_Time 0x0003 096 096 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 622
5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 5
7 Seek_Error_Rate 0x000f 090 060 030 Pre-fail Always - 1298740013
9 Power_On_Hours 0x0032 061 061 000 Old_age Always - 34166
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 618
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 063 063 000 Old_age Always - 37
188 Command_Timeout 0x0032 100 099 000 Old_age Always - 2
189 High_Fly_Writes 0x003a 095 095 000 Old_age Always - 5
190 Airflow_Temperature_Cel 0x0022 069 047 045 Old_age Always - 31 (0 1 31 30 0)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 614
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 622
194 Temperature_Celsius 0x0022 031 053 000 Old_age Always - 31 (128 0 0 0 0)
195 Hardware_ECC_Recovered 0x001a 021 004 000 Old_age Always - 156575972
197 Current_Pending_Sector 0x0012 100 098 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 098 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
SMART Error Log Version: 1
ATA Error Count: 37 (device log contains only the most recent five errors)
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.
Error 37 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 00 ff ff ff 4f 00 06:10:15.816 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:13.141 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:10.504 READ DMA EXT
25 00 58 ff ff ff 4f 00 06:10:10.385 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:07.763 READ DMA EXT
Error 36 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 00 ff ff ff 4f 00 06:10:13.141 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:10.504 READ DMA EXT
25 00 58 ff ff ff 4f 00 06:10:10.385 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:07.763 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:07.644 READ DMA EXT
Error 35 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 00 ff ff ff 4f 00 06:10:10.504 READ DMA EXT
25 00 58 ff ff ff 4f 00 06:10:10.385 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:07.763 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:07.644 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:05.112 READ DMA EXT
Error 34 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 00 ff ff ff 4f 00 06:10:07.763 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:07.644 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:10:05.112 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:09:24.315 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:09:21.575 READ DMA EXT
Error 33 occurred at disk power-on lifetime: 15316 hours (638 days + 4 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 00 ff ff ff 4f 00 06:10:05.112 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:09:24.315 READ DMA EXT
25 00 00 ff ff ff 4f 00 06:09:21.575 READ DMA EXT
35 00 a8 ff ff ff 4f 00 06:09:21.568 WRITE DMA EXT
ea 00 00 00 00 00 40 00 06:09:21.553 FLUSH CACHE EXT
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed without error 00% 48 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.```
sdb:
smartctl 7.3 2022-02-28 r5338 [armv5tel-linux-6.0.0-5-marvell] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Seagate Constellation ES.3
Device Model: ST1000NM0033-9ZM173
Serial Number: Z1W02XDJ
LU WWN Device Id: 5 000c50 050519a6e
Firmware Version: 0001
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Device is: In smartctl database 7.3/5319
ATA Version is: ACS-2 (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Fri Dec 9 17:29:44 2022 NST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 584) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 112) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x50bd) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 081 063 044 Pre-fail Always - 151642236
3 Spin_Up_Time 0x0003 096 096 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 620
5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 090 060 030 Pre-fail Always - 1157132968
9 Power_On_Hours 0x0032 062 062 000 Old_age Always - 34158
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 619
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0
189 High_Fly_Writes 0x003a 098 098 000 Old_age Always - 2
190 Airflow_Temperature_Cel 0x0022 068 050 045 Old_age Always - 32 (Min/Max 31/32)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 618
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 620
194 Temperature_Celsius 0x0022 032 050 000 Old_age Always - 32 (0 14 0 0 0)
195 Hardware_ECC_Recovered 0x001a 027 012 000 Old_age Always - 151642236
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed without error 00% 6 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.```
So, looks like 1 drive is failing, 2 drives are fine. And I tried to put in the first (missing) drive ,but it holds up booting and it even messes things up when I try to add it while the TS is booted up properly, so that one seems completely botched.
yeah, SDD basically dead. SDC with the 5 relocated sectors and all those read errors is on its way too most likely.
Sucks, but at least it's good to know officially. Not sure if it's worth the effort, but is there any value in stripping out the drive and plugging them into a full desktop to try to run recovery?
Had I had my time back, I would've run smartmon a little more often to anticipate these things. Good news is I was looking at the backup on my external 4 TB drive and it looks to be about 70-80% of what was available on the array, so it could be worse. I've learned a lot along the way and am grateful for all your help!
Got to thinking again. When I get my new drive in the mail, is it worth swapping out the existing SDD for the new one and see if the array rebuilds w/ the three drives? Not to use long-term, but rather to salvage any other data i might be missing from my backup.
ARRAY /dev/md0 UUID=e7194c7c:f3579d9d:529ae12f:b827b7aa
ARRAY /dev/md/1 metadata=1.2 UUID=d6c17ec0:cc93ec32:218a896f:4358e4cf name=TS-XEL-EM02C:1
ARRAY /dev/md/10 metadata=1.2 UUID=db00a7ae:43c0dfeb:89959a8c:b4b581b3 name=TS-XEL-EM02C:10
ARRAY /dev/md/2 metadata=1.2 UUID=46c1d87e:e7b2970a:3edd105f:c51f08fe name=TS-XEL02C:2
root@debian:/home/marc# sudo mount /dev/md/2 /mnsudo mdadm -D /dev/md0t/array
mount: invalid option -- 'D'
Try 'mount --help' for more information.
root@debian:/home/marc# sudo mdadm -D /dev/md2
mdadm: cannot open /dev/md2: No such file or directory
root@debian:/home/marc# sudo mdadm -D /dev/md/2
mdadm: cannot open /dev/md/2: No such file or directory
root@debian:/home/marc# sudo mdadm -D /dev/md/2
mdadm: cannot open /dev/md/2: No such file or directory
root@debian:/home/marc# mdadm --assemble --force --uuid 46c1d87e:e7b2970a:3edd105f:c51f08fe /dev/md/2
bash: mdadm: command not found
root@debian:/home/marc# sudo mdadm --assemble --force --uuid 46c1d87e:e7b2970a:3edd105f:c51f08fe /dev/md/2
mdadm: /dev/md/2 assembled from 2 drives - not enough to start the array.
Hadn't tried w/ the uuid option before. That seems to result in a more "realistic" outcome, given the 2 drives assembling (as opposed to 3 when i manually force them, but then the array does a disappearing act)
it needs all 3 stable to do anything with a fourth.
it might be worth a shot taking a new drive and the drive that is failing and putting them into a dock or something and trying to clone it. there are tools like ddrescue that will keep trying to read the drive even if hitting IO errors and even support multiple tries at reads/etc.
I thought there used to be tricks for trying to get a dying drive to behave long enough to try to clone it, but the top google result makes it sound the the "freezer trick" isn't really a thing any more: https://drivesaversdatarecovery.com/why-the-freezer-trick-for-hard-drives-doesnt-work/#:~:text=Bottom%20line%2C%20modern%20hard%20drives,destroy%20the%20hard%20drive%20permanently.
Hey again! Hope that 2023 is treating you well so far.
So just an update that I decided to retire the TS-XEL, at least for the time being. I might keep it around and do a side project with it at some point, but I'll be shifting to a full tower setup with Windows or Linux (likely TrueNAS, but will think on it more). A few questions:
Thanks again for all your help. I learned a lot along the way.
The OS is one the drives so you can always wipe the drives and install the stock firmware or debian using the instructions on the wiki etc.
Debian can run on any number of disks. The stock firmware can too though you need to tweak something to use less than 4 in some cases. Theres a note on the wiki about that part.
I’ve been playing around with a few different backup strategies lately mixing zfs send/receive and simpler rsync based backups. I’ve also played a little bit with iscsi. most terastations are mostly good enough for most of that though zfs on 32-bit devices is unsupported now (though I did get it to work on a device as an experiment).
as write all of this I realize it’s probably better suited to discord rather than a github issue. In any case, good luck!
np, sounds good! Thanks so much again for all your help. I can reach out on Discord if anything arises and I need help. Will close this ticket for now. Cheers!
Hi again, I hope you're well! It was nice being error free on the TS-XEL for awhile, but sadly some new issues arose that I could use help with.
Today, I noticed that my DLNA server was showing media files, but when I clicked any of them, I got an error. I went upstairs to check the box; it was on without any errors, though I heard what sounded like a HDD spinning and struggling to do so.
I shut it down and rebooted; then, it hung at the "no init file", so I decided to break out the UART/serial console cable again (grateful for that option; thanks again the tips previously!)
I got output in Putty and let the box do its thing as it booted up. When the "no init file" output appeared on the display, I looked t the Putty output and saw the following:
"hard resetting link" and the output around it appeared to show up in a loop in the output. From what I read, it could be bad contact with a specific drive. I'm guessing it could be a drive failing, too? If this looks familiar and if you have any suggestions, do let me know, and thanks again for all your help!