mmc0 Timeout waiting for hardware interrupt

Hey,

we've been seeing the above error randomly occur with Raspberry Pi 3s. SD card manufacturer or new/old doesn't seem to make any difference. I've attached the full message log for the error.

Is this a known issue that can be mitigated somehow? We can't use the alternate SD card controller since we need the WLAN connectivity.

mmc_timeout.txt

This is not a common failure - after a difficult development and some initial glitches the sdhost driver has been stable for at least a year now. There could well be bugs, but if so they must have been hiding well.

The log shows the last transfer (prior to this the interface was idle, periodically checking that the card is still present):

[13587.156458] [e97700ea] PRD< c2231240 0
[13587.162954] [e97700eb] PRD1 dea95b10 0
[13587.169461] [e97700f3] PRD2 a 0
[13587.175348] [e9770104] PRD3 cab66184 0
[13587.181863] [e9770105] PDM> c2231240 0
[13587.188327] [e9770106] REQ< c2231168 10801
[13587.195172] [e9770107] CMD< 17 50
[13587.201200] [e977010b] FCM< c2231168 c22311a4
[13587.208322] [e977010d] RSP  900 0
[13587.214378] [e977010e] CMD< 12 19c380
[13587.220771] [e9770110] CMDD 50 200
[13587.226933] [e9770110] SDMA c2231240 dea95b10
[13587.234098] [e9770112] FCM< c2231168 c22311d8
[13587.241258] [e9770113] RSP  900 0
[13587.247337] [e9770115] FCM> c2231168 0
[13587.253826] [e9770116] FCM> c2231168 0
[13587.260321] [e9770116] CMD  12 200
[13587.266457] [e9770116] REQ> c2231168 0
[13587.272942] [ea16f1e2] TIM< 0 0

It's a CMD23 (0x17 - Set block count) indicating an 80 sector transfer, followed by a CMD18 (0x12 - Read multiple blocks) starting at sector 0x19c380 (about 845MB from the start), preceded by the necessary DMA setup, but for some reason the DMA never completes so the transfer times out.

How are you powering the Pi3? Is the power supply capable of delivering 2.5A? Do you ever see the yellow lightning signal appear on the display? What does running vcgencmd get_throttled report during typical activity?

We don't have the warning signs enabled since we use the full KMS. I have just tested with high CPU load for a good time and there was no undervoltage event observed. The power supplies are rated for 2.5A.

I'll see if I can get some more traces, unfortunately there sometimes seem to be IO related lockups that don't even trigger the timeout.

You say you've tried multiple Pi3s and multiple SD cards, so there must be something different about your environment otherwise lots of people would be reporting similar problems. Can you post your config.txt and cmdline.txt, and tell me a bit about the software you are running?

I did find one recent report of similar issues: https://patchwork.kernel.org/patch/10219145/ From what I can tell, the upstream sdhost driver mentioned there is identical to the downstream one, minus the extensive logging/tracing.

I've attached config/cmdline. The software is indeed a bit more special. While the kernel is rpi-4.9.y with a few choice cherry-picks from AOSP kernel common, in userland we run Android on a mesa3d v18 graphics stack.

cmdline.txt config.txt

That all looks reasonable, as do the two patches you referenced. I'll do something similar in the downstream version of the driver (with a hat-tip to the original poster).

I've got a patch which seems to work, although I've only been able to test it by faking a timeout. If I upload the patch somewhere will you be able to try it and test it?

The patch can be downloaded here.

Thanks, I'll test that. It is unfortunately difficult to reproduce reliably.

Any evidence of a single timeout from which it recovers would be great, but since the timeouts are basically fatal at the moment the required confidence level for merging is pretty low.

Just a note, I've started to experience this with a SD card (Samsung 16 EVO, exact same model as mentioned in the patchworks thread linked above) that was previously running wheezy on a Pi1B without any issues and re-written with latest Raspbian. Tested on both Pi2 B and an original Pi1, both fail. A pretty reliable way to reproduce is running badblocks over the card.

@stschake:

Are you able to reproduce this issue with the bcm2835.c instead of bcm2835-sdhost.c (they are more different than you think)?

@oniongarlic

Are you able to reproduce this issue with a different SD card than Samsung 16 EVO? Which parameters did you use for badblocks to reproduce the issue?

@stschake Did @pelwell patch help in any way or are you still seeing the issue?

@oniongarlic Any further comment?

Sorry, I haven't seen the issue since - but since the patch would only trigger on an actual timeout, I can't say either way.

I've seen some issues like this on Fedora, I had one specific RPi3 that would see similar style issues and went through a number of good quality (Sandisk Ultra and Samsung EVO) in the process but seems to have settled with 4.15+ (although maybe it's wishful thinking there). I wonder if the move of the MMC stack to MQ and some of the improvements there have helped this problem or maybe masked it in different ways?

@pelwell Thoughts on closing this?

OK with me. Closed issues are still searchable and can be re-opened as needed, but this been quiet for long enough.

FWIW, I have a similar error during boot on my Yocto linux image. First it gives the hardware interrupt timeout, then a similar trace of the last transaction, and periodically some error that a CPU is frozen. Since it does not boot, I'm not sure how to extract the relevant information.

What's peculiar is that the issue started occurring after adding a random Python recipe. And old Raspbian image on another SD card still works. The same Yocto image on a new SD card does not.

I could potentially upload the entire Yocto image if that would help reproducing the problem.

The preferred method is to a connected USB to serial adapter on the debug UART. But a photo of the beginning of the stacktrace would be okay.

Edit: Please open a new issue for this.

Also chiming in here - I'm seeing a similar issue during boot, but on an EspressoBin instead of a RaspberryPi. Different hardware true, but issues could be related. Here's the UART dump I get:

[   25.495102] mmc0: Timeout waiting for hardware interrupt.
[   25.500400] ------------[ cut here ]------------
[   25.505381] WARNING: at drivers/mmc/host/sdhci.c:1014
[   25.510694] Modules linked in:
[   25.513671] 
[   25.515299] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.4.52-armada-17.10.4-gb3509f8 #1
[   25.523219] Hardware name: EspressoBin, 256MB DDR3, Marvell 88E1512 PHY (DT)
[   25.531319] task: ffffffc006900000 ti: ffffffc006908000 task.ti: ffffffc006908000
[   25.538887] PC is at sdhci_send_command+0x6c0/0xa78
[   25.543920] LR is at sdhci_finish_data+0xd0/0x2f0
[   25.548957] pc : [<ffffffc0007e2110>] lr : [<ffffffc0007e2800>] pstate: 400001c5
[   25.556602] sp : ffffffc00690bb20
[   25.559935] x29: ffffffc00690bb20 x28: ffffffc006908000 
[   25.565517] x27: ffffffc000dae000 x26: ffffffc00bfd7bb8 
[   25.571010] x25: ffffffc000e88ea0 x24: ffffffc006908000 
[   25.576504] x23: ffffffc006183130 x22: 0000000000000002 
[   25.581998] x21: 0000000000000003 x20: ffffffc006183170 
[   25.587494] x19: ffffffc00616b500 x18: 0000000000000000 
[   25.592988] x17: 0000007f7e20f940 x16: ffffffc0001fec68 
[   25.598484] x15: 0000000000000010 x14: ffffffc080ea017f 
[   25.603979] x13: ffffffc000ea018d x12: 0000000000000006 
[   25.609473] x11: 0000000000000006 x10: 0000000005f5e0ff 
[   25.614970] x9 : 0000000000000150 x8 : 7265746e69206572 
[   25.620463] x7 : 6177647261682072 x6 : 0000000006c00000 
[   25.625958] x5 : ffffffc0000997f0 x4 : ffffffc000ebfe08 
[   25.631451] x3 : 0000000000000002 x2 : ffffffc0007e61c8 
[   25.636948] x1 : ffffffc006183130 x0 : ffffffc0061830f0 
[   25.642441] 
[   25.643972] ---[ end trace d7ad8c474e1fcc82 ]---
[   25.648922] Call trace:
[   25.651272] [<ffffffc0007e2110>] sdhci_send_command+0x6c0/0xa78
[   25.657483] [<ffffffc0007e2800>] sdhci_finish_data+0xd0/0x2f0
[   25.663514] [<ffffffc0007e2bec>] sdhci_timeout_timer+0x84/0xd8
[   25.669379] [<ffffffc00011e148>] call_timer_fn+0x38/0x1c8
[   25.674689] [<ffffffc00011e4dc>] run_timer_softirq+0x204/0x270
[   25.681081] [<ffffffc0000c80d0>] __do_softirq+0x128/0x360
[   25.686749] [<ffffffc0000c85c8>] irq_exit+0x98/0xf0
[   25.691708] [<ffffffc00010b020>] __handle_domain_irq+0x60/0xb8
[   25.697827] [<ffffffc0000827c4>] gic_handle_irq+0xbc/0x168
[   25.703237] Exception stack(0xffffffc00690bde0 to 0xffffffc00690bf10)
[   25.709898] bde0: ffffffc000daf000 0000007fffffffff ffffffc00690bf40 ffffffc000086848
[   25.717905] be00: 0000000000000145 ffffffc000d85ad8 0000000000000000 0000000000000000
[   25.726365] be20: 0000000000000001 0000000000000000 00000000000001c0 0100000000000000
[   25.734475] be40: 0000000000000000 ffffffc00bfdd040 ffffffc0069007c0 ffffffc00690bed0
[   25.742226] be60: 0000000000000760 0000000000000000 0000000000000000 0000000000091b92
[   25.750326] be80: 0000000000000000 0000000000000000 ffffffc0001fec68 0000007f7e20f940
[   25.758427] bea0: 00000000000007b1 ffffffc000daf000 ffffffc000dafae8 ffffffc0009bd370
[   25.766886] bec0: 0000000000000000 0000000000000000 ffffffc000d85ad8 ffffffc000e89000
[   25.774816] bee0: ffffffc0009bd000 ffffffc00690bf70 ffffffc006908000 ffffffc00690bf40
[   25.783003] bf00: ffffffc000086844 ffffffc00690bf40
[   25.787869] [<ffffffc000085700>] el1_irq+0x80/0xf8
[   25.792732] [<ffffffc000100524>] default_idle_call+0x1c/0x38
[   25.798669] [<ffffffc000100880>] cpu_startup_entry+0x2f0/0x340
[   25.804970] [<ffffffc00009014c>] secondary_start_kernel+0x12c/0x150
[   25.811367] [<00000000000829dc>] 0x829dc
[   35.511102] mmc0: Timeout waiting for hardware interrupt.
[   36.495096] INFO: rcu_preempt detected stalls on CPUs/tasks:
[   36.500799]  0-...: (1 GPs behind) idle=969/140000000000001/0 softirq=2203/2208 fqs=5170 
[   36.509158]  (detected by 1, t=5252 jiffies, g=537, c=536, q=672)
[   36.515372] Task dump for CPU 0:
[   36.518701] stats_collector R  running task        0  1691   1679 0x00000002
[   36.525993] Call trace:
[   36.528615] [<ffffffc000086e28>] __switch_to+0x88/0xa0
[   36.534008] [<ffffffc00010b01c>] __handle_domain_irq+0x5c/0xb8
[   36.540217] [<ffffffc0000827c4>] gic_handle_irq+0xbc/0x168
[   36.545895] Exception stack(0xffffffc004bafe90 to 0xffffffc004baffc0)
[   36.552563] fe80:                                   0000000000000000 0000007fb2185972
[   36.560402] fea0: ffffffffffffffff 0000007fb22033f4 0000000060000000 0000007fb2181110
[   36.568594] fec0: 0000007fb2185972 0000007fb2181110 0000000000000000 0000000000000001
[   36.576607] fee0: 0000000000000004 00000000004040b0 00000000000001b5 0000000000406570
[   36.584889] ff00: 0000000000000022 000000000000001b 0101010101010101 0000007fb21f7b40
[   36.592903] ff20: 0000007fb1c19da8 0000007fb221a9a8 0000007fb2227000 0000007fb1c07414
[   36.600825] ff40: 0000007fb2228000 0000007fb220ff00 0000000000040434 00000000004017b8
[   36.609101] ff60: 0000007fb2185972 0000007fccd5e098 0000000000406570 0000007fb2229190
[   36.617290] ff80: 0000007fb2181110 00000000000001b5 0000000000000004 0000000000000000
[   36.625303] ffa0: 0000007fccd5e094 0000007fccd5df50 0000007fb22038b0 0000007fccd5df50
[   36.633583] [<ffffffc000085c18>] el0_irq_naked+0x1c/0x24
[   45.527102] mmc0: Timeout waiting for hardware interrupt.
[   45.532989] mmcblk0: error -110 sending status command, retrying
[   55.543102] mmc0: Timeout waiting for hardware interrupt.
[   55.548713] mmcblk0: error -110 sending status command, retrying
[   65.559103] mmc0: Timeout waiting for hardware interrupt.
[   65.564732] mmcblk0: error -110 sending status command, aborting
[   65.570637] blk_update_request: I/O error, dev mmcblk0, sector 606500
[   65.577424] blk_update_request: I/O error, dev mmcblk0, sector 606508
[   65.584295] blk_update_request: I/O error, dev mmcblk0, sector 606516

I also have this timeout message on a Raspberry 3B with Raspbian Buster. Don't know if it is related.

Originally, I tried to find out why my bitcoind process is terminating after some time: https://bitcoin.stackexchange.com/questions/91582/where-can-i-find-a-usefull-log-if-bitcoind-stopped-for-no-apparent-reason

Seeing simular errors with a Raspberrypi 4b and original Pi Powersupply. Pi has no SD Card, only m.2 SSD on USB3 port with Beta Firmware from 6/15/20. Maybe an eletrical problem? Missing pullup/down? Plugged a dead SDCard and the errors are gone. `` [ 5098.170186] mmc0: Timeout waiting for hardware cmd interrupt. [ 5098.170194] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5098.170202] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5098.170206] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5098.170210] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5098.170214] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5098.170218] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5098.170222] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5098.170226] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5098.170229] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5098.170233] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5098.170237] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5098.170241] mmc0: sdhci: Cmd: 0x00000502 | Max curr: 0x00080008

[ 5098.170251] mmc0: sdhci: Host ctl2: 0x00000000 [ 5098.170255] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5098.170258] mmc0: sdhci: ============================================ [ 5108.410373] mmc0: Timeout waiting for hardware cmd interrupt. [ 5108.410380] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5108.410387] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5108.410391] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5108.410395] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5108.410399] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5108.410403] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5108.410407] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5108.410411] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5108.410414] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5108.410418] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5108.410422] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5108.410426] mmc0: sdhci: Cmd: 0x0000371a | Max curr: 0x00080008

[ 5108.410436] mmc0: sdhci: Host ctl2: 0x00000000 [ 5108.410440] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5108.410443] mmc0: sdhci: ============================================ [ 5119.930605] mmc0: Timeout waiting for hardware cmd interrupt. [ 5119.930612] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5119.930620] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5119.930624] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5119.930628] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5119.930632] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5119.930636] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5119.930640] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5119.930643] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5119.930647] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5119.930651] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5119.930655] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5119.930659] mmc0: sdhci: Cmd: 0x00000502 | Max curr: 0x00080008

[ 5119.930669] mmc0: sdhci: Host ctl2: 0x00000000 [ 5119.930673] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5119.930677] mmc0: sdhci: ============================================ [ 5131.450797] mmc0: Timeout waiting for hardware cmd interrupt. [ 5131.450803] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5131.450809] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5131.450813] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5131.450817] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5131.450821] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5131.450825] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5131.450829] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5131.450832] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5131.450836] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5131.450840] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5131.450844] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5131.450847] mmc0: sdhci: Cmd: 0x00000502 | Max curr: 0x00080008

[ 5131.450857] mmc0: sdhci: Host ctl2: 0x00000000 [ 5131.450861] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5131.450864] mmc0: sdhci: ============================================ [ 5141.690999] mmc0: Timeout waiting for hardware cmd interrupt. [ 5141.691006] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5141.691013] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5141.691017] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5141.691021] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5141.691024] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5141.691028] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5141.691032] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5141.691035] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5141.691039] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5141.691043] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5141.691046] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5141.691050] mmc0: sdhci: Cmd: 0x0000371a | Max curr: 0x00080008

[ 5141.691060] mmc0: sdhci: Host ctl2: 0x00000000 [ 5141.691064] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5141.691067] mmc0: sdhci: ============================================ [ 5158.331311] mmc0: Timeout waiting for hardware cmd interrupt. [ 5158.331322] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5158.331335] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5158.331344] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5158.331354] mmc0: sdhci: Argument: 0x80000c08 | Trn mode: 0x00000000 [ 5158.331363] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5158.331372] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5158.331381] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5158.331390] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5158.331399] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5158.331408] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5158.331417] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5158.331426] mmc0: sdhci: Cmd: 0x0000341a | Max curr: 0x00080008

[ 5158.331452] mmc0: sdhci: Host ctl2: 0x00000000 [ 5158.331461] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5158.331468] mmc0: sdhci: ============================================ [ 5202.492126] mmc0: Timeout waiting for hardware cmd interrupt. [ 5202.492137] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5202.492150] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5202.492160] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5202.492169] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5202.492178] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5202.492187] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5202.492197] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5202.492206] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5202.492215] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5202.492223] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5202.492232] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5202.492241] mmc0: sdhci: Cmd: 0x0000371a | Max curr: 0x00080008

[ 5202.492267] mmc0: sdhci: Host ctl2: 0x00000000 [ 5202.492276] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5202.492283] mmc0: sdhci: ============================================ [ 5222.332496] mmc0: Timeout waiting for hardware cmd interrupt. [ 5222.332507] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5222.332519] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5222.332529] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5222.332538] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5222.332548] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5222.332557] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5222.332567] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5222.332576] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5222.332585] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5222.332594] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5222.332603] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5222.332612] mmc0: sdhci: Cmd: 0x00000502 | Max curr: 0x00080008

[ 5222.332637] mmc0: sdhci: Host ctl2: 0x00000000 [ 5222.332647] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5222.332654] mmc0: sdhci: ============================================ [ 5262.653235] mmc0: Timeout waiting for hardware cmd interrupt. [ 5262.653245] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5262.653256] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5262.653264] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5262.653271] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5262.653279] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5262.653286] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5262.653294] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5262.653301] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5262.653308] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5262.653315] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5262.653322] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5262.653330] mmc0: sdhci: Cmd: 0x0000371a | Max curr: 0x00080008

[ 5262.653350] mmc0: sdhci: Host ctl2: 0x00000000 [ 5262.653357] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5262.653363] mmc0: sdhci: ============================================ [ 5279.933559] mmc0: Timeout waiting for hardware cmd interrupt. [ 5279.933565] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5279.933571] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5279.933575] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5279.933578] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5279.933582] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5279.933586] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5279.933590] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5279.933594] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5279.933597] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5279.933601] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5279.933605] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5279.933609] mmc0: sdhci: Cmd: 0x00000502 | Max curr: 0x00080008

[ 5279.933620] mmc0: sdhci: Host ctl2: 0x00000000 [ 5279.933623] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5279.933627] mmc0: sdhci: ============================================ [ 5290.173725] mmc0: Timeout waiting for hardware cmd interrupt. [ 5290.173731] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5290.173737] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5290.173741] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5290.173745] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5290.173749] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5290.173752] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5290.173756] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5290.173760] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5290.173763] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5290.173767] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5290.173771] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5290.173775] mmc0: sdhci: Cmd: 0x0000371a | Max curr: 0x00080008

[ 5290.173785] mmc0: sdhci: Host ctl2: 0x00000000 [ 5290.173788] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5290.173792] mmc0: sdhci: ============================================ [ 5300.413934] mmc0: Timeout waiting for hardware cmd interrupt. [ 5300.413940] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5300.413946] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5300.413950] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5300.413953] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5300.413957] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5300.413961] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5300.413965] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5300.413968] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5300.413972] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5300.413975] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5300.413979] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5300.413983] mmc0: sdhci: Cmd: 0x0000371a | Max curr: 0x00080008

[ 5300.413993] mmc0: sdhci: Host ctl2: 0x00000000 [ 5300.413997] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5300.414000] mmc0: sdhci: ============================================ [ 5311.934140] mmc0: Timeout waiting for hardware cmd interrupt. [ 5311.934146] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5311.934152] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5311.934156] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5311.934160] mmc0: sdhci: Argument: 0x80000c08 | Trn mode: 0x00000000 [ 5311.934164] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5311.934168] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5311.934172] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5311.934176] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5311.934179] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5311.934183] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5311.934187] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5311.934191] mmc0: sdhci: Cmd: 0x0000341a | Max curr: 0x00080008

[ 5311.934202] mmc0: sdhci: Host ctl2: 0x00000000 [ 5311.934206] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5311.934209] mmc0: sdhci: ============================================ [ 5322.184322] mmc0: Timeout waiting for hardware cmd interrupt. [ 5322.184329] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5322.184336] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5322.184341] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5322.184345] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5322.184349] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5322.184353] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5322.184357] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5322.184361] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5322.184364] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5322.184368] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5322.184372] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5322.184376] mmc0: sdhci: Cmd: 0x00000502 | Max curr: 0x00080008

[ 5322.184386] mmc0: sdhci: Host ctl2: 0x00000000 [ 5322.184390] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5322.184393] mmc0: sdhci: ============================================ [ 5332.414494] mmc0: Timeout waiting for hardware cmd interrupt. [ 5332.414501] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5332.414507] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5332.414511] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5332.414515] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5332.414519] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5332.414523] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5332.414527] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5332.414530] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5332.414534] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5332.414538] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5332.414541] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5332.414545] mmc0: sdhci: Cmd: 0x0000371a | Max curr: 0x00080008

[ 5332.414555] mmc0: sdhci: Host ctl2: 0x00000000 [ 5332.414559] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5332.414562] mmc0: sdhci: ============================================ [ 5342.654688] mmc0: Timeout waiting for hardware cmd interrupt. [ 5342.654693] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5342.654699] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5342.654703] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5342.654706] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5342.654710] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5342.654714] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5342.654718] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5342.654722] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5342.654726] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5342.654729] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5342.654733] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5342.654737] mmc0: sdhci: Cmd: 0x0000371a | Max curr: 0x00080008

[ 5342.654748] mmc0: sdhci: Host ctl2: 0x00000000 [ 5342.654751] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5342.654754] mmc0: sdhci: ============================================ [ 5354.174892] mmc0: Timeout waiting for hardware cmd interrupt. [ 5354.174904] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5354.174917] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5354.174927] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5354.174936] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5354.174945] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5354.174954] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5354.174963] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5354.174972] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5354.174982] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5354.174990] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5354.175000] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5354.175009] mmc0: sdhci: Cmd: 0x00000502 | Max curr: 0x00080008

[ 5354.175034] mmc0: sdhci: Host ctl2: 0x00000000 [ 5354.175044] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5354.175051] mmc0: sdhci: ============================================ [ 5390.655542] mmc0: Timeout waiting for hardware cmd interrupt. [ 5390.655553] mmc0: sdhci: ============ SDHCI REGISTER DUMP =========== [ 5390.655566] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00001002 [ 5390.655576] mmc0: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 5390.655585] mmc0: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 5390.655595] mmc0: sdhci: Present: 0x1fff0001 | Host ctl: 0x00000001 [ 5390.655605] mmc0: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 5390.655614] mmc0: sdhci: Wake-up: 0x00000000 | Clock: 0x0000f447 [ 5390.655623] mmc0: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 5390.655632] mmc0: sdhci: Int enab: 0x00ff1003 | Sig enab: 0x00ff1003 [ 5390.655641] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 5390.655651] mmc0: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525 [ 5390.655660] mmc0: sdhci: Cmd: 0x00000502 | Max curr: 0x00080008

[ 5390.655685] mmc0: sdhci: Host ctl2: 0x00000000 [ 5390.655694] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000 [ 5390.655701] mmc0: sdhci: ============================================ `

Without an SD card it's best to put dtparam=sd_poll_once in config.txt - that will prevent (or minimise) the errors

Without an SD card it's best to put dtparam=sd_poll_once in config.txt - that will prevent (or minimise) the errors

Thanks a lot :-), that fixed it.

Just got two of them as well, 10 minutes after boot on RPi 2 v1.1 (firmware #1343, kernel 5.4.68-v7+) with 10 seconds between them, but not leading to any issues as far as I can tell now. While other dmesg pastes here show different outputs, also related to non SD card being attached, my errors match pretty the OP ones (but without the final error -110) and happen with system on SD card:

``` [ 751.191823] mmc0: timeout waiting for hardware interrupt. [ 751.191867] [abd5cf13] FCM> b8f93c00 0 [ 751.191884] [abd5cf15] CMD d 0 [ 751.191901] [abd5cf16] REQ> b8f93c00 0 [ 751.191917] [abd5cf43] TSK< b8f93c00 0 [ 751.191934] [abd5cf5e] TSK> b8f93c00 0 [ 751.191950] [abd5cf81] PRD< b8f0ab90 0 [ 751.191966] [abd5cf86] PRD1 b95a3e40 0 [ 751.191982] [abd5cf90] PRD2 2 0 [ 751.191998] [abd5cfa8] PRD3 b71d6084 0 [ 751.192014] [abd5cfac] PDM> b8f0ab90 0 [ 751.192031] [abd5cfb1] REQ< b8f0aab0 10801 [ 751.192047] [abd5cfb2] CMD< 19 82000 [ 751.192064] [abd5cfb8] CMDD 10 200 [ 751.192081] [abd5cfb9] SDMA b8f0ab90 b95a3e40 [ 751.192098] [abd5cfbd] FCM< b8f0aab0 b8f0ab28 [ 751.192115] [abd5cfbe] RSP 900 0 [ 751.192131] [abd5cfbf] FCM> b8f0aab0 0 [ 751.192147] [abd5cfc0] CMD 19 200 [ 751.192164] [abd5cfc1] REQ> b8f0aab0 0 [ 751.192180] [2bd5d191] DMA< b8f0ab90 0 [ 751.192197] [2bd5d192] DMA 99 10801 [ 751.192213] [2bd5d195] FDA< b8f0aab0 0 [ 751.192229] [2bd5d196] TCM< b8f0ab90 0 [ 751.192246] [2bd5d198] CMD< c 0 [ 751.192262] [2bd5d19a] TCM> b8f0ab90 0 [ 751.192279] [2bd5d19b] FDA> b8f0aab0 b8f0ab5c [ 751.192294] [2bd5d19c] DMA> 0 0 [ 751.192310] [2bd5d9c2] IRQ< 400 0 [ 751.192327] [2bd5d9c4] IRQB b8f0ab5c 400 [ 751.192344] [2bd5d9c5] FCM< b8f0aab0 b8f0ab5c [ 751.192360] [2bd5d9c7] RSP c00 0 [ 751.192377] [2bd5d9c9] FCM> b8f0aab0 b8f0ab5c [ 751.192392] [2bd5d9cb] IRQ> 0 0 [ 751.192409] [2bd5d9d8] TSK< b8f0aab0 0 [ 751.192425] [2bd5da0a] TSK> b8f0aab0 0 [ 751.192442] [2bd5da4f] REQ< b8f4bdb8 10801 [ 751.192458] [2bd5da50] CMD< d 70000 [ 751.192475] [2bd5da57] FCM< b8f4bdb8 b8f4be20 [ 751.192492] [2bd5da59] RSP 900 0 [ 751.192508] [2bd5da6b] FCM> b8f4bdb8 0 [ 751.192523] [2bd5da6d] CMD d 0 [ 751.192540] [2bd5da6e] REQ> b8f4bdb8 0 [ 751.192556] [2bd5da9c] TSK< b8f4bdb8 0 [ 751.192572] [2bd5dab7] TSK> b8f4bdb8 0 [ 751.192589] [6bd5db4c] REQ< b8cf3dc8 10801 [ 751.192605] [6bd5db50] CMD< d 70000 [ 751.192622] [6bd5db58] FCM< b8cf3dc8 b8cf3e30 [ 751.192638] [6bd5db5a] RSP 900 0 [ 751.192655] [6bd5db6d] FCM> b8cf3dc8 0 [ 751.192670] [6bd5db6f] CMD d 0 [ 751.192687] [6bd5db6f] REQ> b8cf3dc8 0 [ 751.192703] [6bd5db9e] TSK< b8cf3dc8 0 [ 751.192719] [6bd5dbb9] TSK> b8cf3dc8 0 [ 751.192736] [6be59644] REQ< b8cf3dc8 10801 [ 751.192752] [6be59648] CMD< d 70000 [ 751.192769] [6be59651] FCM< b8cf3dc8 b8cf3e30 [ 751.192785] [6be59655] RSP 900 0 [ 751.192802] [6be59669] FCM> b8cf3dc8 0 [ 751.192818] [6be5966a] CMD d 0 [ 751.192834] [6be5966b] REQ> b8cf3dc8 0 [ 751.192850] [6be596a1] TSK< b8cf3dc8 0 [ 751.192866] [6be596c2] TSK> b8cf3dc8 0 [ 751.192883] [6bf574d1] REQ< b8cf3dc8 10801 [ 751.192900] [6bf574d4] CMD< d 70000 [ 751.192917] [6bf574df] FCM< b8cf3dc8 b8cf3e30 [ 751.192933] [6bf574e3] RSP 900 0 [ 751.192949] [6bf574f7] FCM> b8cf3dc8 0 [ 751.192965] [6bf574f9] CMD d 0 [ 751.192982] [6bf574fa] REQ> b8cf3dc8 0 [ 751.192998] [6bf57531] TSK< b8cf3dc8 0 [ 751.193014] [6bf57550] TSK> b8cf3dc8 0 [ 751.193031] [6c05534b] REQ< b8cf3dc8 10801 [ 751.193047] [6c05534e] CMD< d 70000 [ 751.193064] [6c055357] FCM< b8cf3dc8 b8cf3e30 [ 751.193081] [6c05535a] RSP 900 0 [ 751.193097] [6c05536e] FCM> b8cf3dc8 0 [ 751.193113] [6c05536f] CMD d 0 [ 751.193129] [6c055370] REQ> b8cf3dc8 0 [ 751.193145] [6c0553a3] TSK< b8cf3dc8 0 [ 751.193161] [6c0553c5] TSK> b8cf3dc8 0 [ 751.193178] [6c1531dc] REQ< b8cf3dc8 10801 [ 751.193195] [6c1531de] CMD< d 70000 [ 751.193212] [6c1531e6] FCM< b8cf3dc8 b8cf3e30 [ 751.193228] [6c1531e9] RSP 900 0 [ 751.193244] [6c153204] FCM> b8cf3dc8 0 [ 751.193260] [6c153206] CMD d 0 [ 751.193276] [6c153207] REQ> b8cf3dc8 0 [ 751.193292] [6c15323f] TSK< b8cf3dc8 0 [ 751.193309] [6c15325e] TSK> b8cf3dc8 0 [ 751.193325] [ac166df3] PRD< b8f0b790 0 [ 751.193341] [ac166df8] PRD1 b95a3e40 0 [ 751.193357] [ac166e08] PRD2 1 0 [ 751.193373] [ac166e24] PRD3 b71d6584 0 [ 751.193390] [ac166e29] PDM> b8f0b790 0 [ 751.193406] [ac166e2e] REQ< b8f0b6b0 10801 [ 751.193423] [ac166e30] CMD< 19 18cb968 [ 751.193439] [ac166e39] CMDD 8 200 [ 751.193456] [ac166e3c] SDMA b8f0b790 b95a3e40 [ 751.193472] [ac166e43] FCM< b8f0b6b0 b8f0b728 [ 751.193489] [ac166e45] RSP 900 0 [ 751.193505] [ac166e47] FCM> b8f0b6b0 0 [ 751.193521] [ac166e48] CMD 19 200 [ 751.193537] [ac166e49] REQ> b8f0b6b0 0 [ 751.193554] [2c166f6f] DMA< b8f0b790 0 [ 751.193570] [2c166f71] DMA 99 10801 [ 751.193587] [2c166f77] FDA< b8f0b6b0 0 [ 751.193603] [2c166f79] TCM< b8f0b790 0 [ 751.193619] [2c166f7c] CMD< c 0 [ 751.193635] [2c166f80] TCM> b8f0b790 0 [ 751.193652] [2c166f81] FDA> b8f0b6b0 b8f0b75c [ 751.193668] [2c166f82] DMA> 0 0 [ 751.193684] [2c1679b7] IRQ< 400 0 [ 751.193700] [2c1679b8] IRQB b8f0b75c 400 [ 751.193717] [2c1679b9] FCM< b8f0b6b0 b8f0b75c [ 751.193733] [2c1679bb] RSP c00 0 [ 751.193750] [2c1679bc] FCM> b8f0b6b0 b8f0b75c [ 751.193766] [2c1679bd] IRQ> 0 0 [ 751.193782] [2c1679c6] TSK< b8f0b6b0 0 [ 751.193799] [2c1679d5] TSK> b8f0b6b0 0 [ 751.193815] [ac167a04] REQ< b8f93c00 10801 [ 751.193831] [ac167a05] CMD< d 70000 [ 751.193849] [ac167a0a] FCM< b8f93c00 b8f93c68 [ 751.193865] [ac167a0c] RSP 900 0 [ 751.193881] [ac167a17] FCM> b8f93c00 0 [ 751.193897] [ac167a18] CMD d 0 [ 751.193913] [ac167a18] REQ> b8f93c00 0 [ 751.193929] [ac167a34] TSK< b8f93c00 0 [ 751.193945] [ac167a43] TSK> b8f93c00 0 [ 751.193962] [ac167a5b] PRD< b8f05190 0 [ 751.193978] [ac167a5d] PRD1 b95a3e40 0 [ 751.193994] [ac167a69] PRD2 5 0 [ 751.194010] [ac167a7f] PRD3 b71d6e04 0 [ 751.194026] [ac167a81] PDM> b8f05190 0 [ 751.194043] [ac167a83] REQ< b8f050b0 10801 [ 751.194060] [ac167a84] CMD< 19 182670 [ 751.194076] [ac167a87] CMDD 28 200 [ 751.194093] [ac167a88] SDMA b8f05190 b95a3e40 [ 751.194110] [ac167a8b] FCM< b8f050b0 b8f05128 [ 751.194126] [ac167a8c] RSP 900 0 [ 751.194142] [ac167a8c] FCM> b8f050b0 0 [ 751.194159] [ac167a8d] CMD 19 200 [ 751.194175] [ac167a8d] REQ> b8f050b0 0 [ 751.194191] [2c16bb31] DMA< b8f05190 0 [ 751.194208] [2c16bb31] DMA 99 10801 [ 751.194224] [2c16bb34] FDA< b8f050b0 0 [ 751.194240] [2c16bb35] TCM< b8f05190 0 [ 751.194256] [2c16bb36] CMD< c 0 [ 751.194272] [2c16bb39] TCM> b8f05190 0 [ 751.194289] [2c16bb3a] FDA> b8f050b0 b8f0515c [ 751.194305] [2c16bb3a] DMA> 0 0 [ 751.194321] [2c16e4cb] IRQ< 400 0 [ 751.194338] [2c16e4cc] IRQB b8f0515c 400 [ 751.194355] [2c16e4cc] FCM< b8f050b0 b8f0515c [ 751.194371] [2c16e4cd] RSP c00 0 [ 751.194387] [2c16e4cf] FCM> b8f050b0 b8f0515c [ 751.194403] [2c16e4cf] IRQ> 0 0 [ 751.194419] [2c16e4d7] TSK< b8f050b0 0 [ 751.194436] [2c16e4f4] TSK> b8f050b0 0 [ 751.194452] [2c16e517] REQ< b8f4bdb8 10801 [ 751.194469] [2c16e518] CMD< d 70000 [ 751.194486] [2c16e51b] FCM< b8f4bdb8 b8f4be20 [ 751.194502] [2c16e51e] RSP 900 0 [ 751.194518] [2c16e529] FCM> b8f4bdb8 0 [ 751.194534] [2c16e52a] CMD d 0 [ 751.194550] [2c16e52a] REQ> b8f4bdb8 0 [ 751.194566] [2c16e545] TSK< b8f4bdb8 0 [ 751.194583] [2c16e553] TSK> b8f4bdb8 0 [ 751.194599] [ec16e673] PRD< b8f05390 0 [ 751.194615] [ec16e676] PRD1 b95a3e40 0 [ 751.194631] [ec16e67e] PRD2 1 0 [ 751.194647] [ec16e68c] PRD3 b700ed04 0 [ 751.194664] [ec16e68f] PDM> b8f05390 0 [ 751.194680] [ec16e691] REQ< b8f052b0 10801 [ 751.194697] [ec16e692] CMD< 19 182698 [ 751.194714] [ec16e697] CMDD 8 200 [ 751.194730] [ec16e698] SDMA b8f05390 b95a3e40 [ 751.194747] [ec16e69a] FCM< b8f052b0 b8f05328 [ 751.194763] [ec16e69b] RSP 900 0 [ 751.194779] [ec16e69c] FCM> b8f052b0 0 [ 751.194796] [ec16e69d] CMD 19 200 [ 751.194812] [ec16e69d] REQ> b8f052b0 0 [ 751.194828] [2c16e782] DMA< b8f05390 0 [ 751.194845] [2c16e783] DMA 99 10801 [ 751.194861] [2c16e784] FDA< b8f052b0 0 [ 751.194877] [2c16e785] TCM< b8f05390 0 [ 751.194893] [2c16e786] CMD< c 0 [ 751.194910] [2c16e788] TCM> b8f05390 0 [ 751.194926] [2c16e788] FDA> b8f052b0 b8f0535c [ 751.194942] [2c16e789] DMA> 0 0 [ 751.194958] [2c16f00c] IRQ< 400 0 [ 751.194975] [2c16f00d] IRQB b8f0535c 400 [ 751.194992] [2c16f00d] FCM< b8f052b0 b8f0535c [ 751.195008] [2c16f00f] RSP c00 0 [ 751.195025] [2c16f011] FCM> b8f052b0 b8f0535c [ 751.195040] [2c16f012] IRQ> 0 0 [ 751.195057] [2c16f01c] TSK< b8f052b0 0 [ 751.195073] [2c16f03e] TSK> b8f052b0 0 [ 751.195090] [2c16f06e] REQ< b8f4bdb8 10801 [ 751.195106] [2c16f06f] CMD< d 70000 [ 751.195123] [2c16f074] FCM< b8f4bdb8 b8f4be20 [ 751.195139] [2c16f077] RSP 900 0 [ 751.195155] [2c16f086] FCM> b8f4bdb8 0 [ 751.195171] [2c16f087] CMD d 0 [ 751.195187] [2c16f088] REQ> b8f4bdb8 0 [ 751.195204] [2c16f0ad] TSK< b8f4bdb8 0 [ 751.195220] [2c16f0c2] TSK> b8f4bdb8 0 [ 751.195237] [6c25103c] REQ< b8cf3dc8 10801 [ 751.195253] [6c25103f] CMD< d 70000 [ 751.195270] [6c251049] FCM< b8cf3dc8 b8cf3e30 [ 751.195286] [6c25104c] RSP 900 0 [ 751.195302] [6c251060] FCM> b8cf3dc8 0 [ 751.195318] [6c251061] CMD d 0 [ 751.195334] [6c251062] REQ> b8cf3dc8 0 [ 751.195351] [6c251096] TSK< b8cf3dc8 0 [ 751.195367] [6c2510b7] TSK> b8cf3dc8 0 [ 751.195384] [6c34eec6] REQ< b8cf3dc8 10801 [ 751.195400] [6c34eec8] CMD< d 70000 [ 751.195417] [6c34eecf] FCM< b8cf3dc8 b8cf3e30 [ 751.195433] [6c34eed2] RSP 900 0 [ 751.195449] [6c34eee6] FCM> b8cf3dc8 0 [ 751.195465] [6c34eee7] CMD d 0 [ 751.195482] [6c34eee8] REQ> b8cf3dc8 0 [ 751.195498] [6c34ef1c] TSK< b8cf3dc8 0 [ 751.195514] [6c34ef3c] TSK> b8cf3dc8 0 [ 751.195531] [6c44cd5c] REQ< b8cf3dc8 10801 [ 751.195547] [6c44cd5f] CMD< d 70000 [ 751.195564] [6c44cd6d] FCM< b8cf3dc8 b8cf3e30 [ 751.195581] [6c44cd70] RSP 900 0 [ 751.195597] [6c44cd85] FCM> b8cf3dc8 0 [ 751.195613] [6c44cd86] CMD d 0 [ 751.195629] [6c44cd88] REQ> b8cf3dc8 0 [ 751.195645] [6c44cdc2] TSK< b8cf3dc8 0 [ 751.195661] [6c44cde7] TSK> b8cf3dc8 0 [ 751.195678] [6c54abe2] REQ< b8cf3dc8 10801 [ 751.195695] [6c54abe6] CMD< d 70000 [ 751.195712] [6c54abf0] FCM< b8cf3dc8 b8cf3e30 [ 751.195728] [6c54abf4] RSP 900 0 [ 751.195744] [6c54ac0a] FCM> b8cf3dc8 0 [ 751.195760] [6c54ac0b] CMD d 0 [ 751.195776] [6c54ac0c] REQ> b8cf3dc8 0 [ 751.195792] [6c54ac45] TSK< b8cf3dc8 0 [ 751.195808] [6c54ac64] TSK> b8cf3dc8 0 [ 751.195825] [ec6354ed] REQ< b8f054b0 10801 [ 751.195842] [ec6354f0] CMD< 18 2037 [ 751.195859] [ec6354fb] CMDD 1 200 [ 751.195875] [ec6354fe] FCM< b8f054b0 b8f05528 [ 751.195891] [ec635502] RSP 900 0 [ 751.195908] [ec635504] FCM> b8f054b0 0 [ 751.195924] [ec635505] CMD 18 200 [ 751.195940] [ec635506] REQ> b8f054b0 0 [ 751.195956] [2c635512] IRQ< 1 0 [ 751.195972] [2c635515] IRQD b8f05590 1 [ 751.195989] [2c635518] XFP< b8f05590 1 [ 751.196005] [2c635538] XFP> b8f05590 1 [ 751.196021] [2c635539] IRQ> 1 0 [ 751.196036] [ed00c9be] TIM< 0 0 [ 751.196070] mmc0: cmd op 24 arg 0x2037 flags 0xb5 - resp 00000900 00000000 00000000 00000000, err 0 [ 751.196086] mmc0: data blocks 1 blksz 200 - err 0 [ 751.196099] mmc0: =========== REGISTER DUMP =========== [ 751.196111] mmc0: SDCMD 0x00004098 [ 751.196124] mmc0: SDARG 0x00002037 [ 751.196137] mmc0: SDTOUT 0x017d7840 [ 751.196149] mmc0: SDCDIV 0x00000003 [ 751.196161] mmc0: SDRSP0 0x00000900 [ 751.196174] mmc0: SDRSP1 0x0000182e [ 751.196186] mmc0: SDRSP2 0xffffffff [ 751.196199] mmc0: SDRSP3 0x0002400f [ 751.196211] mmc0: SDHSTS 0x00000081 [ 751.196223] mmc0: SDVDD 0x00000001 [ 751.196235] mmc0: SDEDM 0x00010801 [ 751.196248] mmc0: SDHCFG 0x0000050e [ 751.196260] mmc0: SDHBCT 0x00000200 [ 751.196272] mmc0: SDHBLC 0x00000001 [ 751.196283] mmc0: =========================================== [ 761.431820] mmc0: timeout waiting for hardware interrupt. [ 761.431864] [6be596c2] TSK> b8cf3dc8 0 [ 761.431882] [6bf574d1] REQ< b8cf3dc8 10801 [ 761.431899] [6bf574d4] CMD< d 70000 [ 761.431916] [6bf574df] FCM< b8cf3dc8 b8cf3e30 [ 761.431933] [6bf574e3] RSP 900 0 [ 761.431949] [6bf574f7] FCM> b8cf3dc8 0 [ 761.431965] [6bf574f9] CMD d 0 [ 761.431982] [6bf574fa] REQ> b8cf3dc8 0 [ 761.431998] [6bf57531] TSK< b8cf3dc8 0 [ 761.432014] [6bf57550] TSK> b8cf3dc8 0 [ 761.432031] [6c05534b] REQ< b8cf3dc8 10801 [ 761.432047] [6c05534e] CMD< d 70000 [ 761.432064] [6c055357] FCM< b8cf3dc8 b8cf3e30 [ 761.432080] [6c05535a] RSP 900 0 [ 761.432097] [6c05536e] FCM> b8cf3dc8 0 [ 761.432113] [6c05536f] CMD d 0 [ 761.432129] [6c055370] REQ> b8cf3dc8 0 [ 761.432145] [6c0553a3] TSK< b8cf3dc8 0 [ 761.432161] [6c0553c5] TSK> b8cf3dc8 0 [ 761.432178] [6c1531dc] REQ< b8cf3dc8 10801 [ 761.432194] [6c1531de] CMD< d 70000 [ 761.432211] [6c1531e6] FCM< b8cf3dc8 b8cf3e30 [ 761.432227] [6c1531e9] RSP 900 0 [ 761.432244] [6c153204] FCM> b8cf3dc8 0 [ 761.432260] [6c153206] CMD d 0 [ 761.432276] [6c153207] REQ> b8cf3dc8 0 [ 761.432292] [6c15323f] TSK< b8cf3dc8 0 [ 761.432308] [6c15325e] TSK> b8cf3dc8 0 [ 761.432324] [ac166df3] PRD< b8f0b790 0 [ 761.432341] [ac166df8] PRD1 b95a3e40 0 [ 761.432356] [ac166e08] PRD2 1 0 [ 761.432373] [ac166e24] PRD3 b71d6584 0 [ 761.432389] [ac166e29] PDM> b8f0b790 0 [ 761.432406] [ac166e2e] REQ< b8f0b6b0 10801 [ 761.432423] [ac166e30] CMD< 19 18cb968 [ 761.432439] [ac166e39] CMDD 8 200 [ 761.432456] [ac166e3c] SDMA b8f0b790 b95a3e40 [ 761.432472] [ac166e43] FCM< b8f0b6b0 b8f0b728 [ 761.432489] [ac166e45] RSP 900 0 [ 761.432505] [ac166e47] FCM> b8f0b6b0 0 [ 761.432521] [ac166e48] CMD 19 200 [ 761.432537] [ac166e49] REQ> b8f0b6b0 0 [ 761.432554] [2c166f6f] DMA< b8f0b790 0 [ 761.432570] [2c166f71] DMA 99 10801 [ 761.432587] [2c166f77] FDA< b8f0b6b0 0 [ 761.432603] [2c166f79] TCM< b8f0b790 0 [ 761.432619] [2c166f7c] CMD< c 0 [ 761.432636] [2c166f80] TCM> b8f0b790 0 [ 761.432652] [2c166f81] FDA> b8f0b6b0 b8f0b75c [ 761.432668] [2c166f82] DMA> 0 0 [ 761.432684] [2c1679b7] IRQ< 400 0 [ 761.432701] [2c1679b8] IRQB b8f0b75c 400 [ 761.432718] [2c1679b9] FCM< b8f0b6b0 b8f0b75c [ 761.432734] [2c1679bb] RSP c00 0 [ 761.432750] [2c1679bc] FCM> b8f0b6b0 b8f0b75c [ 761.432766] [2c1679bd] IRQ> 0 0 [ 761.432783] [2c1679c6] TSK< b8f0b6b0 0 [ 761.432799] [2c1679d5] TSK> b8f0b6b0 0 [ 761.432816] [ac167a04] REQ< b8f93c00 10801 [ 761.432832] [ac167a05] CMD< d 70000 [ 761.432849] [ac167a0a] FCM< b8f93c00 b8f93c68 [ 761.432866] [ac167a0c] RSP 900 0 [ 761.432882] [ac167a17] FCM> b8f93c00 0 [ 761.432898] [ac167a18] CMD d 0 [ 761.432914] [ac167a18] REQ> b8f93c00 0 [ 761.432930] [ac167a34] TSK< b8f93c00 0 [ 761.432946] [ac167a43] TSK> b8f93c00 0 [ 761.432963] [ac167a5b] PRD< b8f05190 0 [ 761.432979] [ac167a5d] PRD1 b95a3e40 0 [ 761.432995] [ac167a69] PRD2 5 0 [ 761.433011] [ac167a7f] PRD3 b71d6e04 0 [ 761.433027] [ac167a81] PDM> b8f05190 0 [ 761.433044] [ac167a83] REQ< b8f050b0 10801 [ 761.433060] [ac167a84] CMD< 19 182670 [ 761.433077] [ac167a87] CMDD 28 200 [ 761.433094] [ac167a88] SDMA b8f05190 b95a3e40 [ 761.433111] [ac167a8b] FCM< b8f050b0 b8f05128 [ 761.433127] [ac167a8c] RSP 900 0 [ 761.433143] [ac167a8c] FCM> b8f050b0 0 [ 761.433159] [ac167a8d] CMD 19 200 [ 761.433175] [ac167a8d] REQ> b8f050b0 0 [ 761.433192] [2c16bb31] DMA< b8f05190 0 [ 761.433208] [2c16bb31] DMA 99 10801 [ 761.433225] [2c16bb34] FDA< b8f050b0 0 [ 761.433241] [2c16bb35] TCM< b8f05190 0 [ 761.433257] [2c16bb36] CMD< c 0 [ 761.433273] [2c16bb39] TCM> b8f05190 0 [ 761.433289] [2c16bb3a] FDA> b8f050b0 b8f0515c [ 761.433305] [2c16bb3a] DMA> 0 0 [ 761.433321] [2c16e4cb] IRQ< 400 0 [ 761.433338] [2c16e4cc] IRQB b8f0515c 400 [ 761.433355] [2c16e4cc] FCM< b8f050b0 b8f0515c [ 761.433371] [2c16e4cd] RSP c00 0 [ 761.433388] [2c16e4cf] FCM> b8f050b0 b8f0515c [ 761.433403] [2c16e4cf] IRQ> 0 0 [ 761.433420] [2c16e4d7] TSK< b8f050b0 0 [ 761.433436] [2c16e4f4] TSK> b8f050b0 0 [ 761.433453] [2c16e517] REQ< b8f4bdb8 10801 [ 761.433469] [2c16e518] CMD< d 70000 [ 761.433486] [2c16e51b] FCM< b8f4bdb8 b8f4be20 [ 761.433502] [2c16e51e] RSP 900 0 [ 761.433518] [2c16e529] FCM> b8f4bdb8 0 [ 761.433534] [2c16e52a] CMD d 0 [ 761.433550] [2c16e52a] REQ> b8f4bdb8 0 [ 761.433566] [2c16e545] TSK< b8f4bdb8 0 [ 761.433583] [2c16e553] TSK> b8f4bdb8 0 [ 761.433599] [ec16e673] PRD< b8f05390 0 [ 761.433615] [ec16e676] PRD1 b95a3e40 0 [ 761.433631] [ec16e67e] PRD2 1 0 [ 761.433647] [ec16e68c] PRD3 b700ed04 0 [ 761.433663] [ec16e68f] PDM> b8f05390 0 [ 761.433680] [ec16e691] REQ< b8f052b0 10801 [ 761.433697] [ec16e692] CMD< 19 182698 [ 761.433713] [ec16e697] CMDD 8 200 [ 761.433730] [ec16e698] SDMA b8f05390 b95a3e40 [ 761.433747] [ec16e69a] FCM< b8f052b0 b8f05328 [ 761.433763] [ec16e69b] RSP 900 0 [ 761.433779] [ec16e69c] FCM> b8f052b0 0 [ 761.433795] [ec16e69d] CMD 19 200 [ 761.433811] [ec16e69d] REQ> b8f052b0 0 [ 761.433828] [2c16e782] DMA< b8f05390 0 [ 761.433844] [2c16e783] DMA 99 10801 [ 761.433861] [2c16e784] FDA< b8f052b0 0 [ 761.433877] [2c16e785] TCM< b8f05390 0 [ 761.433893] [2c16e786] CMD< c 0 [ 761.433909] [2c16e788] TCM> b8f05390 0 [ 761.433926] [2c16e788] FDA> b8f052b0 b8f0535c [ 761.433942] [2c16e789] DMA> 0 0 [ 761.433958] [2c16f00c] IRQ< 400 0 [ 761.433975] [2c16f00d] IRQB b8f0535c 400 [ 761.433991] [2c16f00d] FCM< b8f052b0 b8f0535c [ 761.434008] [2c16f00f] RSP c00 0 [ 761.434024] [2c16f011] FCM> b8f052b0 b8f0535c [ 761.434040] [2c16f012] IRQ> 0 0 [ 761.434056] [2c16f01c] TSK< b8f052b0 0 [ 761.434073] [2c16f03e] TSK> b8f052b0 0 [ 761.434089] [2c16f06e] REQ< b8f4bdb8 10801 [ 761.434105] [2c16f06f] CMD< d 70000 [ 761.434122] [2c16f074] FCM< b8f4bdb8 b8f4be20 [ 761.434138] [2c16f077] RSP 900 0 [ 761.434155] [2c16f086] FCM> b8f4bdb8 0 [ 761.434171] [2c16f087] CMD d 0 [ 761.434187] [2c16f088] REQ> b8f4bdb8 0 [ 761.434203] [2c16f0ad] TSK< b8f4bdb8 0 [ 761.434219] [2c16f0c2] TSK> b8f4bdb8 0 [ 761.434236] [6c25103c] REQ< b8cf3dc8 10801 [ 761.434252] [6c25103f] CMD< d 70000 [ 761.434270] [6c251049] FCM< b8cf3dc8 b8cf3e30 [ 761.434286] [6c25104c] RSP 900 0 [ 761.434302] [6c251060] FCM> b8cf3dc8 0 [ 761.434318] [6c251061] CMD d 0 [ 761.434334] [6c251062] REQ> b8cf3dc8 0 [ 761.434350] [6c251096] TSK< b8cf3dc8 0 [ 761.434366] [6c2510b7] TSK> b8cf3dc8 0 [ 761.434383] [6c34eec6] REQ< b8cf3dc8 10801 [ 761.434400] [6c34eec8] CMD< d 70000 [ 761.434417] [6c34eecf] FCM< b8cf3dc8 b8cf3e30 [ 761.434433] [6c34eed2] RSP 900 0 [ 761.434449] [6c34eee6] FCM> b8cf3dc8 0 [ 761.434465] [6c34eee7] CMD d 0 [ 761.434481] [6c34eee8] REQ> b8cf3dc8 0 [ 761.434497] [6c34ef1c] TSK< b8cf3dc8 0 [ 761.434514] [6c34ef3c] TSK> b8cf3dc8 0 [ 761.434530] [6c44cd5c] REQ< b8cf3dc8 10801 [ 761.434547] [6c44cd5f] CMD< d 70000 [ 761.434564] [6c44cd6d] FCM< b8cf3dc8 b8cf3e30 [ 761.434580] [6c44cd70] RSP 900 0 [ 761.434596] [6c44cd85] FCM> b8cf3dc8 0 [ 761.434612] [6c44cd86] CMD d 0 [ 761.434628] [6c44cd88] REQ> b8cf3dc8 0 [ 761.434645] [6c44cdc2] TSK< b8cf3dc8 0 [ 761.434661] [6c44cde7] TSK> b8cf3dc8 0 [ 761.434678] [6c54abe2] REQ< b8cf3dc8 10801 [ 761.434694] [6c54abe6] CMD< d 70000 [ 761.434711] [6c54abf0] FCM< b8cf3dc8 b8cf3e30 [ 761.434727] [6c54abf4] RSP 900 0 [ 761.434743] [6c54ac0a] FCM> b8cf3dc8 0 [ 761.434759] [6c54ac0b] CMD d 0 [ 761.434776] [6c54ac0c] REQ> b8cf3dc8 0 [ 761.434792] [6c54ac45] TSK< b8cf3dc8 0 [ 761.434808] [6c54ac64] TSK> b8cf3dc8 0 [ 761.434825] [ec6354ed] REQ< b8f054b0 10801 [ 761.434841] [ec6354f0] CMD< 18 2037 [ 761.434858] [ec6354fb] CMDD 1 200 [ 761.434875] [ec6354fe] FCM< b8f054b0 b8f05528 [ 761.434891] [ec635502] RSP 900 0 [ 761.434907] [ec635504] FCM> b8f054b0 0 [ 761.434923] [ec635505] CMD 18 200 [ 761.434939] [ec635506] REQ> b8f054b0 0 [ 761.434955] [2c635512] IRQ< 1 0 [ 761.434971] [2c635515] IRQD b8f05590 1 [ 761.434988] [2c635518] XFP< b8f05590 1 [ 761.435004] [2c635538] XFP> b8f05590 1 [ 761.435020] [2c635539] IRQ> 1 0 [ 761.435035] [ed00c9be] TIM< 0 0 [ 761.435051] [ed00db4a] FDA< b8f054b0 0 [ 761.435068] [ed00db4c] TCM< b8f05590 ffffff92 [ 761.435085] [ed00db4e] WTC< 10801 0 [ 761.435101] [ed00db50] WTC> 10801 0 [ 761.435117] [ed00db53] TCM> b8f05590 0 [ 761.435133] [ed00db54] FDA> b8f054b0 0 [ 761.435150] [ed00dbc5] TSK< b8f054b0 0 [ 761.435166] [ed00dbf4] TSK> b8f054b0 0 [ 761.435183] [ed00dc49] REQ< b957bbf0 10801 [ 761.435199] [ed00dc4d] CMD< d 70000 [ 761.435216] [ed00dc57] FCM< b957bbf0 b957bc58 [ 761.435233] [ed00dc5c] RSP 900 0 [ 761.435249] [ed00dc72] FCM> b957bbf0 0 [ 761.435265] [ed00dc74] CMD d 0 [ 761.435281] [ed00dc75] REQ> b957bbf0 0 [ 761.435297] [ed00dcab] TSK< b957bbf0 0 [ 761.435313] [ed00dcc9] TSK> b957bbf0 0 [ 761.435330] [ed00dcf5] REQ< b957bb50 10801 [ 761.435347] [ed00dcf7] CMD< 37 70000 [ 761.435364] [ed00dcfc] FCM< b957bb50 b957bbcc [ 761.435380] [ed00dcff] RSP 920 0 [ 761.435396] [ed00dd01] FCM> b957bb50 0 [ 761.435412] [ed00dd02] CMD 37 0 [ 761.435429] [ed00dd03] REQ> b957bb50 0 [ 761.435445] [ed00dd2f] TSK< b957bb50 0 [ 761.435461] [ed00dd4a] TSK> b957bb50 0 [ 761.435478] [ed00dd75] REQ< b957bc38 10801 [ 761.435494] [ed00dd77] CMD< 16 0 [ 761.435510] [ed00dd7f] CMDD 1 4 [ 761.435527] [ed00dd82] FCM< b957bc38 b957bbcc [ 761.435543] [ed00dd84] RSP 920 0 [ 761.435559] [ed00dd85] FCM> b957bc38 0 [ 761.435575] [ed00dd86] CMD 16 4 [ 761.435592] [ed00dd87] REQ> b957bc38 0 [ 761.435608] [2d00dd8d] IRQ< 1 0 [ 761.435624] [2d00dd8f] IRQD b957bc00 1 [ 761.435640] [2d00dd91] XFP< b957bc00 1 [ 761.435656] [2d00ded1] XFP> b957bc00 1 [ 761.435673] [2d00ded3] FDA< b957bc38 0 [ 761.435689] [2d00ded5] TCM< b957bc00 0 [ 761.435705] [2d00ded6] WTC< 10801 0 [ 761.435721] [2d00ded7] WTC> 10801 0 [ 761.435738] [2d00dedb] TCM> b957bc00 0 [ 761.435754] [2d00dedc] FDA> b957bc38 0 [ 761.435770] [2d00dede] IRQ> 1 0 [ 761.435787] [2d00deed] TSK< b957bc38 0 [ 761.435803] [2d00df06] TSK> b957bc38 0 [ 761.435820] [ed00df63] REQ< b8f056b0 10801 [ 761.435836] [ed00df65] CMD< 18 2ff8 [ 761.435853] [ed00df6e] CMDD 1 200 [ 761.435870] [ed00df70] FCM< b8f056b0 b8f05728 [ 761.435886] [ed00df73] RSP 900 0 [ 761.435902] [ed00df75] FCM> b8f056b0 0 [ 761.435918] [ed00df76] CMD 18 200 [ 761.435934] [ed00df77] REQ> b8f056b0 0 [ 761.435950] [2d00df7a] IRQ< 1 0 [ 761.435966] [2d00df7b] IRQD b8f05790 1 [ 761.435983] [2d00df7d] XFP< b8f05790 1 [ 761.435999] [2d00df99] XFP> b8f05790 1 [ 761.436015] [2d00df9a] IRQ> 1 0 [ 761.436030] [ed9d09d6] TIM< 0 0 [ 761.436063] mmc0: cmd op 24 arg 0x2ff8 flags 0xb5 - resp 00000900 00000000 00000000 00000000, err 0 [ 761.436080] mmc0: data blocks 1 blksz 200 - err 0 [ 761.436092] mmc0: =========== REGISTER DUMP =========== [ 761.436105] mmc0: SDCMD 0x00004098 [ 761.436118] mmc0: SDARG 0x00002ff8 [ 761.436130] mmc0: SDTOUT 0x017d7840 [ 761.436142] mmc0: SDCDIV 0x00000003 [ 761.436155] mmc0: SDRSP0 0x00000900 [ 761.436167] mmc0: SDRSP1 0x0000182e [ 761.436179] mmc0: SDRSP2 0x7fffffff [ 761.436192] mmc0: SDRSP3 0x00024805 [ 761.436204] mmc0: SDHSTS 0x00000081 [ 761.436216] mmc0: SDVDD 0x00000001 [ 761.436229] mmc0: SDEDM 0x00010801 [ 761.436241] mmc0: SDHCFG 0x0000050e [ 761.436253] mmc0: SDHBCT 0x00000200 [ 761.436265] mmc0: SDHBLC 0x00000001 [ 761.436276] mmc0: =========================================== ```

Got them again, after longer uptime:

``` [241550.240729] mmc0: timeout waiting for hardware interrupt. [241550.240770] [3cb97fea] TCM> b8f03790 0 [241550.240787] [3cb97fea] FDA> b8f036b0 0 [241550.240803] [3cb97feb] DMA> 0 0 [241550.240820] [3cb97ffe] TSK< b8f036b0 0 [241550.240836] [3cb98018] TSK> b8f036b0 0 [241550.240852] [7cb9825b] PRD< b8f03990 0 [241550.240868] [7cb9825e] PRD1 b95a3e40 0 [241550.240884] [7cb98283] PRD2 1c 0 [241550.240901] [7cb982d4] PRD3 b7e9a404 0 [241550.240917] [7cb982d6] PDM> b8f03990 0 [241550.240934] [7cb982d9] REQ< b8f038b0 10801 [241550.240950] [7cb982da] CMD< 17 e0 [241550.240968] [7cb982dd] FCM< b8f038b0 b8f038f4 [241550.240984] [7cb982df] RSP 900 0 [241550.241001] [7cb982df] CMD< 12 31a020 [241550.241017] [7cb982e1] CMDD e0 200 [241550.241034] [7cb982e1] SDMA b8f03990 b95a3e40 [241550.241051] [7cb982e3] FCM< b8f038b0 b8f03928 [241550.241067] [7cb982e4] RSP 900 0 [241550.241083] [7cb982e5] FCM> b8f038b0 0 [241550.241100] [7cb982e5] FCM> b8f038b0 0 [241550.241116] [7cb982e6] CMD 12 200 [241550.241132] [7cb982e6] REQ> b8f038b0 0 [241550.241149] [3cb99017] DMA< b8f03990 1 [241550.241165] [3cb99018] DMA 52 10834 [241550.241181] [3cb9903f] FDA< b8f038b0 0 [241550.241198] [3cb99040] TCM< b8f03990 0 [241550.241214] [3cb99041] WTC< 10804 0 [241550.241230] [3cb99042] WTC> 10804 0 [241550.241247] [3cb99043] TCM> b8f03990 0 [241550.241263] [3cb99043] FDA> b8f038b0 0 [241550.241279] [3cb99044] DMA> 0 0 [241550.241295] [3cb99088] TSK< b8f038b0 0 [241550.241312] [3cb990a2] TSK> b8f038b0 0 [241550.241328] [7cb99236] PRD< b8f03b90 0 [241550.241344] [7cb99238] PRD1 b95a3e40 0 [241550.241360] [7cb99248] PRD2 a 0 [241550.241376] [7cb9926c] PRD3 b734c784 0 [241550.241392] [7cb9926e] PDM> b8f03b90 0 [241550.241409] [7cb99270] REQ< b8f03ab0 10801 [241550.241425] [7cb99271] CMD< 17 50 [241550.241442] [7cb99275] FCM< b8f03ab0 b8f03af4 [241550.241459] [7cb99276] RSP 900 0 [241550.241475] [7cb99277] CMD< 12 31a100 [241550.241491] [7cb99279] CMDD 50 200 [241550.241508] [7cb99279] SDMA b8f03b90 b95a3e40 [241550.241525] [7cb9927b] FCM< b8f03ab0 b8f03b28 [241550.241541] [7cb9927c] RSP 900 0 [241550.241557] [7cb9927d] FCM> b8f03ab0 0 [241550.241574] [7cb9927d] FCM> b8f03ab0 0 [241550.241590] [7cb9927e] CMD 12 200 [241550.241606] [7cb9927e] REQ> b8f03ab0 0 [241550.241623] [3cb998ca] DMA< b8f03b90 1 [241550.241639] [3cb998cc] DMA 52 10834 [241550.241655] [3cb998df] FDA< b8f03ab0 0 [241550.241672] [3cb998e0] TCM< b8f03b90 0 [241550.241688] [3cb998e1] WTC< 10804 0 [241550.241704] [3cb998e2] WTC> 10804 0 [241550.241720] [3cb998e4] TCM> b8f03b90 0 [241550.241737] [3cb998e4] FDA> b8f03ab0 0 [241550.241753] [3cb998e5] DMA> 0 0 [241550.241769] [3cb99906] TSK< b8f03ab0 0 [241550.241785] [3cb9992c] TSK> b8f03ab0 0 [241550.241801] [7cb99ec3] PRD< b8f03d90 0 [241550.241818] [7cb99ec5] PRD1 b95a3e40 0 [241550.241833] [7cb99ecb] PRD2 1 0 [241550.241849] [7cb99eda] PRD3 84e6e904 0 [241550.241866] [7cb99edc] PDM> b8f03d90 0 [241550.241882] [7cb99edf] REQ< b8f03cb0 10801 [241550.241899] [7cb99ee0] CMD< 17 8 [241550.241915] [7cb99ee6] FCM< b8f03cb0 b8f03cf4 [241550.241932] [7cb99ee8] RSP 900 0 [241550.241948] [7cb99eea] CMD< 12 f55d8 [241550.241964] [7cb99eeb] CMDD 8 200 [241550.241981] [7cb99eec] SDMA b8f03d90 b95a3e40 [241550.241998] [7cb99eef] FCM< b8f03cb0 b8f03d28 [241550.242014] [7cb99ef0] RSP 900 0 [241550.242030] [7cb99ef1] FCM> b8f03cb0 0 [241550.242047] [7cb99ef2] FCM> b8f03cb0 0 [241550.242063] [7cb99ef2] CMD 12 200 [241550.242079] [7cb99ef3] REQ> b8f03cb0 0 [241550.242096] [3cb9a03e] DMA< b8f03d90 1 [241550.242112] [3cb9a03e] DMA 52 10834 [241550.242128] [3cb9a044] FDA< b8f03cb0 0 [241550.242145] [3cb9a045] TCM< b8f03d90 0 [241550.242161] [3cb9a046] WTC< 10804 0 [241550.242177] [3cb9a047] WTC> 10804 0 [241550.242193] [3cb9a048] TCM> b8f03d90 0 [241550.242210] [3cb9a049] FDA> b8f03cb0 0 [241550.242226] [3cb9a049] DMA> 0 0 [241550.242242] [3cb9a058] TSK< b8f03cb0 0 [241550.242258] [3cb9a07b] TSK> b8f03cb0 0 [241550.242275] [7cc07447] REQ< 98017dc8 10801 [241550.242291] [7cc0744b] CMD< d 70000 [241550.242308] [7cc07455] FCM< 98017dc8 98017e30 [241550.242324] [7cc07458] RSP 900 0 [241550.242340] [7cc0746d] FCM> 98017dc8 0 [241550.242356] [7cc0746e] CMD d 0 [241550.242373] [7cc0746f] REQ> 98017dc8 0 [241550.242389] [7cc074b5] TSK< 98017dc8 0 [241550.242405] [7cc074d6] TSK> 98017dc8 0 [241550.242422] [7cd05437] REQ< 81583dc8 10801 [241550.242438] [7cd0543a] CMD< d 70000 [241550.242455] [7cd05447] FCM< 81583dc8 81583e30 [241550.242471] [7cd0544b] RSP 900 0 [241550.242487] [7cd05461] FCM> 81583dc8 0 [241550.242503] [7cd05463] CMD d 0 [241550.242519] [7cd05464] REQ> 81583dc8 0 [241550.242536] [7cd054a7] TSK< 81583dc8 0 [241550.242552] [7cd054c8] TSK> 81583dc8 0 [241550.242569] [7ce03408] REQ< 81583dc8 10801 [241550.242585] [7ce0340b] CMD< d 70000 [241550.242602] [7ce03417] FCM< 81583dc8 81583e30 [241550.242618] [7ce03419] RSP 900 0 [241550.242634] [7ce0342e] FCM> 81583dc8 0 [241550.242650] [7ce03430] CMD d 0 [241550.242666] [7ce03431] REQ> 81583dc8 0 [241550.242682] [7ce034ef] TSK< 81583dc8 0 [241550.242699] [7ce03517] TSK> 81583dc8 0 [241550.242715] [7cf013ef] REQ< 98017dc8 10801 [241550.242732] [7cf013f3] CMD< d 70000 [241550.242749] [7cf013fb] FCM< 98017dc8 98017e30 [241550.242765] [7cf013fe] RSP 900 0 [241550.242781] [7cf01414] FCM> 98017dc8 0 [241550.242797] [7cf01415] CMD d 0 [241550.242813] [7cf01416] REQ> 98017dc8 0 [241550.242829] [7cf0144a] TSK< 98017dc8 0 [241550.242845] [7cf01468] TSK> 98017dc8 0 [241550.242862] [7cfff3d1] REQ< 98017dc8 10801 [241550.242879] [7cfff3d4] CMD< d 70000 [241550.242896] [7cfff3dc] FCM< 98017dc8 98017e30 [241550.242912] [7cfff3dd] RSP 900 0 [241550.242928] [7cfff3f0] FCM> 98017dc8 0 [241550.242944] [7cfff3f1] CMD d 0 [241550.242960] [7cfff3f2] REQ> 98017dc8 0 [241550.242976] [7cfff434] TSK< 98017dc8 0 [241550.242993] [7cfff452] TSK> 98017dc8 0 [241550.243009] [7d0fd3c4] REQ< 81583dc8 10801 [241550.243025] [7d0fd3c7] CMD< d 70000 [241550.243042] [7d0fd3d1] FCM< 81583dc8 81583e30 [241550.243058] [7d0fd3d4] RSP 900 0 [241550.243075] [7d0fd3e8] FCM> 81583dc8 0 [241550.243091] [7d0fd3e9] CMD d 0 [241550.243107] [7d0fd3ea] REQ> 81583dc8 0 [241550.243123] [7d0fd422] TSK< 81583dc8 0 [241550.243139] [7d0fd442] TSK> 81583dc8 0 [241550.243156] [7d1fb37e] REQ< 81583dc8 10801 [241550.243172] [7d1fb380] CMD< d 70000 [241550.243189] [7d1fb389] FCM< 81583dc8 81583e30 [241550.243205] [7d1fb38b] RSP 900 0 [241550.243221] [7d1fb398] FCM> 81583dc8 0 [241550.243237] [7d1fb399] CMD d 0 [241550.243253] [7d1fb399] REQ> 81583dc8 0 [241550.243270] [7d1fb3bf] TSK< 81583dc8 0 [241550.243286] [7d1fb3cf] TSK> 81583dc8 0 [241550.243303] [3d25d1a5] REQ< b8f0b0b0 10801 [241550.243319] [3d25d1a9] CMD< 11 2001 [241550.243336] [3d25d1b4] CMDD 1 200 [241550.243353] [3d25d1b8] FCM< b8f0b0b0 b8f0b128 [241550.243369] [3d25d1bc] RSP 900 0 [241550.243385] [3d25d1bd] FCM> b8f0b0b0 0 [241550.243402] [3d25d1bf] CMD 11 200 [241550.243418] [3d25d1c0] REQ> b8f0b0b0 0 [241550.243434] [3d25d409] IRQ< 1 0 [241550.243450] [3d25d40b] IRQD b8f0b190 1 [241550.243466] [3d25d40e] XFP< b8f0b190 1 [241550.243482] [3d25d436] XFP> b8f0b190 1 [241550.243499] [3d25d438] FDA< b8f0b0b0 0 [241550.243515] [3d25d43a] TCM< b8f0b190 0 [241550.243531] [3d25d43c] WTC< 10801 0 [241550.243547] [3d25d43e] WTC> 10801 0 [241550.243564] [3d25d441] TCM> b8f0b190 0 [241550.243580] [3d25d442] FDA> b8f0b0b0 0 [241550.243595] [3d25d443] IRQ> 0 0 [241550.243612] [3d25d456] TSK< b8f0b0b0 0 [241550.243628] [3d25d48b] TSK> b8f0b0b0 0 [241550.243645] [3d25d4d4] REQ< b8f0aab0 10801 [241550.243661] [3d25d4d5] CMD< 18 2020 [241550.243678] [3d25d4dd] CMDD 1 200 [241550.243695] [3d25d4df] FCM< b8f0aab0 b8f0ab28 [241550.243711] [3d25d4e1] RSP 900 0 [241550.243727] [3d25d4e3] FCM> b8f0aab0 0 [241550.243744] [3d25d4e4] CMD 18 200 [241550.243760] [3d25d4e5] REQ> b8f0aab0 0 [241550.243776] [3d25d4f1] IRQ< 1 0 [241550.243792] [3d25d4f2] IRQD b8f0ab90 1 [241550.243808] [3d25d4f4] XFP< b8f0ab90 1 [241550.243824] [3d25d50c] XFP> b8f0ab90 1 [241550.243840] [3d25d50d] IRQ> 1 0 [241550.243856] [3d2a53c4] IRQ< 200 0 [241550.243873] [3d2a53c6] IRQK b8f0ab90 200 [241550.243889] [3d2a53c9] FDA< b8f0aab0 0 [241550.243905] [3d2a53cb] TCM< b8f0ab90 0 [241550.243922] [3d2a53cc] WTC< 10801 0 [241550.243938] [3d2a53ce] WTC> 10801 0 [241550.243954] [3d2a53d1] TCM> b8f0ab90 0 [241550.243970] [3d2a53d2] FDA> b8f0aab0 0 [241550.243986] [3d2a53d3] IRQ> 0 0 [241550.244003] [3d2a53e3] TSK< b8f0aab0 0 [241550.244019] [3d2a5417] TSK> b8f0aab0 0 [241550.244035] [3d2a5468] REQ< 8fd0bc00 10801 [241550.244052] [3d2a546b] CMD< d 70000 [241550.244069] [3d2a5472] FCM< 8fd0bc00 8fd0bc68 [241550.244085] [3d2a5475] RSP 900 0 [241550.244101] [3d2a5489] FCM> 8fd0bc00 0 [241550.244117] [3d2a548b] CMD d 0 [241550.244133] [3d2a548c] REQ> 8fd0bc00 0 [241550.244149] [3d2a54bf] TSK< 8fd0bc00 0 [241550.244166] [3d2a54dd] TSK> 8fd0bc00 0 [241550.244182] [3d2a5505] REQ< b8f0acb0 10801 [241550.244199] [3d2a5507] CMD< 18 2fe1 [241550.244215] [3d2a550d] CMDD 1 200 [241550.244232] [3d2a550f] FCM< b8f0acb0 b8f0ad28 [241550.244248] [3d2a5511] RSP 900 0 [241550.244265] [3d2a5512] FCM> b8f0acb0 0 [241550.244281] [3d2a5513] CMD 18 200 [241550.244297] [3d2a5514] REQ> b8f0acb0 0 [241550.244313] [3d2a5520] IRQ< 1 0 [241550.244329] [3d2a5521] IRQD b8f0ad90 1 [241550.244345] [3d2a5523] XFP< b8f0ad90 1 [241550.244362] [3d2a553e] XFP> b8f0ad90 1 [241550.244378] [3d2a553f] IRQ> 1 0 [241550.244394] [3d2fb31c] IRQ< 200 0 [241550.244410] [3d2fb31e] IRQK b8f0ad90 200 [241550.244427] [3d2fb321] FDA< b8f0acb0 0 [241550.244443] [3d2fb323] TCM< b8f0ad90 0 [241550.244459] [3d2fb325] WTC< 10801 0 [241550.244475] [3d2fb327] WTC> 10801 0 [241550.244492] [3d2fb32a] TCM> b8f0ad90 0 [241550.244508] [3d2fb32b] FDA> b8f0acb0 0 [241550.244524] [3d2fb32d] IRQ> 0 0 [241550.244540] [3d2fb33c] TSK< b8f0acb0 0 [241550.244556] [3d2fb373] TSK> b8f0acb0 0 [241550.244573] [3d2fb3ba] REQ< 8fd0bc00 10801 [241550.244589] [3d2fb3bd] CMD< d 70000 [241550.244606] [3d2fb3c8] FCM< 8fd0bc00 8fd0bc68 [241550.244623] [3d2fb3cc] RSP 900 0 [241550.244639] [3d2fb3e1] FCM> 8fd0bc00 0 [241550.244655] [3d2fb3e2] CMD d 0 [241550.244671] [3d2fb3e3] REQ> 8fd0bc00 0 [241550.244688] [3d2fb418] TSK< 8fd0bc00 0 [241550.244704] [3d2fb437] TSK> 8fd0bc00 0 [241550.244720] [3d2fb462] REQ< b8f0aeb0 10801 [241550.244737] [3d2fb464] CMD< 18 412b [241550.244754] [3d2fb46c] CMDD 1 200 [241550.244771] [3d2fb46d] FCM< b8f0aeb0 b8f0af28 [241550.244787] [3d2fb46f] RSP 900 0 [241550.244803] [3d2fb470] FCM> b8f0aeb0 0 [241550.244819] [3d2fb471] CMD 18 200 [241550.244835] [3d2fb472] REQ> b8f0aeb0 0 [241550.244851] [3d2fb47e] IRQ< 1 0 [241550.244868] [3d2fb47f] IRQD b8f0af90 1 [241550.244884] [3d2fb481] XFP< b8f0af90 1 [241550.244900] [3d2fb49f] XFP> b8f0af90 1 [241550.244916] [3d2fb4a0] IRQ> 1 0 [241550.244931] [3dce5221] TIM< 0 0 [241550.244964] mmc0: cmd op 24 arg 0x412b flags 0xb5 - resp 00000900 00000000 00000000 00000000, err 0 [241550.244981] mmc0: data blocks 1 blksz 200 - err 0 [241550.244993] mmc0: =========== REGISTER DUMP =========== [241550.245006] mmc0: SDCMD 0x00004098 [241550.245019] mmc0: SDARG 0x0000412b [241550.245032] mmc0: SDTOUT 0x027bc86a [241550.245043] mmc0: SDCDIV 0x00000001 [241550.245056] mmc0: SDRSP0 0x00000900 [241550.245068] mmc0: SDRSP1 0x0000182e [241550.245081] mmc0: SDRSP2 0xffffffff [241550.245093] mmc0: SDRSP3 0x0002400f [241550.245105] mmc0: SDHSTS 0x00000081 [241550.245117] mmc0: SDVDD 0x00000001 [241550.245130] mmc0: SDEDM 0x00010801 [241550.245142] mmc0: SDHCFG 0x0000050e [241550.245154] mmc0: SDHBCT 0x00000200 [241550.245166] mmc0: SDHBLC 0x00000001 [241550.245177] mmc0: =========================================== [241550.245417] mmc0: reducing overclock due to errors [241550.246426] mmc0: overclocking to 62500000Hz [241805.689375] mmc0: timeout waiting for hardware interrupt. [241805.689418] [4b0130e5] FCM> b39fddc8 0 [241805.689435] [4b0130e7] CMD d 0 [241805.689451] [4b0130e8] REQ> b39fddc8 0 [241805.689468] [4b013119] TSK< b39fddc8 0 [241805.689484] [4b013139] TSK> b39fddc8 0 [241805.689501] [4b11108b] REQ< b39fddc8 10801 [241805.689517] [4b11108e] CMD< d 70000 [241805.689535] [4b111096] FCM< b39fddc8 b39fde30 [241805.689551] [4b111098] RSP 900 0 [241805.689567] [4b1110ab] FCM> b39fddc8 0 [241805.689583] [4b1110ac] CMD d 0 [241805.689600] [4b1110ad] REQ> b39fddc8 0 [241805.689616] [4b1110e2] TSK< b39fddc8 0 [241805.689632] [4b111100] TSK> b39fddc8 0 [241805.689649] [4b20f087] REQ< b39fddc8 10801 [241805.689665] [4b20f089] CMD< d 70000 [241805.689682] [4b20f091] FCM< b39fddc8 b39fde30 [241805.689699] [4b20f093] RSP 900 0 [241805.689715] [4b20f0b0] FCM> b39fddc8 0 [241805.689731] [4b20f0b1] CMD d 0 [241805.689747] [4b20f0b2] REQ> b39fddc8 0 [241805.689764] [4b20f0e7] TSK< b39fddc8 0 [241805.689780] [4b20f106] TSK> b39fddc8 0 [241805.689796] [4b30d08f] REQ< b39fddc8 10801 [241805.689813] [4b30d091] CMD< d 70000 [241805.689830] [4b30d09a] FCM< b39fddc8 b39fde30 [241805.689846] [4b30d09c] RSP 900 0 [241805.689862] [4b30d0b2] FCM> b39fddc8 0 [241805.689878] [4b30d0b3] CMD d 0 [241805.689894] [4b30d0b4] REQ> b39fddc8 0 [241805.689910] [4b30d0e6] TSK< b39fddc8 0 [241805.689927] [4b30d104] TSK> b39fddc8 0 [241805.689943] [4b40b055] REQ< b39fddc8 10801 [241805.689960] [4b40b057] CMD< d 70000 [241805.689976] [4b40b05e] FCM< b39fddc8 b39fde30 [241805.689993] [4b40b060] RSP 900 0 [241805.690009] [4b40b072] FCM> b39fddc8 0 [241805.690025] [4b40b073] CMD d 0 [241805.690041] [4b40b074] REQ> b39fddc8 0 [241805.690057] [4b40b0a9] TSK< b39fddc8 0 [241805.690073] [4b40b0c7] TSK> b39fddc8 0 [241805.690090] [4b509068] REQ< b39fddc8 10801 [241805.690107] [4b50906a] CMD< d 70000 [241805.690124] [4b509073] FCM< b39fddc8 b39fde30 [241805.690140] [4b509075] RSP 900 0 [241805.690156] [4b509088] FCM> b39fddc8 0 [241805.690172] [4b509089] CMD d 0 [241805.690188] [4b50908a] REQ> b39fddc8 0 [241805.690205] [4b5090c0] TSK< b39fddc8 0 [241805.690221] [4b5090df] TSK> b39fddc8 0 [241805.690238] [4b607057] REQ< b39fddc8 10801 [241805.690254] [4b607058] CMD< d 70000 [241805.690271] [4b607060] FCM< b39fddc8 b39fde30 [241805.690287] [4b607062] RSP 900 0 [241805.690303] [4b607075] FCM> b39fddc8 0 [241805.690319] [4b607076] CMD d 0 [241805.690336] [4b607077] REQ> b39fddc8 0 [241805.690352] [4b6070ab] TSK< b39fddc8 0 [241805.690368] [4b6070c9] TSK> b39fddc8 0 [241805.690385] [4b705015] REQ< b39fddc8 10801 [241805.690401] [4b705017] CMD< d 70000 [241805.690418] [4b70501f] FCM< b39fddc8 b39fde30 [241805.690434] [4b705021] RSP 900 0 [241805.690450] [4b705032] FCM> b39fddc8 0 [241805.690466] [4b705034] CMD d 0 [241805.690482] [4b705035] REQ> b39fddc8 0 [241805.690498] [4b705067] TSK< b39fddc8 0 [241805.690515] [4b705085] TSK> b39fddc8 0 [241805.690532] [4b803030] REQ< b39fddc8 10801 [241805.690548] [4b803032] CMD< d 70000 [241805.690565] [4b803039] FCM< b39fddc8 b39fde30 [241805.690581] [4b80303b] RSP 900 0 [241805.690597] [4b80304e] FCM> b39fddc8 0 [241805.690613] [4b80304f] CMD d 0 [241805.690629] [4b803050] REQ> b39fddc8 0 [241805.690646] [4b803084] TSK< b39fddc8 0 [241805.690662] [4b8030a2] TSK> b39fddc8 0 [241805.690679] [4b900fee] REQ< b39fddc8 10801 [241805.690695] [4b900ff1] CMD< d 70000 [241805.690712] [4b900ff8] FCM< b39fddc8 b39fde30 [241805.690728] [4b900ffb] RSP 900 0 [241805.690744] [4b901010] FCM> b39fddc8 0 [241805.690760] [4b901011] CMD d 0 [241805.690776] [4b901012] REQ> b39fddc8 0 [241805.690792] [4b901043] TSK< b39fddc8 0 [241805.690809] [4b901062] TSK> b39fddc8 0 [241805.690825] [4b9fefff] REQ< b39fddc8 10801 [241805.690842] [4b9ff001] CMD< d 70000 [241805.690858] [4b9ff008] FCM< b39fddc8 b39fde30 [241805.690875] [4b9ff00a] RSP 900 0 [241805.690891] [4b9ff01d] FCM> b39fddc8 0 [241805.690907] [4b9ff01f] CMD d 0 [241805.690923] [4b9ff01f] REQ> b39fddc8 0 [241805.690939] [4b9ff051] TSK< b39fddc8 0 [241805.690956] [4b9ff06e] TSK> b39fddc8 0 [241805.690972] [4bafcfd4] REQ< b39fddc8 10801 [241805.690989] [4bafcfd6] CMD< d 70000 [241805.691005] [4bafcfdd] FCM< b39fddc8 b39fde30 [241805.691022] [4bafcfdf] RSP 900 0 [241805.691038] [4bafcff1] FCM> b39fddc8 0 [241805.691054] [4bafcff5] CMD d 0 [241805.691070] [4bafcff6] REQ> b39fddc8 0 [241805.691086] [4bafd028] TSK< b39fddc8 0 [241805.691103] [4bafd045] TSK> b39fddc8 0 [241805.691119] [4bbfafb2] REQ< b39fddc8 10801 [241805.691136] [4bbfafb4] CMD< d 70000 [241805.691152] [4bbfafbb] FCM< b39fddc8 b39fde30 [241805.691169] [4bbfafbd] RSP 900 0 [241805.691185] [4bbfafcf] FCM> b39fddc8 0 [241805.691201] [4bbfafd0] CMD d 0 [241805.691217] [4bbfafd1] REQ> b39fddc8 0 [241805.691233] [4bbfb005] TSK< b39fddc8 0 [241805.691250] [4bbfb023] TSK> b39fddc8 0 [241805.691266] [4bcf8fab] REQ< b39fddc8 10801 [241805.691283] [4bcf8fae] CMD< d 70000 [241805.691300] [4bcf8fb4] FCM< b39fddc8 b39fde30 [241805.691316] [4bcf8fb6] RSP 900 0 [241805.691332] [4bcf8fc9] FCM> b39fddc8 0 [241805.691348] [4bcf8fcb] CMD d 0 [241805.691364] [4bcf8fcc] REQ> b39fddc8 0 [241805.691380] [4bcf9001] TSK< b39fddc8 0 [241805.691397] [4bcf9020] TSK> b39fddc8 0 [241805.691413] [4bdf6f8f] REQ< b39fddc8 10801 [241805.691430] [4bdf6f91] CMD< d 70000 [241805.691446] [4bdf6f97] FCM< b39fddc8 b39fde30 [241805.691463] [4bdf6f9a] RSP 900 0 [241805.691479] [4bdf6fad] FCM> b39fddc8 0 [241805.691495] [4bdf6fae] CMD d 0 [241805.691511] [4bdf6faf] REQ> b39fddc8 0 [241805.691527] [4bdf6fed] TSK< b39fddc8 0 [241805.691543] [4bdf700d] TSK> b39fddc8 0 [241805.691560] [4bef4f93] REQ< b39fddc8 10801 [241805.691576] [4bef4f95] CMD< d 70000 [241805.691593] [4bef4f9c] FCM< b39fddc8 b39fde30 [241805.691609] [4bef4f9e] RSP 900 0 [241805.691626] [4bef4fb2] FCM> b39fddc8 0 [241805.691642] [4bef4fb3] CMD d 0 [241805.691658] [4bef4fb4] REQ> b39fddc8 0 [241805.691674] [4bef4fe8] TSK< b39fddc8 0 [241805.691690] [4bef5006] TSK> b39fddc8 0 [241805.691707] [4bff2f63] REQ< b39fddc8 10801 [241805.691723] [4bff2f65] CMD< d 70000 [241805.691740] [4bff2f6c] FCM< b39fddc8 b39fde30 [241805.691756] [4bff2f6f] RSP 900 0 [241805.691773] [4bff2f80] FCM> b39fddc8 0 [241805.691789] [4bff2f81] CMD d 0 [241805.691805] [4bff2f82] REQ> b39fddc8 0 [241805.691821] [4bff2fb3] TSK< b39fddc8 0 [241805.691837] [4bff2fd2] TSK> b39fddc8 0 [241805.691854] [4c0f0f22] REQ< b39fddc8 10801 [241805.691870] [4c0f0f24] CMD< d 70000 [241805.691887] [4c0f0f2c] FCM< b39fddc8 b39fde30 [241805.691903] [4c0f0f2e] RSP 900 0 [241805.691919] [4c0f0f38] FCM> b39fddc8 0 [241805.691935] [4c0f0f39] CMD d 0 [241805.691952] [4c0f0f3a] REQ> b39fddc8 0 [241805.691968] [4c0f0f54] TSK< b39fddc8 0 [241805.691984] [4c0f0f63] TSK> b39fddc8 0 [241805.692001] [4c1eef61] REQ< b39fddc8 10801 [241805.692017] [4c1eef64] CMD< d 70000 [241805.692034] [4c1eef6e] FCM< b39fddc8 b39fde30 [241805.692050] [4c1eef72] RSP 900 0 [241805.692066] [4c1eef87] FCM> b39fddc8 0 [241805.692082] [4c1eef89] CMD d 0 [241805.692099] [4c1eef8a] REQ> b39fddc8 0 [241805.692115] [4c1eefc0] TSK< b39fddc8 0 [241805.692131] [4c1eefe4] TSK> b39fddc8 0 [241805.692148] [4c2ecf4f] REQ< b39fddc8 10801 [241805.692164] [4c2ecf52] CMD< d 70000 [241805.692181] [4c2ecf5c] FCM< b39fddc8 b39fde30 [241805.692197] [4c2ecf5f] RSP 900 0 [241805.692213] [4c2ecf75] FCM> b39fddc8 0 [241805.692229] [4c2ecf76] CMD d 0 [241805.692245] [4c2ecf78] REQ> b39fddc8 0 [241805.692262] [4c2ecfe3] TSK< b39fddc8 0 [241805.692278] [4c2ed005] TSK> b39fddc8 0 [241805.692295] [4c3eaf15] REQ< b39fddc8 10801 [241805.692311] [4c3eaf18] CMD< d 70000 [241805.692328] [4c3eaf21] FCM< b39fddc8 b39fde30 [241805.692344] [4c3eaf23] RSP 900 0 [241805.692360] [4c3eaf37] FCM> b39fddc8 0 [241805.692376] [4c3eaf38] CMD d 0 [241805.692392] [4c3eaf39] REQ> b39fddc8 0 [241805.692408] [4c3eaf6f] TSK< b39fddc8 0 [241805.692425] [4c3eaf8f] TSK> b39fddc8 0 [241805.692441] [4c4e8f0c] REQ< b39fddc8 10801 [241805.692458] [4c4e8f0f] CMD< d 70000 [241805.692475] [4c4e8f18] FCM< b39fddc8 b39fde30 [241805.692491] [4c4e8f1a] RSP 900 0 [241805.692507] [4c4e8f2e] FCM> b39fddc8 0 [241805.692523] [4c4e8f2f] CMD d 0 [241805.692539] [4c4e8f30] REQ> b39fddc8 0 [241805.692555] [4c4e8f66] TSK< b39fddc8 0 [241805.692572] [4c4e8f83] TSK> b39fddc8 0 [241805.692588] [4c5e6f0b] REQ< b39fddc8 10801 [241805.692605] [4c5e6f0d] CMD< d 70000 [241805.692622] [4c5e6f18] FCM< b39fddc8 b39fde30 [241805.692638] [4c5e6f1b] RSP 900 0 [241805.692654] [4c5e6f39] FCM> b39fddc8 0 [241805.692670] [4c5e6f3a] CMD d 0 [241805.692686] [4c5e6f3b] REQ> b39fddc8 0 [241805.692702] [4c5e6f72] TSK< b39fddc8 0 [241805.692719] [4c5e6f91] TSK> b39fddc8 0 [241805.692735] [0c621a5e] PRD< b8f01790 0 [241805.692752] [0c621a63] PRD1 b95a3e40 0 [241805.692767] [0c621a73] PRD2 1 0 [241805.692783] [0c621a8e] PRD3 9c7ead04 0 [241805.692800] [0c621a93] PDM> b8f01790 0 [241805.692816] [0c621a98] REQ< b8f016b0 10801 [241805.692833] [0c621a9b] CMD< 19 18b2e0 [241805.692848] [0c621aa4] CMDD 8 200 [241805.692865] [0c621aa6] SDMA b8f01790 b95a3e40 [241805.692882] [0c621aad] FCM< b8f016b0 b8f01728 [241805.692898] [0c621ab0] RSP 900 0 [241805.692914] [0c621ab2] FCM> b8f016b0 0 [241805.692931] [0c621ab3] CMD 19 200 [241805.692947] [0c621ab4] REQ> b8f016b0 0 [241805.692963] [0c621be1] DMA< b8f01790 0 [241805.692979] [0c621be3] DMA 99 10801 [241805.692996] [0c621be8] FDA< b8f016b0 0 [241805.693012] [0c621beb] TCM< b8f01790 0 [241805.693028] [0c621bed] CMD< c 0 [241805.693044] [0c621bf0] TCM> b8f01790 0 [241805.693061] [0c621bf1] FDA> b8f016b0 b8f0175c [241805.693076] [0c621bf2] DMA> 0 0 [241805.693092] [0c622469] IRQ< 400 0 [241805.693109] [0c62246b] IRQB b8f0175c 400 [241805.693126] [0c62246d] FCM< b8f016b0 b8f0175c [241805.693142] [0c62246f] RSP c00 0 [241805.693159] [0c622472] FCM> b8f016b0 b8f0175c [241805.693174] [0c622474] IRQ> 0 0 [241805.693190] [0c622483] TSK< b8f016b0 0 [241805.693207] [0c6224b6] TSK> b8f016b0 0 [241805.693223] [0c6224fd] REQ< 8fd0bdb8 10801 [241805.693239] [0c6224fe] CMD< d 70000 [241805.693256] [0c622504] FCM< 8fd0bdb8 8fd0be20 [241805.693272] [0c622507] RSP 900 0 [241805.693288] [0c62251a] FCM> 8fd0bdb8 0 [241805.693304] [0c62251b] CMD d 0 [241805.693320] [0c62251c] REQ> 8fd0bdb8 0 [241805.693336] [0c622550] TSK< 8fd0bdb8 0 [241805.693352] [0c62256d] TSK> 8fd0bdb8 0 [241805.693369] [0c696e39] REQ< b8f018b0 10801 [241805.693385] [0c696e3c] CMD< 18 2001 [241805.693402] [0c696e46] CMDD 1 200 [241805.693419] [0c696e48] FCM< b8f018b0 b8f01928 [241805.693435] [0c696e4b] RSP 900 0 [241805.693451] [0c696e4c] FCM> b8f018b0 0 [241805.693467] [0c696e4e] CMD 18 200 [241805.693483] [0c696e4f] REQ> b8f018b0 0 [241805.693499] [0c696e5f] IRQ< 1 0 [241805.693515] [0c696e61] IRQD b8f01990 1 [241805.693531] [0c696e63] XFP< b8f01990 1 [241805.693547] [0c696e81] XFP> b8f01990 1 [241805.693563] [0c696e82] IRQ> 1 0 [241805.693578] [0d082af6] TIM< 0 0 [241805.693611] mmc0: cmd op 24 arg 0x2001 flags 0xb5 - resp 00000900 00000000 00000000 00000000, err 0 [241805.693628] mmc0: data blocks 1 blksz 200 - err 0 [241805.693641] mmc0: =========== REGISTER DUMP =========== [241805.693653] mmc0: SDCMD 0x00004098 [241805.693666] mmc0: SDARG 0x00002001 [241805.693678] mmc0: SDTOUT 0x01dcd650 [241805.693690] mmc0: SDCDIV 0x00000002 [241805.693703] mmc0: SDRSP0 0x00000900 [241805.693715] mmc0: SDRSP1 0x0000182e [241805.693727] mmc0: SDRSP2 0xffffffff [241805.693740] mmc0: SDRSP3 0x0002400f [241805.693752] mmc0: SDHSTS 0x00000081 [241805.693764] mmc0: SDVDD 0x00000001 [241805.693777] mmc0: SDEDM 0x00010801 [241805.693789] mmc0: SDHCFG 0x0000050e [241805.693801] mmc0: SDHBCT 0x00000200 [241805.693813] mmc0: SDHBLC 0x00000001 [241805.693824] mmc0: =========================================== [241805.693954] mmc0: reducing overclock due to errors [241805.695009] mmc0: cancelling overclock ```

This time I had set dtparam=sd_overclock=100, which is why the firmware reduced it back to default in two steps, actually a nice feature. However in last post above this was NOT overclocked, so I don't expect it as the origin of the issue, as well since the overclocked SD frequency is something that worked nicely for the 5 years I run this RPi 24/7 😉.

I think the difficulty is that this error is very unspecific, is it? Related to the fact that I never saw this on any other firmware/kernel version (see above), probably someone has an idea where it might come from and how to debug? At least I would like to stay with overclocked mmc (which increases transfer rates significantly) and the SD card definitely supports it.

I have the same issue with the eMMC on multiple compute modules. There's no SD card. For some reason the timeout log and register dumps take more than 1s in a softIRQ, running with IRQs disabled. I have included the output from the sdhost driver from dmesg here.

In my case it seems to have been solved after enabling uio_pdrv_genirq kernel module. I was in attempt to find out which are required for what and without this it worked stable for a year until one of the Linux 5.4 releases, so I was not thinking about it anymore. But for some reason it seems to be required now. It "should" load by default, i.e. I blacklisted it before to prevent its load.

I have the same issue with the eMMC on multiple compute modules. There's no SD card. For some reason the timeout log and register dumps take more than 1s in a softIRQ, running with IRQs disabled. I have included the output from the sdhost driver from dmesg here.

My issue seems to have been a hardware issue instead of a driver issue. Our controller board had the raspberry pi compute module IO board copied on it wholesale. Instead of connecting a jumper to the connector for selecting the bootmode, we had a switch there, connected via a ~20cm wire. This wire probably picked up some noise during operation, switching the EMMC_DISABLE_N signal, causing issues with this driver. My work-around is outlined here: https://www.raspberrypi.org/forums/viewtopic.php?f=98&t=289726

Just reporting, after running for several YEARS.

Many many like: 2023-09-15 00:11:00 pi93graf kern.err kernel: [ 8518.855078] print_req_error: I/O error, dev mmcblk0, sector 42880405 2023-09-15 00:11:10 pi93graf kern.err kernel: [ 8529.092917] mmc0: timeout waiting for hardware interrupt. 2023-09-15 00:11:10 pi93graf kern.err kernel: [ 8529.095121] print_req_error: I/O error, dev mmcblk0, sector 42880406 ... 2023-09-15 00:11:21 pi93graf kern.err kernel: [ 8539.335215] print_req_error: I/O error, dev mmcblk0, sector 42880407 2023-09-15 00:11:30 pi93graf daemon.err systemd[1]: systemd-journald.service: Watchdog timeout (limit 3min)!

Also from influxdb:

2023-09-15 08:09:23 pi93graf user.info influxd-systemd-start.sh[2501]: ts=2023-09-15T12:09:23.344486Z lvl=info msg="Compacting file" log_id=0kHjJEDG000 engine=tsm1 tsm1_strategy=full tsm1_optimize=false trace_id=0kIBmEWl000 op_name=tsm1_compact_group db_shard_id=2066 tsm1_index=1 tsm1_file=/varnew/lib/influxdb/data/ruuvi/autogen/2066/000000002-000000001.tsm

2023-09-15 08:09:31 pi93graf user.info influxd-systemd-start.sh[2501]: ts=2023-09-15T12:09:31.579042Z lvl=info msg="Error replacing new TSM files" log_id=0kHjJEDG000 engine=tsm1 tsm1_strategy=full tsm1_optimize=false trace_id=0kIBmEWl000 op_name=tsm1_compact_group db_shard_id=2066 error="cannot allocate memory"

This is happening now on my up-to-date Raspberry Pi Zero 2.

Because this has happened before and I could not see any reason, i left a couple logs open in screen.

from kernel.log: [seems normal up to here] Nov 9 20:09:19 troll systemd[1]: Removed slice User Slice of UID 0. Nov 9 20:09:46 troll kernel: [213338.858612] mmc0: timeout waiting for hardware interrupt. Nov 9 20:09:46 troll kernel: [213338.858635] [6b9d8a9c] PRD1 81785840 0 Nov 9 20:09:46 troll kernel: [213338.858653] [6b9d8a9f] PRD2 2 0

dnsmasq.log: [all normal up to here] Nov 10 01:47:28 dnsmasq-dhcp[428]: failed to write /var/lib/misc/dnsmasq.leases: Read-only file system (retry in 60 s) [repeated many times over subsequent hours; yes, it keeps serving DNS]

It's hard to troubleshoot after the fact because no commands or files can be found on the filesystem, ls won't work, etc. top continues to run and says that RAM is reasonably available, CPU mostly idle, etc.

root@troll:/var/log# ls bash: /bin/ls: Input/output error

Any suggestions welcome. I just wanted to confirm that this can still happen fairly frequently on a Pi with the current OS and updated firmware.

I will add more info if I learn anything else.

In my case I believe it to be a couple of bad locations on the SD !

raspberrypi / linux

mmc0 Timeout waiting for hardware interrupt #2392