[BUG] LibreELEC 12.0.1 unbootable on Rock64 (RK3328)

NetDwarf commented 2 weeks ago

Describe the bug

A fresh install of LibreELEC 12.0.1 is stuck on boot. LibreELEC logo and version shows, but it remains on that screen forever.

How to reproduce

Steps to reproduce the behavior:

Flash LibreELEC 12.0.1 (stable) to SD card
Insert SD
Start device

Information

LibreELEC Version: 12.0.1
Hardware Platform: Rock64 (RK3328)

Log file

Unfortunately there is no Kodi.log or anything useful I could find, so you might need to point me in the right direction.

I can say that the installation process seemingly went fine as the partitions are there and have the right size as far as I can tell.

Context

This is also true for newer nightly releases (20240802 was the previous working nightly)

heitbaum commented 2 weeks ago

Please check if this is the same as #8446

NetDwarf commented 2 weeks ago

Please check if this is the same as Since #7837 kernel 6.4.y Rock64 does not display on a 4K screen #8446

It's not. It's on a 1080p display, kernel 6.6 (presumably, if it didn't change for this specific version), 12.0.1 stable.

PS.: It also doesn't reboot and I have no SSH access (that'd be a boon).

heitbaum commented 2 weeks ago

I had a look - you are right - only the kodi and kernel really different between these 2

https://github.com/LibreELEC/LibreELEC.tv/compare/cbf0545...12.0.1

Did you get anything on the screen during the 12.0.1 boot?

I'm going to suggest

boot with a clean https://test.libreelec.tv/12.0/Rockchip/rock64/LibreELEC-RK3328.aarch64-12.0-nightly-20240802-cbf0545-rock64.img.gz image.
validate
put the 12.0.1 image into the .update folder

NetDwarf commented 2 weeks ago

I had a look - you are right - only the kodi and kernel really different between these 2

cbf0545...12.0.1

Did you get anything on the screen during the 12.0.1 boot?

I'm going to suggest
* boot with a clean https://test.libreelec.tv/12.0/Rockchip/rock64/LibreELEC-RK3328.aarch64-12.0-nightly-20240802-cbf0545-rock64.img.gz image.

* validate

* put the 12.0.1 image into the .update folder

fresh 12.0-nightly-20240802 boots and then updating to 12.0.1 -> broken
fresh 12.0.0 (stable) boots and then updating to 12.0.1 -> broken

I think it is safe to say, that 12.0.1 is broken on this specific setup at least (Rock64 RK3328).

Is there actually a way to debug this stuck boot somehow?

heitbaum commented 2 weeks ago

We are checking - it might be fixed with an upstream patch - https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git/commit/drivers/pinctrl/pinctrl-rockchip.c?id=128f71fe014fc91efa1407ce549f94a9a9f1072c - will advise once tested.

diederikdehaas commented 2 weeks ago

FWIW: That is a known fix for a known bug

(https://lore.kernel.org/all/2241778.ZfL8zNpBrT@diego/ was send after I 'pushed' on the issue)

EDIT: It's already queued up for 6.1: https://git.kernel.org/pub/scm/linux/kernel/git/stable/stable-queue.git/tree/queue-6.1/pinctrl-rockchip-correct-rk3328-iomux-width-flag-for-gpio2-b-pins.patch

EDIT2: While true, a bit more relevant is that it's also queued up for 6.6: https://git.kernel.org/pub/scm/linux/kernel/git/stable/stable-queue.git/tree/queue-6.6/pinctrl-rockchip-correct-rk3328-iomux-width-flag-for-gpio2-b-pins.patch

heitbaum commented 2 weeks ago

@NetDwarf please test https://heitbaum.libreelec.tv/LibreELEC-RK3328.aarch64-12.0-devel-20240831103135-ee40b52-rock64.img.gz and let us know, then we can include the patch in the nightly releases if it does indeed fix your issue.

diederikdehaas commented 2 weeks ago

@heitbaum How can I get serial output? I downloaded the above image and the 12.0.1 release and have a serial console connected to my Rock64, but when I started up, I didn't get anything on serial.
How to change that?

EDIT: nvm, found it: add console=ttyS2,1500000n8 to extlinux.conf

diederikdehaas commented 2 weeks ago

Surprisingly (?) the serial output was the same, apart from timestamps/guids and the release identifier.

I'll now try the visual approach, but that's without serial. Could it be that this issue doesn't happen always? Or only with certain HW revisions? I have a Rock64 v2

EDIT: everything seems to work fine in 'visual' mode too.
I did have a DNS problem (within my LAN) though where I could ping by IP address, but not by hostname, while that works fine on my 'regular' LE device (also Rock64) in that same LAN, but that still runs 11.0.6 ...

Anyway, it looks like I can't help with this problem, so I'd better stay out of it.
Having said that, the mentioned bug is real and the fix/patch fixes that bug, but maybe something else is going on here ..

NetDwarf commented 1 week ago

@NetDwarf please test https://heitbaum.libreelec.tv/LibreELEC-RK3328.aarch64-12.0-devel-20240831103135-ee40b52-rock64.img.gz and let us know, then we can include the patch in the nightly releases if it does indeed fix your issue.

Updating from 12.0.1 (offline) the devel build boots, so I'd assume this issue is fixed with this patch.

PS.: Sorry for the late feedback, but I haven't had access to the device in the last few days.

LibreELEC / LibreELEC.tv