search

FalconChristmas / fpp

Falcon Player
http://FalconChristmas.com
Other
552 stars 193 forks source link

Some SD Cards have issues with FPP 8.0, Unable to boot #1959

Open zackbcom opened 1 week ago

zackbcom commented 1 week ago

FPP Version and Hardware: FPP 8.0 running on BBB

Describe the bug and Steps to reproduce:

  1. Flash FPP BBB 8.0 zip to sd card.
  2. boot
  3. does not boot, or pull ip.
  4. Does not fix with power cycle Unable to attach monitor to trouble shoot farther.

Upgrading from 7.5 - same issue

  1. flash 7.5 on sd card
  2. Upgrade to latest 7.5 via ui
  3. upgrade os with 8.0 from ui
  4. reboot
  5. same as above, does not boot
  6. Does not fix with power cycle

I have tried this with 4 SD cards on two Beagle Bone Black. I have tried with no lan, using usb wan, no usb wan tried booting holding the S2 button. Both devices sit there and double blink the led every second.

7.5 works just fine.

Expected behavior: should boot.

dkulp commented 1 week ago

I cannot reproduce this at all. I used Raspberry Pi imager to burn 8.0 onto a fresh SD card, stuck it into a brand new Beagle, and it booted up fine.

zackbcom commented 1 week ago

I'll try some more debugging today. I flashed using a Mac with BalenaEtcher . I will try pc.

Wonder if it might be related to the networking. I did see my Unifi switch's STP disabled the port due to loopback detected at somepoint during the flashing 7.5 and upgraded to 8.0.

I am also using static IP reservation on pfsense based on mac address.

I'll test with all of these and determine root cause.

I'll see if I can try finding an hdmi cable for it.

dkulp commented 1 week ago

If things are working properly, an HDMI adapter won't be very useful as FPP specifically disables the HDMI port.

FYI: the image I burned was from RPI on a Mac.

zackbcom commented 1 week ago

I will try the RPI imager on mac downloading the 8.0 zip again.

dkulp commented 1 week ago

With RPI imager, you don't need to download the zip. Select FPP from the "Other Special Purpose OS" option and RPI imager will automatically download it, verify the checksum, and burn it.

zackbcom commented 1 week ago

The BBB That I am using are the PCB RevB6. I wonder if this has something to do with it.

Going to check my other boxes to see if i have any BBB C https://docs.beagleboard.org/latest/boards/beaglebone/black/ch02.html I found one, going to try on BBB RevC

zackbcom commented 1 week ago

I've tried with 5 BBB. 4 are the PCB RevB6 and one PCB RevC

  1. Flashed SD card with FPP BBB 8.0
  2. image
  3. first boot, just see this double blink every second. Not pulling IP

Anything else I could try? I have another SD card reader coming tomorrow to see if that might be the issue.

dkulp commented 1 week ago

That blink is normal. Mine are all doing that as well. The image was created on a RevB6 beagle (just checked) so it shouldn't be that. Everything looks normal from the lights. I would double check your network to see if it's pulling a different IP address or something.

zackbcom commented 1 week ago

I will try my friends network to pull IPs. Yea, it could be related to Unifi switches maybe not liking if there is some Loopback things going on.

Any way to static set ips after flash? Or If I use a USB wifi dongle, does it auto hotspot so I can atleast see if it boots?

zackbcom commented 1 week ago

I think it's related to Unifi / STP/RSTP. I will test another network tonight. After pulling the base image https://rcn-ee.net/rootfs/debian-armhf-12-bookworm-minimal-mainline/2024-08-28/am335x-debian-12.6-minimal-armhf-2024-08-28-2gb.img.xz It still is not grabbing an IP.

trying to follow this https://github.com/FalconChristmas/fpp/blob/master/SD/README.BBB

I tried the new image and it didn't work https://rcn-ee.net/rootfs/debian-armhf-12-bookworm-minimal-mainline/2024-09-04/

darylc commented 1 week ago

Works fine in my unifi network

dkulp commented 1 week ago

Most of the FPP developers (myself included) are on full Unifi networks. Thus, it's not entirely Unifi specific and has to be something unique to their setup.

darylc commented 1 week ago

If you can, hook up a ttl serial console to the beaglebone and see what is really going on

zackbcom commented 1 week ago

I think it's probably related to this. On my switch I don't see packets going to the beagle.

https://forum.beagleboard.org/t/beagleplay-wired-ethernet-doesnt-receive-packets/38994

zackbcom commented 1 week ago

I'll attach to the console today and verify.

zackbcom commented 1 week ago

I attached to the TTY. No caped Attached Same Card can flash FPP 7.5 and works.

  1. Flashed new San Disk High Endurance 64GB U3 with FPP 8.0 using raspberry pi imager to pull image
  2. put sd card in
  3. started BBB with TTY conenction
  4. View logs.
U-Boot SPL 2022.04-gbaca7b46 (Jan 15 2024 - 19:59:28 +0000)
Trying to boot from MMC2

U-Boot 2022.04-gbaca7b46 (Jan 15 2024 - 19:59:28 +0000)

CPU  : AM335X-GP rev 2.1
Model: TI AM335x BeagleBone Black
DRAM:  512 MiB
Reset Source: Global external warm reset has occurred.
Reset Source: Power-on reset has occurred.
RTC 32KCLK Source: External.
Core:  150 devices, 14 uclasses, devicetree: separate
WDT:   Started wdt@44e35000 with servicing (60s timeout)
MMC:   OMAP SD/MMC: 0, OMAP SD/MMC: 1
Loading Environment from EXT4... ** File not found /boot/uboot.env **

** Unable to read "/boot/uboot.env" from mmc0:1 **
Board: BeagleBone Black
<ethaddr> not set. Validating first E-fuse MAC
BeagleBone Black:
BeagleBone Cape EEPROM: no EEPROM at address: 0x54
BeagleBone Cape EEPROM: no EEPROM at address: 0x55
BeagleBone Cape EEPROM: no EEPROM at address: 0x56
BeagleBone Cape EEPROM: no EEPROM at address: 0x57
Net:   eth2: ethernet@4a100000, eth3: usb_ether
Press SPACE to abort autoboot in 0 seconds
board_name=[A335BNLT] ...
board_rev=[00C0] ...
switch to partitions #0, OK
mmc0 is current device
SD/MMC found on device 0
Couldn't find partition 0:2 0x82000000
Can't set block device
Couldn't find partition 0:2 0x82000000
Can't set block device
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
Scanning disk mmc@48060000.blk...
Scanning disk mmc@481d8000.blk...
Found 4 disks
No EFI system partition
BootOrder not defined
EFI boot manager: Cannot load any image
gpio: pin 56 (gpio 56) value is 0
gpio: pin 55 (gpio 55) value is 0
gpio: pin 54 (gpio 54) value is 0
gpio: pin 53 (gpio 53) value is 1
switch to partitions #0, OK
mmc0 is current device
gpio: pin 54 (gpio 54) value is 1
Checking for: /uEnv.txt ...
Checking for: /boot/uEnv.txt ...
gpio: pin 55 (gpio 55) value is 1
2074 bytes read in 4 ms (505.9 KiB/s)
Loaded environment from /boot/uEnv.txt
Checking if uname_r is set in /boot/uEnv.txt...
gpio: pin 56 (gpio 56) value is 1
Running uname_boot ...
loading /boot/vmlinuz-6.6.44-fpp16 ...
11719168 bytes read in 744 ms (15 MiB/s)
debug: [enable_uboot_overlays=1] ...
debug: [enable_uboot_cape_universal=1] ...
debug: [uboot_base_dtb_univ=am335x-boneblack-uboot-univ.dtb] ...
uboot_overlays: [uboot_base_dtb=am335x-boneblack-uboot-univ.dtb] ...
uboot_overlays: Switching too: dtb=am335x-boneblack-uboot-univ.dtb ...
loading /boot/dtbs/6.6.44-fpp16/am335x-boneblack-uboot-univ.dtb ...
206153 bytes read in 18 ms (10.9 MiB/s)
Found 0 extension board(s).
uboot_overlays: [fdt_buffer=0x60000] ...
uboot_overlays: loading /boot/dtbs/6.6.44-fpp16/BB-ADC-00A0.dtbo ...
645 bytes read in 5 ms (126 KiB/s)
uboot_overlays: loading /lib/firmware/bbb-fpp-reserve-memory.dtbo ...
1180 bytes read in 10 ms (115.2 KiB/s)
uboot_overlays: loading /boot/dtbs/6.6.44-fpp16/BB-BONE-eMMC1-01-00A0.dtbo ...
1645 bytes read in 5 ms (321.3 KiB/s)
uboot_overlays: uboot loading of [BB-HDMI-TDA998x-00A0.dtbo] disabled by /boot/uEnv.txt [disable_uboot_overlay_video=1]...
debug: [console=ttyS0,115200n8 bone_capemgr.uboot_capemgr_enabled=1 root=/dev/mmcblk0p1 ro rootfstype=ext4 rootwait coherent_pool=1M lpj=1990656 rng_core.default_quality=100 quiet rootwait] ...
debug: [bootz 0x82000000 - 88000000] ...
Kernel image @ 0x82000000 [ 0x000000 - 0xb2d200 ]
## Flattened Device Tree blob at 88000000
   Booting using the fdt blob at 0x88000000
   Loading Device Tree to 8ff6a000, end 8fffffff ... OK

Starting kernel ...

[    1.630046] omap_voltage_late_init: Voltage driver support not added
[    2.023063] debugfs: Directory '49000000.dma' with parent 'dmaengine' already present!
[    2.211202] l3-aon-clkctrl:0000:0: failed to disable
[    2.639780] mmc0: error -110 reading general info of SD ext reg
[    2.645791] mmc0: error -110 whilst initialising SD card
[    3.098120] mmc0: error -110 reading general info of SD ext reg
[    3.104104] mmc0: error -110 whilst initialising SD card
[    3.565420] mmc0: error -110 reading general info of SD ext reg
[    3.571394] mmc0: error -110 whilst initialising SD card
[    4.045548] mmc0: error -110 reading general info of SD ext reg
[    4.051521] mmc0: error -110 whilst initialising SD card
zackbcom commented 1 week ago

All of my SD cards were the San Disk High Endurance 64GB U3. I'm going to try some others. Looks like maybe partition issues?

zackbcom commented 1 week ago

Looks to be an SDCard issue. Works:

Im currently running F3XSwift on the bad sdcard to verify their integrity.

Good logs

U-Boot SPL 2022.04-gbaca7b46 (Jan 15 2024 - 19:59:28 +0000)
Trying to boot from MMC2

U-Boot 2022.04-gbaca7b46 (Jan 15 2024 - 19:59:28 +0000)

CPU  : AM335X-GP rev 2.1
Model: TI AM335x BeagleBone Black
DRAM:  512 MiB
Reset Source: Power-on reset has occurred.
RTC 32KCLK Source: External.
Core:  150 devices, 14 uclasses, devicetree: separate
WDT:   Started wdt@44e35000 with servicing (60s timeout)
MMC:   OMAP SD/MMC: 0, OMAP SD/MMC: 1
Loading Environment from EXT4... ** File not found /boot/uboot.env **

** Unable to read "/boot/uboot.env" from mmc0:1 **
Board: BeagleBone Black
<ethaddr> not set. Validating first E-fuse MAC
BeagleBone Black:
BeagleBone Cape EEPROM: no EEPROM at address: 0x54
BeagleBone Cape EEPROM: no EEPROM at address: 0x55
BeagleBone Cape EEPROM: no EEPROM at address: 0x56
BeagleBone Cape EEPROM: no EEPROM at address: 0x57
Net:   eth2: ethernet@4a100000, eth3: usb_ether
Press SPACE to abort autoboot in 0 seconds
board_name=[A335BNLT] ...
board_rev=[00C0] ...
switch to partitions #0, OK
mmc0 is current device
SD/MMC found on device 0
Couldn't find partition 0:2 0x82000000
Can't set block device
Couldn't find partition 0:2 0x82000000
Can't set block device
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
libfdt fdt_check_header(): FDT_ERR_BADMAGIC
Scanning disk mmc@48060000.blk...
Scanning disk mmc@481d8000.blk...
Found 4 disks
No EFI system partition
BootOrder not defined
EFI boot manager: Cannot load any image
gpio: pin 56 (gpio 56) value is 0
gpio: pin 55 (gpio 55) value is 0
gpio: pin 54 (gpio 54) value is 0
gpio: pin 53 (gpio 53) value is 1
switch to partitions #0, OK
mmc0 is current device
gpio: pin 54 (gpio 54) value is 1
Checking for: /uEnv.txt ...
Checking for: /boot/uEnv.txt ...
gpio: pin 55 (gpio 55) value is 1
2074 bytes read in 4 ms (505.9 KiB/s)
Loaded environment from /boot/uEnv.txt
Checking if uname_r is set in /boot/uEnv.txt...
gpio: pin 56 (gpio 56) value is 1
Running uname_boot ...
loading /boot/vmlinuz-6.6.44-fpp16 ...
11719168 bytes read in 748 ms (14.9 MiB/s)
debug: [enable_uboot_overlays=1] ...
debug: [enable_uboot_cape_universal=1] ...
debug: [uboot_base_dtb_univ=am335x-boneblack-uboot-univ.dtb] ...
uboot_overlays: [uboot_base_dtb=am335x-boneblack-uboot-univ.dtb] ...
uboot_overlays: Switching too: dtb=am335x-boneblack-uboot-univ.dtb ...
loading /boot/dtbs/6.6.44-fpp16/am335x-boneblack-uboot-univ.dtb ...
206153 bytes read in 19 ms (10.3 MiB/s)
Found 0 extension board(s).
uboot_overlays: [fdt_buffer=0x60000] ...
uboot_overlays: loading /boot/dtbs/6.6.44-fpp16/BB-ADC-00A0.dtbo ...
645 bytes read in 5 ms (126 KiB/s)
uboot_overlays: loading /lib/firmware/bbb-fpp-reserve-memory.dtbo ...
1180 bytes read in 9 ms (127.9 KiB/s)
uboot_overlays: loading /boot/dtbs/6.6.44-fpp16/BB-BONE-eMMC1-01-00A0.dtbo ...
1645 bytes read in 6 ms (267.6 KiB/s)
uboot_overlays: uboot loading of [BB-HDMI-TDA998x-00A0.dtbo] disabled by /boot/uEnv.txt [disable_uboot_overlay_video=1]...
debug: [console=ttyS0,115200n8 bone_capemgr.uboot_capemgr_enabled=1 root=/dev/mmcblk0p1 ro rootfstype=ext4 rootwait coherent_pool=1M lpj=1990656 rng_core.default_quality=100 quiet rootwait] ...
debug: [bootz 0x82000000 - 88000000] ...
Kernel image @ 0x82000000 [ 0x000000 - 0xb2d200 ]
## Flattened Device Tree blob at 88000000
   Booting using the fdt blob at 0x88000000
   Loading Device Tree to 8ff6a000, end 8fffffff ... OK

Starting kernel ...

[    1.629887] omap_voltage_late_init: Voltage driver support not added
[    2.023083] debugfs: Directory '49000000.dma' with parent 'dmaengine' already present!
[    2.211464] l3-aon-clkctrl:0000:0: failed to disable
[   20.309568] sh[323]: removed '/etc/ssh/ssh_host_rsa_key.XXXXfliItJ'
[   22.373607] bbbio-set-sysconf[362]: Reading the system configuration settings from /boot/firmware/sysconf.txt
[   22.732262] bbbio-set-sysconf[371]: Could not read from configuration file '/boot/firmware/sysconf.txt': No such file or directory
[   23.055560] bbbio-set-sysconf[382]: Could not write to configuration file '/boot/firmware/sysconf.txt': No such file or directory
[   23.114228] bbbio-set-sysconf[301]: No such file or directory at /usr/sbin/bbbio-set-sysconf line 365.
[FAILED] Failed to start bbbio-set-sysconf.…eBoard Set up system configuration.
Debian GNU/Linux 12 fpp ttyS0

Falcon Player OS Image v2024-09
My IP address: 192.168.2.101

FPP is configured from a web browser. Point your browser at:
http://192.168.2.101 , http://fpp.local , or http://fpp

fpp login:

Trying the bad card again.

U-Boot SPL 2022.04-gbaca7b46 (Jan 15 2024 - 19:59:28 +0000)
Trying to boot from MMC2

U-Boot 2022.04-gbaca7b46 (Jan 15 2024 - 19:59:28 +0000)

CPU  : AM335X-GP rev 2.1
Model: TI AM335x BeagleBone Black
DRAM:  512 MiB
Reset Source: Global external warm reset has occurred.
Reset Source: Power-on reset has occurred.
RTC 32KCLK Source: External.
Core:  150 devices, 14 uclasses, devicetree: separate
WDT:   Started wdt@44e35000 with servicing (60s timeout)
MMC:   OMAP SD/MMC: 0, OMAP SD/MMC: 1
Loading Environment from EXT4... ** File not found /boot/uboot.env **

** Unable to read "/boot/uboot.env" from mmc0:1 **
Board: BeagleBone Black
<ethaddr> not set. Validating first E-fuse MAC
BeagleBone Black:
BeagleBone Cape EEPROM: no EEPROM at address: 0x54
BeagleBone Cape EEPROM: no EEPROM at address: 0x55
BeagleBone Cape EEPROM: no EEPROM at address: 0x56
BeagleBone Cape EEPROM: no EEPROM at address: 0x57
Net:   eth2: ethernet@4a100000, eth3: usb_ether
Press SPACE to abort autoboot in 0 seconds
board_name=[A335BNLT] ...
board_rev=[00C0] ...
switch to partitions #0, OK
mmc0 is current device
SD/MMC found on device 0
Couldn't find partition 0:2 0x82000000
Can't set block device
Couldn't find partition 0:2 0x82000000
Can't set block device
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
libfdt fdt_check_header(): FDT_ERR_BADMAGIC
Scanning disk mmc@48060000.blk...
Scanning disk mmc@481d8000.blk...
Found 4 disks
No EFI system partition
BootOrder not defined
EFI boot manager: Cannot load any image
gpio: pin 56 (gpio 56) value is 0
gpio: pin 55 (gpio 55) value is 0
gpio: pin 54 (gpio 54) value is 0
gpio: pin 53 (gpio 53) value is 1
switch to partitions #0, OK
mmc0 is current device
gpio: pin 54 (gpio 54) value is 1
Checking for: /uEnv.txt ...
Checking for: /boot/uEnv.txt ...
gpio: pin 55 (gpio 55) value is 1
2074 bytes read in 4 ms (505.9 KiB/s)
Loaded environment from /boot/uEnv.txt
Checking if uname_r is set in /boot/uEnv.txt...
gpio: pin 56 (gpio 56) value is 1
Running uname_boot ...
loading /boot/vmlinuz-6.6.44-fpp16 ...
11719168 bytes read in 744 ms (15 MiB/s)
debug: [enable_uboot_overlays=1] ...
debug: [enable_uboot_cape_universal=1] ...
debug: [uboot_base_dtb_univ=am335x-boneblack-uboot-univ.dtb] ...
uboot_overlays: [uboot_base_dtb=am335x-boneblack-uboot-univ.dtb] ...
uboot_overlays: Switching too: dtb=am335x-boneblack-uboot-univ.dtb ...
loading /boot/dtbs/6.6.44-fpp16/am335x-boneblack-uboot-univ.dtb ...
206153 bytes read in 19 ms (10.3 MiB/s)
Found 0 extension board(s).
uboot_overlays: [fdt_buffer=0x60000] ...
uboot_overlays: loading /boot/dtbs/6.6.44-fpp16/BB-ADC-00A0.dtbo ...
645 bytes read in 6 ms (104.5 KiB/s)
uboot_overlays: loading /lib/firmware/bbb-fpp-reserve-memory.dtbo ...
1180 bytes read in 10 ms (115.2 KiB/s)
uboot_overlays: loading /boot/dtbs/6.6.44-fpp16/BB-BONE-eMMC1-01-00A0.dtbo ...
1645 bytes read in 5 ms (321.3 KiB/s)
uboot_overlays: uboot loading of [BB-HDMI-TDA998x-00A0.dtbo] disabled by /boot/uEnv.txt [disable_uboot_overlay_video=1]...
debug: [console=ttyS0,115200n8 bone_capemgr.uboot_capemgr_enabled=1 root=/dev/mmcblk0p1 ro rootfstype=ext4 rootwait coherent_pool=1M lpj=1990656 rng_core.default_quality=100 quiet rootwait] ...
debug: [bootz 0x82000000 - 88000000] ...
Kernel image @ 0x82000000 [ 0x000000 - 0xb2d200 ]
## Flattened Device Tree blob at 88000000
   Booting using the fdt blob at 0x88000000
   Loading Device Tree to 8ff6a000, end 8fffffff ... OK

Starting kernel ...

[    1.629744] omap_voltage_late_init: Voltage driver support not added
[    2.024982] debugfs: Directory '49000000.dma' with parent 'dmaengine' already present!
[    2.213843] l3-aon-clkctrl:0000:0: failed to disable
[    2.637964] mmc0: error -110 reading general info of SD ext reg
[    2.643998] mmc0: error -110 whilst initialising SD card
[    3.096124] mmc0: error -110 reading general info of SD ext reg
[    3.102110] mmc0: error -110 whilst initialising SD card
[    3.562986] mmc0: error -110 reading general info of SD ext reg
[    3.568959] mmc0: error -110 whilst initialising SD card
[    4.043362] mmc0: error -110 reading general info of SD ext reg
[    4.049362] mmc0: error -110 whilst initialising SD card
zackbcom commented 1 week ago

Testing the cards passed. I was able to write and read the full card using F3XSwift

I'm not sure what the real issue is here but these SD cards do not like FPP 8.0. They work with FPP 7.5 San Disk High Endurance 64GB U3 https://www.amazon.com/SanDisk-Endurance-microSDXC-Adapter-Monitoring/dp/B07P3D6Y5B

Probably Related: Some microSD cards aren’t readable on BBAI: mmc0: error -110 whilst initialising SD card

So, not to throw a wrench into this, but in 5.4.x timeframe, TI nuked the ti specific ti,omap4-hsmmc driver and moved to the sdhci-omap driver, mainly as it’s a shared generic sdhci stack.

https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/arch/arm/boot/dts/dra7.dtsi?h=v6.4&id=940293affa7ed7c0bdb1820ecf7a8f12e901d030 8

So, i’d really ‘retest’ on 5.10.x-ti image with those same microSD cards…

image
darylc commented 1 week ago

Looks like people have problem with these SD cards on Pi's and newer kernels too https://forums.raspberrypi.com/viewtopic.php?t=370618 Not sure there is much FPP can do about this one except hope the upstream kernels fix it in time for FPP 9?

zackbcom commented 1 week ago

Yeah that sucks. 7.5 works good. After upgrading, and you have a not supported card, it basically bricks your setup. Maybe we can make sure people are aware of the issue that might happen.

zackbcom commented 1 week ago

Might also be worth mentioning that if we use the Emmc on BBB with 6.1.x kernels, it might become bricked.

Source: Possible eMMC firmware bug or hw issue - recent Seeed Studio BBBs with 6.1.x kernels

darylc commented 1 week ago

@Poporacer Before we close this can you check if theres anything you want to learn for the manual?