ESP Home continuously failing after unpacking Installing platformio/framework-espidf @ ~3.40405

Krispkiwi commented 12 months ago

The problem

I've been attempting to add a bluetooth proxy to ESPHome however when I press the install, I can never get it to complete the job. It keeps failing at "Installing platformio/framework-espidf @ ~3.40405." after reaching 100% on unpacking, the window falls to a "retry" state.

When pressing retry I then get the error "MissingPackageManifestError: Could not find one of 'package.json' manifest files in the package"

I've been able to replicate this on multiple HA installs. Reinstalling ESP Home fixes the missing package just to fall back to the original issue again.

Which version of ESPHome has the issue?

2023.8.3

What type of installation are you using?

Home Assistant Add-on

Which version of Home Assistant has the issue?

2023.9

What platform are you using?

ESP8266

Board

No response

Component causing the issue

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

No response

Additional information

No response

Krispkiwi commented 11 months ago

Steps I've taken to try to troubleshoot so far: Trying a brand new home assistant instance on the same device Turning on and off my adguard to test if that was the issue Running a new HA instance on a VM and trying on that Giving network access to the WiFi its on Deleting the ESP folder so it needs to redownload it on a new install after uninstalling.

Seems to be addon related.

ys112 commented 11 months ago

+1 here facing the same issue installing platformio/framework-arduinoespressif32 @ ~3.20005.0, I got stuck at unpacking too. No luck with reinstalling and updating my pi.

Krispkiwi commented 11 months ago

+1 here facing the same issue installing platformio/framework-arduinoespressif32 @ ~3.20005.0, I got stuck at unpacking too. No luck with reinstalling and updating my pi.

Glad I'm not the only one, I've asked a few places and no one seems to have any idea what's going on.

Krispkiwi commented 11 months ago

+1 here facing the same issue installing platformio/framework-arduinoespressif32 @ ~3.20005.0, I got stuck at unpacking too. No luck with reinstalling and updating my pi.

Just doing some testing via windows powershell esphome now, it might have worked?? Just getting a second opinion because I've never done it this way before.

ys112 commented 11 months ago

@Krispkiwi you mean manually flashing using windows powershell?

I tried downgrading add-on versions and esp32 platform versions but seems like something is wrong with the installing of the framework.

Krispkiwi commented 11 months ago

@Krispkiwi you mean manually flashing using windows powershell?

I tried downgrading add-on versions and esp32 platform versions but seems like something is wrong with the installing of the framework.

Okay this approach has proved to be problematic. I'm not able to update the board the standard way after the latest esphome update.

ys112 commented 11 months ago

Currently I am using window's cmd prompt to compile and OTA. ESPHome addon in HA just would not go past the installing error for some reason even with the newer updates...

wrobelda commented 11 months ago

Same issue here. A simple "Install" -> "Manual download" fails immediately with:

INFO ESPHome 2023.9.1
INFO Reading configuration /config/esphome/blmproxy.yaml...
INFO Generating C++ source...
INFO Compiling app...
Processing blmproxy (board: esp32doit-devkit-v1; framework: arduino; platform: platformio/espressif32@5.4.0)
--------------------------------------------------------------------------------
MissingPackageManifestError: Could not find one of 'package.json' manifest files in the package

Meanwhile the ESP8266 compilation works fine:

INFO ESPHome 2023.9.1
INFO Reading configuration /config/esphome/d1mini.yaml...
INFO Generating C++ source...
INFO Compiling app...
Processing d1mini (board: d1_mini; framework: arduino; platform: platformio/espressif8266@3.2.0)
--------------------------------------------------------------------------------
HARDWARE: ESP8266 80MHz, 80KB RAM, 4MB Flash

So it would appear there's something wrong with some of the packages?

EDIT: I can build esp32-c3-devkitm-1 just fine, but not esp32doit-devkit-v1 nor esp32dev, so it appears that only the ESP32 base variant is affected.

EDIT2: switching to ESP-IDF framework worked for me, though, so at least there's a workaround.

Krispkiwi commented 11 months ago

Same issue here. A simple "Install" -> "Manual download" fails immediately with:
INFO ESPHome 2023.9.1
INFO Reading configuration /config/esphome/blmproxy.yaml...
INFO Generating C++ source...
INFO Compiling app...
Processing blmproxy (board: esp32doit-devkit-v1; framework: arduino; platform: platformio/espressif32@5.4.0)
--------------------------------------------------------------------------------
MissingPackageManifestError: Could not find one of 'package.json' manifest files in the package
Meanwhile the ESP8266 compilation works fine:
INFO ESPHome 2023.9.1
INFO Reading configuration /config/esphome/d1mini.yaml...
INFO Generating C++ source...
INFO Compiling app...
Processing d1mini (board: d1_mini; framework: arduino; platform: platformio/espressif8266@3.2.0)
--------------------------------------------------------------------------------
HARDWARE: ESP8266 80MHz, 80KB RAM, 4MB Flash
So it would appear there's something wrong with some of the packages?

EDIT: I can build esp32-c3-devkitm-1 just fine, but not esp32doit-devkit-v1 nor esp32dev, so it appears that only the ESP32 base variant is affected.

EDIT2: switching to ESP-IDF framework worked for me, though, so at least there's a workaround.

Excuse my ignorance, how did you switch frameworks?

wrobelda commented 11 months ago

Excuse my ignorance, how did you switch frameworks?

https://esphome.io/components/esp32.html#esp-idf-framework

ssieb commented 11 months ago

MissingPackageManifestError: Could not find one of 'package.json' manifest files in the package

@wrobelda that's a different issue. re-installing the addon should fix that one.

ys112 commented 11 months ago

Interestingly I am able to go pass the installing framework issue today and got an error of sh: 1: xtensa-esp32-elf-g++: not found which was fixed by disabling 64bit on pi4

Krispkiwi commented 11 months ago

Mines still failing today.

Krispkiwi commented 11 months ago

Excuse my ignorance, how did you switch frameworks?

https://esphome.io/components/esp32.html#esp-idf-framework

Drat looks like my framework is already esp-idf

DukemFIVE commented 11 months ago

same here, also tried with the esp-idf and ardunio framework Plus after the fail at 100% my HA is extremly slow and laggy

thzzlan commented 9 months ago

I have the same problem. ESPHome fails after unpacking the framework and then HA is extremely slow for a while. The supervisor seems to crash as well but it restarts after some time. I tried the esp-idf and the arduino framework, but both caused ESPHome to fail unpacking.

matthewliut commented 9 months ago

RIP still a problem...

ys112 commented 9 months ago

To shed some hope, you could try using the HA app on your phone to update instead of a PC browser. When I used a PC browser, the compiling always failed at certain points with intensive resource usage on pi4. But when I used the HA app on my phone, I was able to successfully compile and OTA. Weird but it worked.

matthewliut commented 9 months ago

Really?? IL give that a try for sure. I already tried using a vm as well but when compiling it, the supervisor crashed on the vm as well 😭. (It did get to the crash point alot faster tho LOLL)

ssieb commented 9 months ago

How much RAM do you have?

matthewliut commented 9 months ago

How much RAM do you have?

I have a pi4 b with 4gb of ram!

matthewliut commented 9 months ago

To shed some hope, you could try using the HA app on your phone to update instead of a PC browser. When I used a PC browser, the compiling always failed at certain points with intensive resource usage on pi4. But when I used the HA app on my phone, I was able to successfully compile and OTA. Weird but it worked.

Holy fuck this worked first try. Took like 3 minutes too loll. Finally I can make my stupid bed sensor 🤣 But of a pain typing code on the phone too

NikolasRupp commented 9 months ago

Hi has anyone found another solution for this. Having the same Problem

flashvenom commented 9 months ago

Hi has anyone found another solution for this. Having the same Problem

Same here. In a similar thread, the user changed the SD card and that fixed it, so perhaps I need to use a bigger/better SD card on my raspi?

flashvenom commented 8 months ago

Just wanted to update for @NikolasRupp and future readers here. It would appear it was the SD card. I had 30% free, but it was also a very cheap Microcenter micrSD card. Backed up everything, installed HA fresh on a SanDisk sdcard, restored from backup. I also has a few minor upgrades to HA Core, so I did that as well which may have fixed the problem I guess...

But everything is much better now. HA loads way faster and I seem to have way less errors... EspHome is compiling as intended...

alexcf commented 4 months ago

For those who have this issue, delete the packages folder in your platformio folder. https://github.com/esphome/issues/issues/4272

ELKER54 commented 4 months ago

Even after deleting the packages folder I still cannot install it. Keep getting the error: InvalidJSONFile: Could not load broken JSON: /root/.platformio/packages/framework-arduinoespressif32/.piopm

esphome / issues