bluerobotics / BlueOS

The open source platform for ROV, USV, robotic system operation, development, and expansion.
https://blueos.cloud/docs/
Other
143 stars 72 forks source link

Sometimes it reverts to factory after manual upload #1600

Open joaoantoniocardoso opened 1 year ago

joaoantoniocardoso commented 1 year ago

Occasionally when I'm using the manual upload to test a PR, BlueOS reverts to the factory version.

patrickelectric commented 1 year ago

From my research it appears that dealing with such files makes BlueOS unable to talk with bootstrap, resulting in a factory reset.

patrickelectric commented 1 year ago

That's not only happening during the manual update process but also on normal use cases. We are getting a number of reports that indicates that is something that is happening in the wild. We should:

joaoantoniocardoso commented 1 year ago

We also need more swap. The following video was recorded during a manual upload:

https://user-images.githubusercontent.com/5920286/234951073-4d0315ce-9384-4840-a8c9-334f4ec3848a.mp4

joaoantoniocardoso commented 1 year ago

We might need to configure the Linux's OOM killer.

We can see here that it is acting:

image

patrickelectric commented 1 year ago

Needs to be tested with Pi 4 2GB version and Pi 3 2GB version as well.

joaoantoniocardoso commented 1 year ago

Today I can only confirm that it is happening on Raspberry Pi 3 w/ 1GB of ram, but when I created this Issue I was using a Pi 4 2GB.

Williangalvani commented 1 year ago

IIRC we tried massively increasing swap with no success we should check exactly what step is loading the file to ram and try to avoid it

joaoantoniocardoso commented 1 year ago

Related to #1503