dos panda hangs when setting safety mode

commaai / openpilot

openpilot is an operating system for robotics. Currently, it upgrades the driver assistance system in 275+ supported cars.

https://comma.ai/openpilot

MIT License

49.25k stars 8.99k forks source link

dos panda hangs when setting safety mode #29131

Open somkanae opened 1 year ago

somkanae commented 1 year ago

Describe the bug

I use Honda hrv eHev 2022 (hybrid , radarless) when openpilot engage HDC error show

Provide a route where the issue occurs

1e4baee1aa2687a0|2023-07-22--15-46-12--0

openpilot version

0.9.4

Additional info

No response

sshane commented 1 year ago

User has tried new harness, but pandaStates and can still hang whenever the safety mode is changed (still happens with forced FP and very few multiplexing changes):

1e4baee1aa2687a0|2023-07-22--03-05-42--0

adeebshihadeh commented 1 year ago

The panda seems to be getting flooded with (presumably error) interrupts from bus 1. Can you get a route on master or master-ci? We have some new logging that would be helpful here.

sshane commented 1 year ago

Have a recent route here, anything added since then? 1e4baee1aa2687a0|2023-07-23--15-39-57

eFiniLan commented 1 year ago

1e4baee1aa2687a0|2023-08-10--21-21-37 this is on the master w/ "enable openpilot" off

sshane commented 1 year ago

@briskspirit have you checked this out?

sshane commented 1 year ago

@briskspirit any updates? user is still experiencing this. let me know if you need a more recent commit

cached fingerprint (changing safety modes less): 1e4baee1aa2687a0|2023-09-15--07-39-34--0

briskspirit commented 1 year ago

I don't see any error flooding from CAN cores. Something else hangs panda (inside IRQ call) for that brief second. we need at least figure out which interrupt it hangs in. I will work on test branch for him today. @sshane might need your help on OP side.

sshane commented 1 year ago

@somkanae can you give this branch a try and report back?

https://github.com/commaai/openpilot/tree/issue_29131

Installer URL: https://installer.comma.ai/commaai/issue_29131

somkanae commented 1 year ago

After I installed op shown Car Unrecognized

1e4baee1aa2687a0|2023-09-16--14-59-37--0

https://connect.comma.ai/1e4baee1aa2687a0/1694851179455/1694851840182

sshane commented 1 year ago

Dashcam is expected since your car isn't supported yet, and this is a branch based on master.

@briskspirit hmm can and pandaStates still drop out during fingerprinting.

sshane commented 11 months ago

@briskspirit can you check out the new route on master? Same issue with your logging 1e4baee1aa2687a0|2023-09-16--14-59-37

briskspirit commented 11 months ago

@sshane updated my panda branch to also report longest execution time for IRQ. Seems like in this case it isn't rate issue but execution time of some handler. You need to update your fork.

sshane commented 11 months ago

@somkanae Hi, I updated the issue branch. Please pull, update submodules and try again!

somkanae commented 11 months ago

S__110067725_0 S__110067728_0 S__110067730_0 S__110067731_0 @sshane After I installed issue branch Openpilot still unrecognized.