commaai / openpilot

openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for 250+ supported car makes and models.
https://comma.ai/
MIT License
48.67k stars 8.82k forks source link

Steering bug: Steering stops working at very low speeds in experimental mode. #26694

Closed dukeajuke closed 1 year ago

dukeajuke commented 1 year ago

Describe the bug

2022 Arteon in experimental mode:

When at very low speeds or often stopping for a stop sign or another car, Openpilot displays a warning "Steering temporarily unavailable" and won't start working again even at higher speeds until the device is rebooted. At the same time, my car displays the message "Take control of the wheel" like it used to with my stock lane keeping.

Provide a route where the issue occurs

200d2fe234e1fef3|2022-12-03--18-50-25

openpilot version

0.9.0

'carFingerprint': 'VOLKSWAGEN ARTEON 1ST GEN',

'gitBranch': 'mqb-fw-dukajuke',
'gitCommit': 'c1524b4b082de8bf9091193c5682b45280ae3105',
'gitRemote': 'https://github.com/jyoung8607/openpilot.git',

Additional info

No response

dukeajuke commented 1 year ago

This is a better example route: 200d2fe234e1fef3|2022-12-03--16-12-04

sshane commented 1 year ago

@jyoung8607 recommended sharing the route with him so he can look into this.

jyoung8607 commented 1 year ago

@dukeajuke, happy to look into this if you're able to temporarily share your device with jyoung8607@gmail.com again, just like you did when we added your fingerprint.

dukeajuke commented 1 year ago

Thanks! I’ll do another drive with the experimental turned on and share it to you. It doesn’t happen at ever time its stops, but it does happen at least once with every drive.

From: Jason Young @.*** Sent: Tuesday, December 6, 2022 1:12 PM To: commaai/openpilot Cc: dukeajuke; Mention Subject: Re: [commaai/openpilot] Steering bug: Steering stops working at very low speeds in experimental mode. (Issue #26694)

@dukeajuke https://github.com/dukeajuke , happy to look into this if you're able to temporarily share your device with @.*** again, just like you did when we added your fingerprint.

— Reply to this email directly, view it on GitHub https://github.com/commaai/openpilot/issues/26694#issuecomment-1339778792 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AEJJEUENHI4VPQTHJY262F3WL56XVANCNFSM6AAAAAASTOY7V4 . You are receiving this because you were mentioned. https://github.com/notifications/beacon/AEJJEUBBB3YFCMWZFLN6WULWL56XVA5CNFSM6AAAAAASTOY7V6WGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTSP3NTOQ.gif Message ID: @.***>

dukeajuke commented 1 year ago

Hi Jason - I shared my device with you. The drive is - 200d2fe234e1fef3|2022-12-07--12-15-05--0. The steering disconnect issue happens at the first light about half way through the drive.

jyoung8607 commented 1 year ago

@dukeajuke, I see where in the drive you encountered the steering fault, but not yet why based on the qlogs (abbreviated logs) that have been uploaded so far. At your convenience, go back to that same route in comma connect, go to Files, and Upload All Logs. That will send up some detailed debug info I need, so long as your device is on WiFi.

dukeajuke commented 1 year ago

Logs should be uploaded now. You can look at my last drive too. It did the same thing but this time in Chill mode. Displays a warning "Steering temporarily unavailable" and it won't start working again until I shut the car off and reboot the device. Thanks in advance for looking at this!

jyoung8607 commented 1 year ago

Checked all three routes mentioned so far and unfortunately the rlogs haven't uploaded for any of them.

@sshane can you make sure these routes are queued for upload? I can't due to commaai/connect#203.

200d2fe234e1fef3|2022-12-03--18-50-25 200d2fe234e1fef3|2022-12-03--16-12-04 200d2fe234e1fef3|2022-12-07--12-15-05

dukeajuke commented 1 year ago

Looks like Those drives have been overwritten already (should have bought more storage!). I’ll do another drive tonight and make sure the logs get updated.

From: Jason Young @.*** Sent: Sunday, December 11, 2022 12:30 PM To: commaai/openpilot Cc: dukeajuke; Mention Subject: Re: [commaai/openpilot] Steering bug: Steering stops working at very low speeds in experimental mode. (Issue #26694)

Checked all three routes mentioned so far and unfortunately the rlogs haven't uploaded for any of them.

@sshane https://github.com/sshane can you make sure these routes are queued for upload? I can't due to commaai/connect#203 https://github.com/commaai/connect/issues/203 .

200d2fe234e1fef3|2022-12-03--18-50-25 200d2fe234e1fef3|2022-12-03--16-12-04 200d2fe234e1fef3|2022-12-07--12-15-05

— Reply to this email directly, view it on GitHub https://github.com/commaai/openpilot/issues/26694#issuecomment-1345611873 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AEJJEUH4XG3A53UCLCLPJATWMYFR7ANCNFSM6AAAAAASTOY7V4 . You are receiving this because you were mentioned. https://github.com/notifications/beacon/AEJJEUGT6ZAJFRR6ZTGGMX3WMYFR7A5CNFSM6AAAAAASTOY7V6WGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTSQGRUGC.gif Message ID: @.***>

dukeajuke commented 1 year ago

The other routes were overwritten already. I just did another drive and the logs have been uploaded. The steering disconnects and errors out at the first light near the last 25% of the drive. - Route: 200d2fe234e1fef3|2022-12-11--17-00-49--0

dukeajuke commented 1 year ago

17:05:13 is about where the steering error occurs.

jyoung8607 commented 1 year ago

It looks like your EPS doesn't want to see steering commands below 1 km/h. It also looks like your EPS is something new-to-us. There's an obvious difference in reported software part numbers, and a less obvious variance in its diagnostic response that makes me think it runs a different software stack than our usual. Fortunately, they should be easy to identify.

It looks like you're still running your temporary fingerprint update branch, so I've taken the liberty of pushing an update to that branch which prevents steering below 0.3 m/s (1.08 km/h). Please give that a try at your convenience.

Whether it works or not, please report back with your results. The change I've put in is more of a diagnostic measure than a final fix. If it works well, I'll add detection for this firmware to upstream openpilot. If not, I'll need to see logs again.

dukeajuke commented 1 year ago

Thanks! I'll give it a try tomorrow. I do need to reinstall that branch to get the update correct?

jyoung8607 commented 1 year ago

Your device should already see the update and prompt you to install it from the UI. If it doesn't, go to Settings and then Software to manually check for updates. On the off chance that process doesn't work for you, yes you could reinstall.

dukeajuke commented 1 year ago

Looks like it updated automatically overnight. The change you made did fix my steering problem! Thanks again for all your help.

dukeajuke commented 1 year ago

Do you know if this change and the one you made to add my car's fingerprint will make it into the next release?

jyoung8607 commented 1 year ago

I'm glad the change worked for you. Re: the fingerprint, that was merged long ago and will be in the next release. Re: the steering fix, I'm still considering how best to fix it in mainline openpilot. It may be a couple days before I file a PR. This GitHub issue will remain open for now, so you can watch it for updates.

otaviobonder-deel commented 9 months ago

I'm running sunnypilot but I'm having the exact same issue. @jyoung8607 which file is responsible for tweaking this? I want to check it in sunnypilot to see if I can fix it.

Also, how can I check if my fingerprint is correct? I'm running in a 2023 VW Taos

stevenaa123isme commented 8 months ago

Hi @jyoung8607. Same here on a 2022 Q3. I finger printed the car myself. Just to reiterate the issue, once "Steering temporarily unavailable" shows up, it never gets cleared until i restart the car.

dukeajuke commented 8 months ago

Yep. Still happens on mine. Usually occurs at very low speeds.


From: stevenaa123isme @.> Sent: Monday, October 16, 2023 2:54 PM To: commaai/openpilot @.> Cc: David Whapham @.>; Mention @.> Subject: Re: [commaai/openpilot] Steering bug: Steering stops working at very low speeds in experimental mode. (Issue #26694)

Hi @jyoung8607https://github.com/jyoung8607. Same here on a 2022 Q3. I finger printed the car myself. Just to reiterate the issue, once "Steering temporarily unavailable" shows up, it never gets cleared until i restart the car.

— Reply to this email directly, view it on GitHubhttps://github.com/commaai/openpilot/issues/26694#issuecomment-1765095650, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEJJEUAYQRFWSZH3EPTTIQDX7V7GTAVCNFSM6AAAAAASTOY7V6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONRVGA4TKNRVGA. You are receiving this because you were mentioned.Message ID: @.***>