AndreyPavlenko / Fermata

GNU General Public License v3.0
619 stars 75 forks source link

[Feature Request] Mouse navigation speed & Voice Input to Search or enter #297

Open discoinferno1 opened 1 year ago

discoinferno1 commented 1 year ago

Hi Andrey,

Thank you very much for the good work and contribution.

May I kindly request for faster mouse pointer movement and because right now with Mazda Infotainment Display we have to do multiple pushes to the left right or up down with the rotary dial as it's not a touchscreen. This results in maybe 20-30 nudged on the dial to reach one part of the desired screen location. Secondly, the voice input is an excellent and super accurate feature but could there be a shortcut to launch this ? it would be super helpful for navigation with a non touch screen model. Besides that, it would be effective as well if there is a shortcut button to enter or search after voice input for search..Once again thank you very much for your efforts.

AndreyPavlenko commented 1 year ago

Try this version - https://drive.google.com/file/d/1lYr5T7Hu5DfCvfV3wepajrvRsmjw57d5/view?usp=drive_link . It has some enhancements for the cursor navigation.

For the voice input you can bind a steering wheel button. You can find the key bindings in the ap settings.

FPSUsername commented 1 year ago

I'll add to this. Is it possible to move the cursor by holding the control knob instead of nudging every time?

What about touchpad support (e.g. Audi A3 8V)?

AndreyPavlenko commented 1 year ago

I'll add to this. Is it possible to move the cursor by holding the control knob instead of nudging every time?

https://drive.google.com/file/d/1lYr5T7Hu5DfCvfV3wepajrvRsmjw57d5/view?usp=drive_link

What about touchpad support (e.g. Audi A3 8V)?

Could you send me the log? https://github.com/AndreyPavlenko/Fermata/issues/287#issuecomment-1722471651

FPSUsername commented 1 year ago

Hey Andrey,

Sorry for the late reply, I completely forgot about it. Here's the log. Fermata.log

The issue I'm having with the browser is that the cursor is often invisible, especially when the "touch" operation is happening. There's no blue bounding box around the selected item (like it is when you select items inside AA). This makes it pretty much impossible to use.

AndreyPavlenko commented 1 year ago

Hey Andrey,

Sorry for the late reply, I completely forgot about it. Here's the log. Fermata.log

The issue I'm having with the browser is that the cursor is often invisible, especially when the "touch" operation is happening. There's no blue bounding box around the selected item (like it is when you select items inside AA). This makes it pretty much impossible to use.

Thanks. Unfortunately, I don't see any events from the touchpad in the log. Try this version https://drive.google.com/file/d/1lYr5T7Hu5DfCvfV3wepajrvRsmjw57d5/view?usp=drive_link . If the cursor does not appear, press the back button.

FPSUsername commented 1 year ago

I'm already using that version (you linked it three times by now). The UI is definitely a great improvement over the previous version. I'll try to get a new log tomorrow using your advice.

AndreyPavlenko commented 1 year ago

I'm already using that version (you linked it three times by now).

I've updated it today with a few fixes.

FPSUsername commented 1 year ago

Fermata.log

Here's a new log. The cursor does keep moving when you hold the joystick. The issue is that the cursor hides behind any popup. Popup from the menu (where the browser launch is), popup from google's afwul cookiewall and the URL bar (scrolling in the "selection" mode doesn't select the URL bar.

AndreyPavlenko commented 1 year ago

The issue is that the cursor hides behind any popup.

With popup menu it's a bit more complicated, because it's drawn above the app view.

URL bar (scrolling in the "selection" mode doesn't select the URL bar.

Sorry, didn't get this.

FPSUsername commented 1 year ago

The spot where you'd put in the URL (to browse any website) also renders on top of the cursor.

AndreyPavlenko commented 1 year ago

Try pressing the back button when a popup menu appears and the cursor disappears.

FPSUsername commented 1 year ago

In that case, the selection mode would be active, but it's impossible to navigate through browser popups when there's no active marking shown. The only proper way would be to be able to render the cursor on top of popups.

By the way, is it possible to implement touchpad support? My rotary dial has a touchpad that could be used as a cursor as well.

AndreyPavlenko commented 1 year ago

In that case, the selection mode would be active, but it's impossible to navigate through browser popups when there's no active marking shown.

Could you share a URL of a web page with such a popup.

By the way, is it possible to implement touchpad support?

I didn't find a way how to receive touchpad events.

FPSUsername commented 1 year ago

Could you share a URL of a web page with such a popup.

The home page, Google.

AndreyPavlenko commented 1 year ago

The home page, Google.

When you click on the google search bar, the cursor disappears to allow typing. To make it appear again, press the back button. The cursor should be on top of the popup.

JVKeller commented 11 months ago

@AndreyPavlenko , Are you still working on something to have a pointer or better selection method for non-touch screen displays? I have a Mazda CX-9 which of course has the knob and there's no way to see what you are selection once you're out of the menu.

Maybe there's a way to use the parse the knob turn event as a tab, then it could just highlight the selected link?

Welp, I'm on 1.9.3 and see the update to 1.9.5 and will check that out later!

AndreyPavlenko commented 11 months ago

There were some fixes in 1.9.5, but still there are some issues with pop-up.

fwon2638 commented 9 months ago

Hi Andrey,

Thank you very much for the good work and contribution.

May I kindly request for faster mouse pointer movement and because right now with Mazda Infotainment Display we have to do multiple pushes to the left right or up down with the rotary dial as it's not a touchscreen. This results in maybe 20-30 nudged on the dial to reach one part of the desired screen location. Secondly, the voice input is an excellent and super accurate feature but could there be a shortcut to launch this ? it would be super helpful for navigation with a non touch screen model. Besides that, it would be effective as well if there is a shortcut button to enter or search after voice input for search..Once again thank you very much for your efforts.

Fermata Auto should be working now on your MZD unit - https://www.youtube.com/watch?v=X6qklvaVofw

JVKeller commented 9 months ago

Great job Andrey! I will test it out later today and report back.

On Fri, Jan 12, 2024, 12:32 AM fwon2638 @.***> wrote:

Hi Andrey,

Thank you very much for the good work and contribution.

May I kindly request for faster mouse pointer movement and because right now with Mazda Infotainment Display we have to do multiple pushes to the left right or up down with the rotary dial as it's not a touchscreen. This results in maybe 20-30 nudged on the dial to reach one part of the desired screen location. Secondly, the voice input is an excellent and super accurate feature but could there be a shortcut to launch this ? it would be super helpful for navigation with a non touch screen model. Besides that, it would be effective as well if there is a shortcut button to enter or search after voice input for search..Once again thank you very much for your efforts.

Fermata Auto should be working now on your MZD unit - https://www.youtube.com/watch?v=X6qklvaVofw

— Reply to this email directly, view it on GitHub https://github.com/AndreyPavlenko/Fermata/issues/297#issuecomment-1888461491, or unsubscribe https://github.com/notifications/unsubscribe-auth/AG6GTYXKQSTYUULWZRLUBEDYODDGPAVCNFSM6AAAAAA5DBFWBOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBYGQ3DCNBZGE . You are receiving this because you commented.Message ID: @.***>