Entering recorded data regardless of system layout

EugeneRymarev commented 8 months ago

Expected behavior

Entering recorded data regardless of system layout. If the device contains the entry myemail@mail.com, then enter it that way, even if the current system layout does not match.

Actual behavior

Instead of the expected myemail@mail.com, ьнуьфшд"ьфшдюсщь is entered on the RU layout.

Step by step guide to reproduce the problem

Create a record myemail@mail.com
Set the system to the RU layout or any other that will not coincide with the layout in which the myemail@mail.com entry was entered
Change the current layout to RU (or another selected one)
Manually select this entry on Mooltipass and ask it to enter the data into the controlled device
Firmware Version

AUX MCU version: 0.74 Main MCU version: 0.86 Bundle version: 13 (beta?)

Moolticute Version - If Involved

Operating System

Windows 11
Android 14
Comment

I still can't understand one thing. Why is it that when a device automatically enters a login and password, it enters exactly as it is written in its memory, regardless of the current layout of the controlled device (be it a PC or a phone); and when I manually select a service and ask the device to enter a login and password, does it enter in the current layout? For example, my device enters the email myemail@mail.com as ьнуьфшд"ьфшдюсщь - that is, in the current layout of the managed device RU.

limpkin commented 8 months ago

We are using two different mechanisms to send credentials to the computer. When using the extension, we are using a custom HID channel while when recalling credentials through the device we are using a "keyboard HID" channel. The latter channel uses key positions and not characters (that's the HID standard) so the mini ble needs to be aware of the keyboard layout selected on the computer.

There's therefore no solution for your issue...

On Tue, Oct 17, 2023, 07:04 Eugene Rymarev @.***> wrote:

Expected behavior

Entering recorded data regardless of system layout. If the device contains the entry @.***, then enter it that way, even if the current system layout does not match. Actual behavior

Instead of the expected @.***, ьнуьфшд"ьфшдюсщь is entered on the RU layout. Step by step guide to reproduce the problem

Create a record @.***

Set the system to the RU layout or any other that will not coincide with the layout in which the @.*** entry was entered

Change the current layout to RU (or another selected one)

Manually select this entry on Mooltipass and ask it to enter the data into the controlled device

Firmware Version

AUX MCU version: 0.74 Main MCU version: 0.86 Bundle version: 13 (beta?) Moolticute Version - If Involved Operating System

Windows 11

Android 14

Comment

I still can't understand one thing. Why is it that when a device automatically enters a login and password, it enters exactly as it is written in its memory, regardless of the current layout of the controlled device (be it a PC or a phone); and when I manually select a service and ask the device to enter a login and password, does it enter in the current layout? For example, my device enters the email @.*** as ьнуьфшд"ьфшдюсщь - that is, in the current layout of the managed device RU.

— Reply to this email directly, view it on GitHub https://github.com/mooltipass/minible/issues/413, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABPCNM5FJYOGH3SSPRFVHO3X7YNW5AVCNFSM6AAAAAA6DIIKHKVHI2DSMVQWIX3LMV43ASLTON2WKOZRHE2DMNRRGE2TINI . You are receiving this because you are subscribed to this thread.Message ID: @.***>

EugeneRymarev commented 8 months ago

@limpkin, Why can't change the manual input mechanism to imitate automatic input?

limpkin commented 8 months ago

For the same reason you need a keyboard to type things in your computer..,.

On Tue, Oct 17, 2023, 13:06 Eugene Rymarev @.***> wrote:

@limpkin https://github.com/limpkin, Why can't change the manual input mechanism to imitate automatic input?

— Reply to this email directly, view it on GitHub https://github.com/mooltipass/minible/issues/413#issuecomment-1766281594, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABPCNMZRDID5WIP2NB5LHOTX7ZYDVAVCNFSM6AAAAAA6DIIKHKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONRWGI4DCNJZGQ . You are receiving this because you were mentioned.Message ID: @.***>

EugeneRymarev commented 8 months ago

@limpkin, I don't understand. What's the problem with using custom HID for manual entry? 🤔

limpkin commented 8 months ago

because your program (let's say, notepad) only "listens" to keyboard presses

On Tue, Oct 17, 2023 at 3:09 PM Eugene Rymarev @.***> wrote:

@limpkin https://github.com/limpkin, I don't understand. What's the problem with using custom HID for manual entry? 🤔

— Reply to this email directly, view it on GitHub https://github.com/mooltipass/minible/issues/413#issuecomment-1766387437, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABPCNM7RUFGZLEZSF6CO53LX7Z7RHAVCNFSM6AAAAAA6DIIKHKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONRWGM4DONBTG4 . You are receiving this because you were mentioned.Message ID: @.***>

EugeneRymarev commented 8 months ago

@limpkin, Fine. Let me pose the question a little differently.

Is such an implementation impossible or possible, but requires a lot of labor?

Something tells me that there are no unsolvable problems.

limpkin commented 8 months ago

I don't think it's actually doable to have a software simulate key presses into any open program... but I may be wrong

On Tue, Oct 17, 2023 at 4:19 PM Eugene Rymarev @.***> wrote:

@limpkin https://github.com/limpkin, Fine. Let me pose the question a little differently.

Is such an implementation impossible or possible, but requires a lot of labor?

Something tells me that there are no unsolvable problems.

— Reply to this email directly, view it on GitHub https://github.com/mooltipass/minible/issues/413#issuecomment-1766519141, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABPCNM637EY22RGHKZFBCLTX72HYPAVCNFSM6AAAAAA6DIIKHKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONRWGUYTSMJUGE . You are receiving this because you were mentioned.Message ID: @.***>

EugeneRymarev commented 8 months ago

@limpkin, check Clickermann. That tool from russian developer. Direct download link Main page

limpkin commented 8 months ago

I'm sorry, I don't speak russian. I'm going to close this issue for now as implementing the feature you're requesting requires an external program that could directly requests credentials to the mini BLE.

EugeneRymarev commented 8 months ago

@limpkin, The program includes English. The site can be translated using the built-in translator in the browser. In any case, this is just an example that this is possible.

I can (if I read the documentation) write a simple Python script that will enter any information in any language into any window.

Why need new external program if you already have Moolticute?

limpkin commented 8 months ago

right... it sounds like a feature request for moolticute then :)

mooltipass / minible