qdlmcfresh
commented
3 years ago I wanted to implement this but i cant figure out how to build weylus on windows. I installed wsl and the dependencies there but building ffmpeg and the tsc call always fail ...
So i thought ill at least share my findings.
For Pens windows has an api to create a synthetic pointer device and inject pointer movements.
winapi-rs supports these apis
With winapi-rs the api calls look like this:
use winapi::shared::windef::{HWND, POINT};
use winapi::um::winuser::*;
unsafe {
let syntheticPointerDeviceHandle = CreateSyntheticPointerDevice(PT_PEN, 1, 1)
let mut pointerTypeInfo = POINTER_TYPE_INFO {
type_: PT_PEN,
u: std::mem::zeroed(),
};
// Fill this struct with the information from PointerEvent and call InjectSyntheticPointerInput for every PointerEvent
*pointerTypeInfo.u.pen_info_mut() = POINTER_PEN_INFO {
pointerInfo: POINTER_INFO {
pointerType: PT_PEN,
pointerId: event.pointer_id,
frameId: 0,
pointerFlags: POINTER_FLAG_INRANGE
| POINTER_FLAG_INCONTACT
//| POINTER_FLAG_FIRSTBUTTON
| POINTER_FLAG_PRIMARY,
sourceDevice: 0 as *mut winapi::ctypes::c_void, //maybe use syntheticPointerDeviceHandle here but works with 0
hwndTarget: 0 as HWND,
ptPixelLocation: POINT { x: x, y: y },
ptHimetricLocation: POINT { x: 0, y: 0 },
ptPixelLocationRaw: POINT { x: x, y: y },
ptHimetricLocationRaw: POINT { x: 0, y: 0 },
dwTime: 0,
historyCount: 1,
InputData: 0,
dwKeyStates: 0,
PerformanceCount: 0,
ButtonChangeType: POINTER_CHANGE_NONE,
},
penFlags: PEN_FLAG_NONE,
penMask: PEN_MASK_PRESSURE | PEN_MASK_ROTATION | PEN_MASK_TILT_X | PEN_MASK_TILT_Y,
pressure: event.pressure,
rotation: 0,
tiltX: event.tiltx,
tiltY: event.tilty,
};
InjectSyntheticPointerInput(syntheticPointerDeviceHandle, &pointerTypeInfo, 1);
}
H-M-H
edemaine
Schischu
When having light pressure:
When pressing as hard as possible:
0lm
melwazir
mson1509
vpontikes
Diordany
Right now only the mouse can be controlled, things like pressure or touch events are not handled. I do not run windows myself and thus will most likely not implement this, but if someone else is up to the task here is what needs to be done:
Implement the InputDevice trait: https://github.com/H-M-H/Weylus/blob/master/src/input/device.rs,
send_eventis called on everyPointerEventsent from the browser. ThePointerEventtype is defined in https://github.com/H-M-H/Weylus/blob/master/src/protocol.rs.xandycoordinates of the events are normalized to a range between 0 and 1, have a look at https://github.com/H-M-H/Weylus/blob/master/ts/lib.ts.Once a struct that implements this trait is done (should be in its own file in https://github.com/H-M-H/Weylus/blob/master/src/input/), it has to be instantiated in https://github.com/H-M-H/Weylus/blob/master/src/websocket.rs
setup.Probably useful: