Workshop: Hello Input HEAJ

[EloiStree]

"Ce sont des étudiants en option Game Design. Ils ont des bases sur Unreal et Unity. L'objectif de ce workshop est de faire imaginer aux étudiants de Game Design des périphériques et des expériences de jeu créatives, hors des sentiers battus : un véritable laboratoire expérimental. Il s’agit de créer des périphériques ludiques, comme une voiture télécommandée avec son circuit, de la réalité augmentée, etc. L’idéal serait qu'ils produisent un livrable à la fin du workshop."

---

Proposition de cours

Version du 06/11/2024

Lundi 18 19 20 /11 de 8h40 à 15h40 :

• Création des inputs
• Simulation des inputs
• Transmission en réseau

Mardi 26/11 de 8h40 à 15h40 :

• L'atelier sera validé après avoir rencontré les apprenants.

Mardi 03/12 de 8h40 à 17h40 :

• Inputs virtuels avec le Quest

---

Note de construction

https://youtu.be/mPTCq3LiZSE

Workshop is going to turn around integer, why ?

• https://github.com/EloiStree/HelloInput/issues/107

For the HEAJ, I am constructing a workshop to learn about how to use Input in for video game.

What are the words to learn:

• HID: #5
• vJoy: #6
• MIDI: #7
• BLE MIDI: #8
• Infrared: #9
• UART: #10
• XInput: #11
  • VigEM https://github.com/EloiStree/HelloInput/issues/239
• PostMessage: #14

Audio

• Spectrogram: #13
• Value Intensity: #29
• AudioMixer: #15

Webcam:

• Webcam Color: #30
• Webcam Microphone : #22
• Vuforia #31
  • AR Core #32
  • Image Target #33

XR specific

• OpenXR: #12

Brain:

• BCI: #17

Muscle:

• Read muscule EMG Capteur: #34

Kinect:

• Kinect Body:
• Kinect Depth:

Open CV:

• Open CV in Unity3D
• Open CV in Python

Unstore:

• Radio Control FM: Arduino Antenna
• Channel FM: FlySky #69
• Channel FM: WheelCar
• 4G to Android Bluetooth RC
• Unity3D: Bluetooth Package.

Hack existing:

• Inside submarine RC
• Inside Stear Car RC
• Inside Double Stick RC
• Inside Xbox RC

Injection:

• Inject in Xbox with adapter
• Inject in Xbox with Xbox App
• Inject in app using Window fake keystoke
• Inject in computer using Arduino
• Inject in computer using Raspberry Pi Pico
• Inject in app using SendMessage
• Inject in app with mouse input
• Inject Android with Scrcopy
• Inject Android with USB Keyboard
• Inject Android with ADB
• Inject Android with BLE Keyboard and Gamepad
• Inject in Unity3D DLL

Hardware:

• XIAO RP2040: #27
• Arduino #35
  • Arduino Uno #37
  • Arduino Leonardo #38
  • Adruino Micro #39
  • Arduino Mega #40
• MicroPython #36
  • Raspbery Pi #42
  • Raspbery Pi Pico #41
  • XIAO RP2040: #27
• Micro Bit: #21
• Makey Makey: #20

Electronic:

• Resistor #46
• Light Sensor #43
• Hall Effect #44
• Button #61
• Infrared Receiver #45
• Touch Sensor #54
• Potentiometer Resistor #59
• Digital Potentiometer Resistor #60
• Pression Sensor #64
• Learn
  • Terminal #66
  • Board #67
• Motor Driver #57
• Step Motor Driver #58
• Sensors Kit #51
  • Temperature Sensor #53
• Crocodile Clip #52
• Relay Solide State #55
• Relay Classic #56
• Piezo Sensor #68
• Capacitive Sensor #65
• Servo Motor: #70

Read about:

• MicroPython: https://micropython.org
• Aduino: https://www.arduino.cc

Unstore:

• Barcode QR reader #50
• NFC Tag Reader #49
• NFC Tag #48

---

Under construction:

• MicroBit to Midi
  • https://github.com/EloiStree/HelloInput/issues/88

[EloiStree]

IID To Actions

• Turn Index Integer to actions:
  • https://github.com/EloiStree/2024_05_14_IntegerIndexDateToRemoteControl.git

[EloiStree]

Found in Archive

• Server to UDP
  • https://github.com/EloiStree/HelloInput/issues/76

[EloiStree]

Must know

• What is a manual IPV4 ?
  • https://github.com/EloiStree/HelloInput/issues/77
  • https://github.com/EloiStree/HelloInput/issues/226

Must Try Elixir (Android)

• Observer all sensor your phone can provide
  • https://play.google.com/store/apps/details?id=com.bartat.android.elixir&hl=en
  • https://github.com/EloiStree/HelloInput/issues/86

[EloiStree]

Video created for workshop

• MicroBit > COM3 >UDP > Unity
  • https://github.com/EloiStree/HelloEloiTeachingVideo/issues/91

Video perferct from the web for the workshop

• Initation à l'Arduino: #219

[EloiStree]

Reminder:

• Talk about:

  • the Roger project
  • Wow remapping (here)
  • AI injection and Input wrote
  • Safe firework (here)
  • Open Macro Input
  • JOMI https://github.com/EloiStree/2020_04_10_JavaOpenMacroInputRuntime
  • XOMI https://github.com/EloiStree/2022_01_24_XOMI
  • JOYMI https://github.com/EloiStree/2023_09_28_PythonUdp2vJoy

• Javascript to local websocket relay

  • Gamepad to Websocket #216
  • Java to Websocket #217

[EloiStree]

If you can create a device HID, Xinput or else. Don't forget that you can hack cheap device that did it:

• https://github.com/EloiStree/HelloInput/issues/163

[EloiStree]

UART / SerialPort Only: Arduino Uno et Nano USB input injection: - Arduino Micro Keyboard + MIDI + Media: Pico XInput USB: - XArduino Micro

• https://github.com/EloiStree/HelloInput/issues/215 BLE gamepad or keyboard : - Feather and ESP32
  • # MIDI: - Arduino Micro or Pico(CircuitPython)
• https://github.com/EloiStree/HelloInput/issues/25 Arcade USB: gp2040-CE
• https://github.com/EloiStree/HelloInput/issues/280 Joystick Simulation: Arduino Leonardo
• https://github.com/EloiStree/HelloInput/issues/279 No code: Generic USB Arcade
  • https://github.com/EloiStree/HelloInput/issues/102 Lot's of Input as UART: Arduino Mega
  • https://github.com/EloiStree/HelloInput/issues/40

[EloiStree]

Command:

• 241

  

https://www.x360ce.com

• 247

[EloiStree]

Micro Controller to integer on UDP

Voir ici https://github.com/EloiStree/HelloInput/issues/245

[EloiStree]

Python you need to know for input injection

• pip install pywin32

  pip3 install pyautogui

import ctypes pip install mido pip install keyboard https://pypi.org/project/keyboard/ import pyxinput https://github.com/bayangan1991/PYXInput?tab=readme-ov-file

[EloiStree]

Connector:

• Audio jack small
• Audio Jack MIDI
• Terminal d'électriciens
• Flat Connector and SJT PH
• ...