HarikalarKutusu / 3d-voice-chess

A voice driven 3D chess game for learning Voice AI
GNU General Public License v3.0
16 stars 2 forks source link

[FR] Preprocess voice in the client and only send data when spoken #15

Open HarikalarKutusu opened 2 years ago

HarikalarKutusu commented 2 years ago

Currently, all sounds are streamed continuously, which also hogs the server. In a normal chess play there are 30-50 moves * 2 per game in 20-120 minutes. Assuming 30 minutes/game with 40 moves/player and 4 secs per command, that would mean less than 10%.

If we can implement this:

This can be achieved by measuring the sound level/energy with pre-buffering.

One downside to this is: The client will be processing audio continuously, which can be bad for future mobile users in terms of battery usage.