CodingTrain / Bizarro-Devin

12 stars 4 forks source link

Testing Whisper with Transformers.js #32

Closed shiffman closed 5 months ago

shiffman commented 5 months ago

Right now this loads from a wav file, it would need to connect to real-time audio and the mic. This may be too difficult to do in node so may want to investigate some other service to do the "speech to text".

shiffman commented 5 months ago

Some leads on how this might work?

https://www.npmjs.com/package/node-record-lpcm16

  audioStream.on('data', async (chunk) => {
    const output = await whisper(chunk);
    console.log('Transcription:', output);
  });