Speech to text demo - Githubissues

mit-han-lab / TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

https://mit-han-lab.github.io/TinyChatEngine/

MIT License

634 stars 59 forks source link

Speech to text demo #26

Closed Jiminator closed 10 months ago

Jiminator commented 10 months ago

Summary of Changes

Laptop Speech-to-Speech Demo, mainly with Macbook
Updated README to have appropriate instructions and fixed a few errors.

Key things to note

LlamaGenerate now returns a string instead of a vector of generation ids.
voicechat has not been tested on Windows, and definitely is not compatible with edge GPUs at the moment
voicechat creates a temporary file to store input that does get immediately deleted at the end of the demo

Checklist

[x] I tested the branch on my computer (Macbook M1).
[x] No error nor warning in the console.
[x] I joined a screenshot of developed feature (if applicable). []