Closed ethanzrd closed 1 year ago
Known bugs:
When tested in a Google Colab environment with the large-v2 model, the socket appears to be disconnecting & reconnecting during the model's initialization. This is a behavior I've found to be associated with blocking operations, I will be trying to resolve it by offloading the model's initialization.
The app may occasionally generate a transcription that contains nothing but the same word multiple times, I've yet to understand why. This seems to not be happening in a Google Colab environment.
Edit: The latest commit enhancing responsiveness should fix the first problem. If the problem is indeed caused due to socket timeouts, this should solve it. It should also pave the way to multi-client support which will be explored on July 28th.
It doesn't have to be through Conda. You can also install via other means, e.g. pip install where appropriate).
It's somewhat of an overkill to install Conda for this purpose alone (weight 3GB and installs many things).
Sent via Superhuman ( @.*** )
On Fri, Aug 04, 2023 at 11:12:06, Ethan Zerad < @.*** > wrote:
@.**** commented on this pull request.
In install_playground. sh ( https://github.com/saharmor/whisper-playground/pull/23#discussion_r1284715363 ) :
\ No newline at end of file +cd ../backend
That's what Diart requires:
conda install portaudio pysoundfile ffmpeg -c conda-forge
— Reply to this email directly, view it on GitHub ( https://github.com/saharmor/whisper-playground/pull/23#discussion_r1284715363 ) , or unsubscribe ( https://github.com/notifications/unsubscribe-auth/ABPE22IJKWVBMZ7JIZHHHCLXTU3PNANCNFSM6AAAAAA2YKT4RA ). You are receiving this because you commented. Message ID: <saharmor/whisper-playground/pull/23/review/1563350063 @ github. com>
Changelog:
Client Modifications:
react-mic
withAudioContext
for audio processing.Server Modifications:
Future modifications:
Credits:
Color Your Captions: Streamlining Live Transcriptions With “diart” and OpenAI’s Whisper - This allowed for the well thought-out implementation of Diart and Whisper I've used here. Thanks to Juanma Coria (the creator of Diart)!