search

OpenAgentsInc / workerbee

GPUtopia worker process for client machine
GNU Affero General Public License v3.0
18 stars 8 forks source link

Implement whisper #28

Open gonzafirewall opened 11 months ago

gonzafirewall commented 11 months ago

Implement whisper in worker receive the transcriptions request download file from queenbee because of whisper dependencies sizes need to change the onefile to onedir because else reach 4gb max size to onefile.

here an example how to test with last openai client.

`from openai import OpenAI client = OpenAI(api_key="123", base_url="http://localhost:8000/v1")

audio_file= open("audio.mp3", "rb") transcript = client.audio.transcriptions.create( model="base", file=audio_file ) print(transcript)`

AtlantisPleb commented 11 months ago

Cool, thanks for this.

Having trouble running poetry install on M2 Mac:

  • Installing triton (2.1.0): Failed

  RuntimeError

  Unable to find installation candidates for triton (2.1.0)

Seeing issues like https://github.com/openai/whisper/discussions/683#discussioncomment-4448282 and https://github.com/python-poetry/poetry/issues/8673 -- guessing there's some issue with Triton builds not being available for the Mac platform? Does Triton need to be built separately unless you're on Linux?

gonzafirewall commented 11 months ago

I see that triton dependency were in the project before my changes, but i know that openai-whisper with poetry doesnt work very well. because of that in the build i put poetry run pip install openai-whisper I don't have access to a macbook environment to test it at this time.