search

bcc-code / bcc-media-tools

[BCC Media]
https://tools.bcc.media/
0 stars 0 forks source link

Replace specific phrases from automatic transcription #43

Open mulundapm opened 1 month ago

kkuepper commented 1 month ago

@KillerX Does this include providing a prompt to whisper (as Mark Kloosterman suggested)?

KillerX commented 1 month ago

To be honest, I have absolutely no clue what he means by that as the whisper model does not take any prompts. OpenAI is probably running some kind of multimodal GPT version on the side/before/after, but in essence that statement just does not apply here.

What the issue is about is just good old string search and replace.

kkuepper commented 1 month ago

https://cookbook.openai.com/examples/whisper_prompting_guide https://github.com/openai/whisper/blob/main/whisper/transcribe.py#L100

KillerX commented 1 month ago

https://huggingface.co/openai/whisper-large-v3 🤷

KillerX commented 1 month ago

I can spend time moving to the OpenAI implementation but that would make this task 5 at a minimum.