thewh1teagle / vibe

Transcribe on your own!
https://thewh1teagle.github.io/vibe/
MIT License
1.27k stars 73 forks source link

spelling and sync problems #25

Closed pedroan02 closed 7 months ago

pedroan02 commented 9 months ago

What happened?

The software makes lots of spelling mistakes in Hebrew and occasionally outputs SRT files that are not in sync.

Steps to reproduce

  1. step one...
  2. step two...

What OS are you seeing the problem on?

No response

Relevant log output

No response

thewh1teagle commented 9 months ago

Hello! Can you share sample audio & subtitles? Also, if possible, please report from the button inside the settings of the app, it will allow you to share versions and useful information such as OS versin.

pedroan02 commented 9 months ago

Attached a link to a Dropbox folder containing a sound file + an SRT file for example. You can see in the first sentence 2 spelling errors for a relatively everyday and simple text https://www.dropbox.com/scl/fo/6k672x4rn0ko5afqewvcy/h?rlkey=n0pdiuu1uquzvp7fps1pz6unw&dl=0

Many tanks for the fast response :)

thewh1teagle commented 7 months ago

I checked the srt file + the audio you attached, looks like there's no sync problem, every sentence has the correct timestamps.

Regrading spelling errors - I can see them, and I agree that it should work on such simple words, the model works best for english but on hebrew it's trained on less data. Two things can help:

  1. You can try use new ivrit model
  2. You can try play with the temperature in vibe advanced settings (in the main video, near the transcribe button) and change it between 0.1 to 0.9