search

rakuri255 / UltraSinger

AI based tool to convert vocals lyrics and pitch from music to autogenerate Ultrastar Deluxe, Midi and notes. It automatic tapping, adding text, pitch vocals and creates karaoke files.
MIT License
283 stars 25 forks source link

Update Whisper? #98

Closed BanCrash closed 1 year ago

BanCrash commented 1 year ago

Hi, a new version of Whisper is available (V3), which seems to be better than V2. Will be updated the project to have support for V3?

rakuri255 commented 1 year ago

We are at the latest. See requirements.txt -> whisperx~=3.1.1 I think you mean the official whisper version from OpenAi. The problem is that they don't provide timestamps for words. The timestamps are for the full sentence.

UltraSinger uses WhisperX for that. It has its flaws but is currently the best what we get.

BanCrash commented 1 year ago

We are at the latest. See requirements.txt -> whisperx~=3.1.1 I think you mean the official whisper version from OpenAi. The problem is that they don't provide timestamps for words. The timestamps are for the full sentence.

UltraSinger uses WhisperX for that. It has its flaws but is currently the best what we get.

Ah, ok, fine then!