ivrit-ai / ivrit.ai

ivrit.ai codebase
MIT License
24 stars 9 forks source link

Automatically Generate Faster-Whisper and GGML Models from HuggingFace Whisper Model #36

Open yairl opened 2 months ago

yairl commented 2 months ago

Implement a utility that will automatically generate both models from a HF whisper model.

yanirmr commented 1 month ago

Is your feature request related to a problem? Please describe. Currently, generating faster-whisper and GGML models from an HF whisper model requires manual steps, which can be time-consuming and error-prone. Automating this process would streamline model generation and reduce the potential for mistakes.

Describe the solution you'd like Implement a utility that automatically generates both faster-whisper and GGML models from an HF whisper model. This utility should be able to take an HF whisper model as input and produce the corresponding faster-whisper and GGML models with minimal user intervention.

Describe alternatives you've considered An alternative solution could be to create detailed documentation and scripts that guide users through the manual process of generating these models. However, this would not be as efficient or user-friendly as an automated utility.

Additional context Automating the model generation process will require changes to the backend infrastructure to support the conversion and generation of these models. This feature will significantly improve workflow efficiency and ensure consistency in model generation.