A suggestion would be to add support for Faster Whisper, which is much faster and uses much less VRAM than Whisper. You can use the Whisper Large V2 model and only use 4.6GB VRAM instead of the original 10GB. If you can add this, it will be very useful for the community.
A suggestion would be to add support for Faster Whisper, which is much faster and uses much less VRAM than Whisper. You can use the Whisper Large V2 model and only use 4.6GB VRAM instead of the original 10GB. If you can add this, it will be very useful for the community.