-
Can any colleague help with the example of interference with the Gemma model in CTranslate2? Unfortunately, there is no information about this model in the documentation.
Thx
-
Hi All,
I'm trying to profile the ct2 model on both CPU and CUDA, but I'm unable to see any data output when using the '-DENABLE_PROFILING=ON` flag in `CMakeLists.txt`.
Specifically, I'm trying …
-
My script located here has a basic test now...
[https://github.com/collabora/WhisperSpeech/issues/67](https://github.com/collabora/WhisperSpeech/issues/67)
I'm excited about the concept of rever…
-
Operaring system: Ubuntu 22.04.2, Python 3.10.6, CTranslate2 3.16.
When exporting the bigscience/bloomz model using:
_ct2-transformers-converter --force --model bigscience/bloomz --output_dir …
-
Issue Description:
When utilizing the 'medium' model, it has come to my attention that certain medical terms may not be transcribed accurately. For instance:
"Amoxicillin" is transcribed as "Amoxani…
-
```python
from basaran.model import load_model
model = load_model('mosaicml/mpt-7b-storywriter', trust_remote_code=True, load_in_8bit=True,)
for choice in model("once upon a time"):
print…
-
I like the idea but it needs more work on execution to be useful IRL.
I would like to see:
- [ ] Switch transcription engine to [faster-whisper](https://github.com/SYSTRAN/faster-whisper) (a re-…
-
How can I convert https://huggingface.co/primeline/whisper-large-v3-german to be used with faster-whisper?
Also, can faster-whisper use safetensors and can I convert the above to it?
EDIT: Whe…
-
Thank you for creating this amazing library.
But there is a small issue when I follow this link: https://huggingface.co/michaelfeil/ct2fast-nllb-200-3.3B
It gives me the following error:
File…
-
BLEU calculation occurs only on the CPU, perhaps this is somehow related to the function below
[eval.py#L56C44-L56C44](https://github.com/LibreTranslate/Locomotive/blob/975ef8a73c234d20e1938c806a4…