-
```
#0 0x00007bc0622c6554 in std::_Rb_tree_increment(std::_Rb_tree_node_base const*) () from /lib/x86_64-linux-gnu/libstdc++.so.6
No symbol table info available.
#1 0x00007bc05573e59a in cub::Cac…
-
I'm planning to use `CTranslate2` from Rust with [ctranslate2-rs](https://github.com/jkawamoto/ctranslate2-rs) to create cross platform desktop app for translate multilang offline using `facebook/nllb…
-
I ran the new Llama3 sample script and it seems to be conversing with itself so I think there's a problem with how the prompt is being constructed...See below:
```
You: Hello, how are you doing to…
-
Latest versions of ctranslate2 support CUDA 12 only.
model = faster_whisper.WhisperModel(
File "/usr/local/lib/python3.10/dist-packages/faster_whisper/transcribe.py", line 144, in __init__
…
-
@minhthuc2502 @alexlnkp
**Description**
What type of cache is currently implemented in CTranslate2? Is it static or dynamic? Could we achieve a speed-up if the cache implementation is changed for …
-
import ctranslate2,psutil,os,transformers,time,torch
generator = ctranslate2.Generator("/ct2opt-1.3b",tensor_parallel=True,device="cuda")
tokenizer = transformers.AutoTokenizer.from_pretrained…
-
Hi there! I am trying to compile the project on Windows. I have used the strategy on #3 and it compiled. The issue that I am facing is that the **Translate method never returns**.
I have added seve…
-
When I run the following converter script:
`ct2-transformers-converter --model facebook/nllb-200-distilled-1.3B --quantization float16 --output_dir nllb-200-distilled-1.3B-ct2-float16
`
I now g…
-
Provide option to pass callback function which will be called just like the stream callback to abort the translation if true returned and keep it if false returned
-
It was very promising that faster-whisper actually started, but when audio is being processed, I get this:
INFO:__main__:Ready
INFO:faster_whisper:Processing audio with duration 00:01.530
Could n…