-
Tried this out today and it fails on my (ARM) AGX Orin on 22.04/Jetpack 6 due to CTranslate2 missing CUDA support. Docker logs:
```
Traceback (most recent call last):
File "/usr/lib/python3.10/…
-
Hello,
Thanks for the great framework for deploying LLM.
Would it be possible to use a LLM model compiled with the CTranslate2 library?
-
### Project URL
https://pypi.org/project/ctranslate2/
### Does this project already exist?
- [X] Yes
### New limit
50
### Update issue title
- [X] I have updated the title.
###…
-
When running Lean Copilot v1.2.2 with lean4's language v4.8.0-rc2 (standalone, without mathlib), I receive some warnings and an error. I'm running Ubuntu 22.04. Also, thank you in advance for reading …
-
Hi!
I was using it until I got this issue:
```
❯ nix flake update
warning: updating lock file '/home/pol/Code/tmp/my-ollama-flake/flake.lock':
• Updated input 'nixpkgs':
'github:nixos/ni…
-
CPU: Apple M3 Max
![image](https://github.com/myshell-ai/OpenVoice/assets/3955387/70a18f90-a77a-4a20-b465-ad87c1a0ecb2)
can support. mac os m3 cpu mode
-
When running Lean Copilot v1.4.1 with Lean 4's language v4.10.0-rc1 (including mathlib which I imported completely) in more advanced topics, the Lean server crashes. My operating system is Debian GNU/…
-
Hello, everyone.
I am trying to use ctranslate2 on android device.
Hope any ctranslate2 expert to guide on how to use ctranslate2 on android.
maybe we need to cross-compile ctranslate2 for arm.
Bu…
-
## Problem
We am working on analyzing the performance of different layers of a workload and comparing the performance with different backends.
The current issue is that we are running [whisper …
-
Among the backends that we already have, we should consider also ctransformers2 which is high performance: https://opennmt.net/CTranslate2/generation.html besides #796