-
I just learned about rust and now am lamenting my decision to write [vkwayland](https://bitbucket.org/cheako/vkwayland/src/master/) in CPP. This project looks to have most everything required to supp…
-
I am trying to cross-compile llama.cpp on x86 platform and move it to run on Android device (Adreno 740). On Android device, vulkan can recognize my device (GPU) but there is an load model error.
…
-
It would be nice to have also a wrapper for the "native" Vulkan backend.
Maybe this [Vulkan python wrapper](https://github.com/EthicalML/vulkan-kompute) could be of some help.
-
### 💭 Description
With the new CUDA driver it will be much easier to run GPU code on NVIDA graphics cards. Because CUDA is proprietary however, it necessarily only supports NVIDIA cards.
To supp…
-
Let me start by saying a big thank you for creating Lapce. It is _phenomenally_ good. I genuinely love it.
## Lapce Version
0.4.2+Nightly.76ed075
## System information
- Fedora Linux 40 (W…
-
**Describe the Issue**
As of 1.71.1 and the addition of rope_factors, newly created GGUFs (Llama3) seem to incur an inference speed hit on specifically Windows ~~and not Linux as far as I can tell.~~…
-
Awesome to see an imgui hook example for Vulkan. This is the only example I could find! 😄
When injecting for Valheim, it appears to inject fine. However the imgui menu is not showing.
![image](…
-
Crashing at startup
[11:16:15.638] |I| [config::init_config]: backend-renderer: Vulkan
[11:16:15.638] |I| [config::init_config]: log-level: Trace
[11:16:15.761] |I| [SDL_main]: Vita3K v0.2.0 3624…
-
Looking through the code it appears that warp sizes are often hardcoded at 32 with some places supporting both 16 and 32. While the vulkan backend recognizes warp sizes of 64 correctly, and uses about…
-
### What happened?
I compiled llamacpp with Vulkan backend. The "rpc-server" binary is linked to libvulkan but it never uses my GPUs. While "llama-cli" is OK.
### Name and Version
version: 33…