-
Hello. The tools look very interesting but I am having trouble building them properly for a user-level, non-root installation:
```
$ mkdir build
$ cd build
$ export level_zero_DIR=$HOME/.local/i…
-
### How can we reproduce the crash?
Admin D:\bunDb via 🍔Bun v1.1.29
😊 ➜ bun dev
$ bun run src/index.ts
107 | return opts[p] || p;
108 | })
109 | );
110 | tries.push(…
-
### How can we reproduce the crash?
Clone https://github.com/KilianB/BunWorkerCrash and run.
I tried version 1.26 as well as the current canary and both are crashing on windows. Ubuntu works fine.
…
-
Hi, I wanted to ask if the support for Gemma2 models can be added in this binding? Specifically I was trying to load the `gemma2-2b-it` model but wasn't able to because the ModelType enum only support…
-
```
dima@dima-Dell-G15-Special-Edition-5521:~/IdeaProjects/LocalAI$ make BUILD_TYPE=cublas BUILD_GRPC_FOR_BACKEND_LLAMA=ON CUDA_DOCKER_ARCH=all GRPC_BACKENDS=backend-assets/grpc/llama-cpp build
go …
-
Hi,
I am interested to use a draft model as speculative decoding, and the only example I found is: https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/draft_target_model
We use tensorRT LLM (…
-
### Troubleshooting docs
- [X] My problem is not solved in the Troubleshooting docs
### Anaconda default channels
- [X] I do NOT use the Anaconda default channels (pkgs/* etc.)
### How did you ins…
-
### Your Question
I tried ```editor_ui->createObject``` but it crashes the game with exception access violation (EditorUI::createObject + 121 | C:\Users\aceinet\code\LevelEdit\build\bindings\bindings…
-
### Your current environment
docker desktop is used to build the image
### How you are installing vllm
so i am trying to build vllm using the dockerfile in the source code locally but the build fai…
-
We could expose llama.cpp's progress_callback to provide a way to both report progress and cancel model loading via the bindings.
ref #1934