-
### Your current environment
Using Docker!
### 🐛 Describe the bug
Running v0.5.0 docker image with bitsandbytes quantization gives me the follwoing error:
```
[rank0]: Traceback (most recent ca…
-
## Bug report
**Required Info:**
- Operating System:
- Ubuntu 24.04 (devcontainer)
- Installation type:
- From source
- Version or commit hash:
- rolling, 43198cbfe11c84480b15478f…
-
使用vllm0.4.3跑Qwen2-57B-A14B-Instruct-GPTQ-Int4模型时,直接报错,不知是vllm的问题还是Qwen2的问题,是否因为不支持量化Moe模型?
命令:python -m vllm.entrypoints.openai.api_server --model /data/models/Qwen2-57B-A14B-Instruct-GPTQ-Int4 --m…
-
### Describe the bug
I think `CompletableFuture`s seems to always be on or reverts to the default shared `ForkJoinPool` even if an `Executor` is provided via `FUTURE_COMPLETION_EXECUTOR` when making …
-
### Your current environment
```text
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: RED OS release MUROM (7.3.4) Stan…
vlsav updated
2 hours ago
-
### Description
`assumeIsolated` apparently doesn't understand custom executors, at all. So it lies, in essence, by crashing when in fact the code _is_ executing isolated to the actor.
### Reproduc…
-
### Summary
Pretty trivial C++ program segfaults inside `WasmEdge_VMInstantiate` after `exceeded limit page size`. Reproduced with particular wasm module, pretty big (70MB release build) and complex …
-
### Describe the bug
`ModuleNotFoundError: No module named 'numpy'`
### Steps to reproduce
Follow tutorial
### Model Used
False
### Expected Behavior
Work
### Screenshots and logs
```
test.p…
-
### Self Checks
- [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general).
- [X] I have s…
-
### Describe the feature request
Hi Experts,
I just started working AI/ML stuff recently. Currently trying to run Hugging Face - Optimum model on GPU using DML-EP
Platform: Windows 11
**Mode…