-
### Your current environment
```text
The output of `python collect_env.py`
Collecting environment information...
/home/ubuntu/.local/lib/python3.8/site-packages/torch/cuda/__init__.py:118: UserWar…
-
### 🐛 Describe the bug
I encountered an `AssertionError` when attempting to compile a model using Torch-TensorRT with PyTorch. The error occurs when using a `@property` within the model's forward pas…
-
### Problem Description
Hi ,
My environment config is like this :
OS:
NAME="Ubuntu"
VERSION="24.04 LTS (Noble Numbat)"
CPU:
model name : AMD Ryzen 7 1700X Eight-Core Processor
GPU:
…
zouid updated
1 month ago
-
```
+ cd build/linux-riscv64-normal-server-release/hotspot/linux_riscv_compiler2/generated
+ bash -c '/usr/bin/g++ -DLINUX -D_GNU_SOURCE -DRISCV64 -DPRODUCT -I. -I/home/yansendao/git/riscv-port-jdk8…
-
```
(Unidepth) hygx@DESKTOP-47Q8A9V:~/code/UniDepth$ python ./scripts/demo.py
Triton is not available, some optimizations will not be enabled.
This is just a warning: triton is not available
Torch…
-
### What is the issue?
I have noticed that when GPU VRAM gets near-full, but ollama has decided to load 2 models into VRAM, incoming requests to one model simply stall until the other model pops out …
-
### 🐛 Describe the bug
AMP static shape cpp wrapper
suite
name
thread
batch_size_new
speed_up_new
inductor_new
eager_new
compilation_…
-
```
+ cd build/linux-riscv64-normal-server-release/hotspot/linux_riscv_compiler2/generated
+ bash -c '/usr/bin/g++ -DLINUX -D_GNU_SOURCE -DRISCV64 -DPRODUCT -I. -I/home/yansendao/git/riscv-port-jdk8…
-
Testing would be appreciated for the [1.0 branch](https://github.com/fosslinux/live-bootstrap/tree/1.0) - of all kinds is great, but particularly;
- `chroot` or `bwrap` mode on a variety of Linux s…
-
### Your current environment
### Anything you want to discuss about vllm.
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.4.0+cu121
Is debug…