-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Community Note
* Please vote on this issue by adding a :thumbsup: [reaction](https://blog.github.com/2016-…
-
I am trying to compile an ONNX (graph below) model using TVM.
![5618520ff3e8817d39d4422c547eaf9](https://github.com/apache/tvm/assets/100203773/0a00c2d4-70e1-4e66-b7ae-96737e30d5b3)
Of course, thi…
-
## 🐛 Bug
I have a bug with a fine-tuned (DORA) Qwen2-0.5B deployed with webllm. Inference always fail with the same error.
Error trace:
background.js:53 thread '' panicked at /home/cfruan/.car…
-
Why does this simple getter function always return an Unsupported item type? I also tested common types like String, and Int but only on returning structs have error.
```
get fun query(index: Int)…
-
Hi,
I'm just trying test out Live LLaVA using the following command:
```
./run.sh \
-e SSL_KEY=/data/key.pem -e SSL_CERT=/data/cert.pem \
$(./autotag local_llm) \
python3 -m local_llm.…
-
@n-berezina-nn, добрый день! Возникла проблема с моделью ```retinaface-resnet50-pytorch``` при запуске скрипта ```inference_tvm_pytorch.py``` выбрасывается следующая ошибка:
```
[ ERROR ] Traceback …
-
### Environment
ubuntu 18.04
llvm 13.0.1
cuda 11.7
TensorRT-8.4.1.5
python3.8.2
### Steps to reproduce
1.build tvm with
USE_CUDA ON、 USE_RELAY_DEBUG ON、 USE_TENSORRT_CODEGEN ON
USE_TE…
-
**rust-analyzer version**: `rust-analyzer version: 0.3.1958-standalone`
**rustc version**: `rustc 1.78.0 (9b00956e5 2024-04-29)`
**editor or extension**: VSCode, rust-analyzer `v0.3.1958`
**r…
-
### Description and goal
Currently BAL, BAPR, TVM300, and TVM430 are modeled the same way. However there's a significant difference between those systems : BAL and BAPR work passively with every ro…
-
## 🐛 Bug
Attempting to run Mixtral 8x7 at q4f16_1 split across 2 16GB GPUs, I get an unhandled cuda error from rccl.
## To Reproduce
Steps to reproduce the behavior:
1. Install MLC-LLM
2. Con…