-
**Describe the bug**
`fatal error: cuosd.h: No such file or directory`, while `cuosd.h` is needed [here](https://github.com/CVCUDA/CV-CUDA/blob/release_v0.3.x/tests/cvcuda/system/OsdUtils.cuh#L21).
…
-
**Describe the bug**
When trying to use the mean() function on a cudf.core.groupby.groupby.DataFrameGroupBy object, a 'RuntimeError: Failed to deserialize program' is thrown
**Steps/Code to reprod…
-
## 🐛 Bug
I do the model compile as following the sample from https://mlc.ai/mlc-llm/docs/compilation/compile_models.html, and happen the LLVM ERROR: Broken function
Is it because of LLVM issue?
…
-
## 🐛 Bug
InternalError when converting starcoderbase from HuggingFace
Error msg:
> zguo@HQ-N7QDT262TG:/Users/zguo/workplace/mlc-ai/mlc-llm$python3 build.py --hf-path bigcode/starcoderbase --…
-
## 🐛 Bug
When running the model produced by `python3 -m mlc_llm.build --hf-path meta-llama/Llama-2-7b-chat-hf --target webgpu --quantization q4f32_1` on the web I get `Init error, GPUPipelineError:…
-
## 🐛 Bug
I'm compiling LLama-13b-hf model with MLC-LLM ROCm backend and found that the compiled model outputs different value each time. We found that the error was introduced mainly from matmul op…
-
**Description**
My issue is fairly similar to this [one](https://github.com/triton-inference-server/server/issues/5920).
After a few hours of consecutive successful inference one of my python mod…
-
## 🐛 Bug
I set up mlc-llm and tried to compile [Orca-Mini 3B](https://huggingface.co/pankajmathur/orca_mini_3b). I am getting the following error:
```
(myenv) aadarsh@AAD-HPLAP:~/src/mlc-llm$ p…
-
### bug描述 Describe the Bug
docker run --name paddle-test -v $PWD:/paddle --network=host -it registry.baidubce.com/paddlepaddle/paddle:latest-dev /bin/bash
cmake .. -DPY_VERSION=3.7 -DWITH_GPU=OFF
…
-
While trying to find methods to improve models, one of the things to look into was merging and hopefully the below discoveries are valuable in helping improve/provide additional options for merging.
…