issues
search
mlc-ai
/
mlc-llm
Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
19.23k
stars
1.58k
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[Bug] tvm::runtime::InternalError:
#2994
loekTheDreamer
closed
3 weeks ago
0
[Bug] TVM Unity Compiler Build Errors on Orange Pi 5 Max
#2993
limcheekin
closed
3 weeks ago
2
[Bug] Concurrent requests are being run sequentially on AMD MI60 (gfx906)
#2992
Said-Akbar
opened
1 month ago
1
[Download] Update HuggingFace git clone URL
#2991
MasterJH5574
closed
1 month ago
0
Dont build twice to export cl source code.
#2990
sunzj
closed
1 month ago
0
[Question] tvm errors
#2989
ArpanDhot
closed
3 weeks ago
4
[SLM] Deepseek Multi-GPU support
#2988
tlopex
closed
1 month ago
1
[SERVE][CPP][Android] add native executable program to benchmark models
#2987
pfk-beta
opened
1 month ago
0
Problems encountered while doing Android SDK
#2986
whyshifht
opened
1 month ago
1
[Bug] some questions about build Android app with mlc
#2985
ecccccsgo
opened
1 month ago
3
[Doc] Add quantization documentation
#2984
vinx13
closed
1 month ago
1
[Bug] Running Quick Start Example in Windows gives Error: 'InternalError: Check failed: (it != n->end()) is false: cannot find the corresponding key in the Map and MLCEngine' object has no attribute '_ffi'
#2983
Seoulsim
opened
1 month ago
8
[Bug] FP8 Meta-Llama-3.1-8B-Instruct generates garbage
#2982
fan-niu
closed
1 month ago
10
[Model] Optimize image preprocess for vision model
#2981
mengshyu
closed
1 month ago
3
[Docs] Update the Android APK link in quick start
#2980
mengshyu
closed
1 month ago
0
[Bug] Running Quick Start Example in Windows gives Error: `'MLCEngine' object has no attribute '_ffi'`
#2979
jackuh105
opened
1 month ago
4
[Streamer] Fix UTF-8 handling in streamer
#2978
MasterJH5574
closed
1 month ago
0
[Bug] Llama example inference using Vulkan gives build error
#2977
asfarkTii
opened
1 month ago
2
[Model] Add support for DeepSeek Model
#2976
tlopex
closed
1 month ago
1
Fix discord badge in readme
#2975
sravan1946
closed
1 month ago
0
[Question] Fail to pip install mlc-llm
#2974
xiboliyaxiangjiaojun
opened
1 month ago
7
[Question] instructions for speculative decoding usage
#2973
zhyncs
closed
1 month ago
1
[Model] Add support for DeepSeek-V2 Model
#2972
rickzx
closed
1 month ago
4
[Question] Performance on long sequence
#2971
gabrielolympie
closed
1 month ago
1
'tvm/runtime/packed_func.h' file not found
#2970
mubeenasif01
closed
1 month ago
2
Error with LLVM Configuration on Windows for GPU Inference in mlc-llm
#2969
sreejith-ios
opened
1 month ago
6
[Bench] Update API backend names
#2968
MasterJH5574
closed
1 month ago
0
[Question] Why phi3.5v inference image is much longer than HF
#2967
Liuuuu54
opened
1 month ago
5
InternalError when running llava model
#2966
plufz
opened
1 month ago
6
Is there a stable release?
#2965
plufz
closed
1 month ago
1
Header file of TVM is referred not from `include` but `src`.
#2964
grf53
closed
1 month ago
1
[Bug] ValueError: Unknown model type: rwkv
#2963
haohenggang
opened
1 month ago
1
[Bench] Specialize OpenAI endpoint for backends not supporting debug config
#2962
MasterJH5574
closed
1 month ago
0
[Bench] Support applying chat template
#2961
MasterJH5574
closed
1 month ago
0
[Fix][Bench] Improve determinism and log dump
#2960
MasterJH5574
closed
1 month ago
0
[Metric] Fix the devision-by-zero in spec-decode metrics
#2959
MasterJH5574
closed
1 month ago
0
[Question] Android app related sentence generation
#2958
j0h0k0i0m
closed
2 weeks ago
0
[Docs] Support CUDA 12.3 packages; deprecate 12.1 packages
#2957
MasterJH5574
closed
1 month ago
0
[CI] Update docker image
#2956
MasterJH5574
closed
1 month ago
0
[Question] Please explain how the VRAM mechanism of MLC-LLM works on AMD ROCm 6.1?
#2955
shahizat
closed
1 month ago
1
[SERVE][OPENCL] Pre compiler cache enable for opencl
#2954
krishnaraj36
closed
1 month ago
0
[Serving] Remove draft tokens after finishing request
#2953
vinx13
closed
1 month ago
0
[Serving] Add error message for missing param in the loader
#2952
vinx13
closed
1 month ago
0
[Python] Update dependency for benchmark
#2951
MasterJH5574
closed
1 month ago
0
[CI] Update docker image
#2950
MasterJH5574
closed
1 month ago
0
Fix draft token indices in eagle drafting
#2949
vinx13
closed
1 month ago
0
[Conv] Remove custom from gen_config CONV_TEMPLATES
#2948
CharlieFRuan
closed
1 month ago
0
MADE BY ACCIDENT
#2947
dylan-deepshard
closed
1 month ago
0
[Bench] Fix the dataset truncation
#2946
MasterJH5574
closed
1 month ago
0
[Fix] Deepcopy reqeust when sampling dataset
#2945
cyx-6
closed
1 month ago
0
Previous
Next