airockchip rknn-llm issues

airockchip / rknn-llm

Other

417 stars 36 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

模型转换报错： Catch exception when loading dataset

#121 sdrzmgy opened 1 week ago
1
更新驱动v1.1.0时报错！内核是6.1.57

#120 quhanj opened 1 week ago
0
GGML_ASSERT(view_src == NULL || data_size == 0 || data_size + view_offs <= ggml_nbytes(view_src)) failed

#119 sdrzmgy opened 1 week ago
1
一个小建议：skip_special_token应该属于RKLLMInferParam

#118 weitianhan opened 1 week ago
1
Not support ChatGLMForConditionalGeneration!

#117 qin-yuhao opened 1 week ago
1
最新版本驱动0.9.8，多种大模型问答效果很差

#116 Royaler opened 1 week ago
4
跑qwen2.5-0.5B有时候推理结果没有任何内容输出，量化前的qwen2.5-0.5B在PC上跑不存在此问题

#115 Channing-dong opened 2 weeks ago
9
rkllm_run()阻塞问题

#114 lzw12138 opened 2 weeks ago
0
docs: update rkllm_server_demo/README.md

#113 eltociear opened 2 weeks ago
0
Build model failed!模型构建失败！Optimizing model直接Killed

#112 xiangzhangpang opened 2 weeks ago
4
rkllm_api_demo run GGML_ASSERT fail

#111 zoomtechjwq opened 2 weeks ago
0
BERT support?

#110 chenkaijiang opened 3 weeks ago
1
Updated rknpu from 0.9.6 to 0.9.8(orange-pi-6.1-rk35xx.tar.gz)

#109 elcky opened 3 weeks ago
1
What model to use supporting embeddings?

#108 vincenzodentamaro opened 4 weeks ago
1
w4a16 for rk3588

#107 cryi closed 1 month ago
2
Llama 3.2 hallucinating

#106 cryi closed 1 month ago
1
chatglm3无法运行

#105 huaxin233 closed 4 weeks ago
4
rkllm-toolkit version: 1.1.0 Not support MiniCPMV!

#104 drq123456 closed 2 weeks ago
4
Updated rknpu from 0.9.7 to 0.9.8

#103 vincenzodentamaro opened 1 month ago
0
Request for a Python 3.10 Wheel File

#102 FUjr closed 1 month ago
2
RK3588推理MiniCPM-V 2.6(Qwen2 7B)使用Embedding输入时推理结果不正常

#101 happyme531 closed 2 weeks ago
4
GGUF加载模型的精度只支持 'F16', 'Q4_0' ，但所使用 Q4_0 模型的 output.weight 不是 Q4_0 或者 FP16

#100 Morxi closed 1 month ago
1
RK3588推理MiniCPM-V 2.6(Qwen2 7B)当`base_domain_id`设置为非0时`rkllm_init()`段错误

#99 happyme531 closed 1 month ago
3
转换模型时导出失败 / Model Export Failed During Conversion

#98 CallMeMushroom closed 1 month ago
1
What are the optimizations of rknpu-driver version 0.9.6 compared to version 0.9.2 ?

#97 xiehousen opened 1 month ago
1
Containerize rkllm_server_demo

#96 rpersee opened 1 month ago
0
Guide to adapting new models?

#95 kinchahoy opened 2 months ago
2
几个月没更新了，能直接开源嘛？

#94 proxy2008 closed 1 month ago
1
RKNN-LLM Context length expansion

#93 vincenzodentamaro closed 2 weeks ago
1
如果将qwen1.5-0.5的模型进行lora微调，怎么将这个模型转换成rkllm模型

#92 Gooddz1 closed 3 weeks ago
1
python deployment code

#91 openedev opened 2 months ago
3
Is w4a16 supported by rk3588?

#90 vincenzodentamaro opened 2 months ago
6
qwen2.cpp和rkllm的推理例子，将同一个qwen2分别转成对应的模型，rkllm的回答效果很一般

#89 Gooddz1 opened 3 months ago
1
qwen2.cpp和rkllm的推理例子，将同一个qwen2分别转成对应的模型，rkllm的回答效果很一般

#88 Gooddz1 closed 3 months ago
0
LLM in a flash

#87 CatchPig51 opened 3 months ago
0
跑internlm2-chat-1_8b、MiniCPM-2B-sft-bf16、Qwen-1_8B-Chat等模型结果异常

#86 zhangw864680355 opened 3 months ago
6
矩阵乘法算子提交错误 failed to submit!, op id: 0, op name: MatMul, flags: 0x5, task start: 0, task number: 1, run task counter: 0, int status: 0x200

#85 yuunnn-w opened 3 months ago
0
How do I install on rk3588 which is aarch64 and not x86_64?

#84 mrodriguez3313 closed 3 months ago
1
v0.8.8升级v0.9.6后模型初始化卡死

#83 PlanetesDDH opened 3 months ago
0
v0.9.6中模型无法启动

#82 PlanetesDDH closed 3 months ago
0
ERROR: rkllm_toolkit-1.0.1-cp38-cp38-linux_x86_64.whl is not a supported wheel on this platform.

#81 redwolf2019 closed 3 months ago
0
Error: could find any OpenCL devices!

#80 phplpf closed 1 month ago
1
支持模型中qwen2 0.5B的链接指向问题

#79 PlanetesDDH opened 4 months ago
2
RKLLM支持多模态视觉大模型的转换吗

#78 fastfeee closed 4 months ago
0
如何接入anythingllm或fastgpt

#77 aileen5150 opened 4 months ago
1
recommend rkllm_run interface include a version that can directly accept embeddings.，建议rkllm_run接口有能直接接受embedding的版本

#76 shiyu-ren closed 2 weeks ago
3
运行test.py报错

#75 W2333DDD closed 3 months ago
1
Consider Open-Sourcing the Code After Nearly Two Months Without Updates 项目近两个月未更新，建议开源代码

#74 AndySze opened 4 months ago
13
Error compiling kernel

#73 windskyxb opened 4 months ago
0
新手求助：如何更新NPU内核版本至0.9.6

#72 xinyinan9527 opened 4 months ago
9