issues
search
evilsocket
/
cake
Distributed LLM and StableDiffusion inference for mobile, desktop and server.
Other
2.64k
stars
141
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Qwen2.5-Coder not working `Error: cannot find tensor lm_head.weight` and `panicked at cake-core/src/cake/mod.rs:155:9: not implemented`
#36
malikwirin
opened
1 week ago
1
Cannot load config.json `Error: can't parse /path/to/model/config.json: Error("missing field `hidden_size`", line: 31, column: 1)`
#35
malikwirin
closed
1 week ago
1
Error: cannot find tensor model.layers.0.model.layers.0.self_attn.q_proj.weight
#34
VincentXWD
opened
2 weeks ago
1
docs: update README.md
#33
eltociear
opened
2 weeks ago
0
fix: fix second inference error, update candle version
#32
lucky9-cyou
closed
1 month ago
1
fix: fix second inference error
#31
lucky9-cyou
closed
1 month ago
5
Dockerize cake
#30
derogab
opened
2 months ago
4
build error on compiling with cuda features
#29
venusarathy
opened
2 months ago
3
refactor(core): make protocol endian-aware
#28
shurizzle
closed
3 months ago
0
Support running Stable Diffusion image generation models using multiple devices
#27
lukewwww
closed
3 months ago
0
request for the second time error details
#26
ddbbcc
closed
1 month ago
0
[Feature request] Will cake be able to train model in the future?
#25
fish4terrisa-MSDSM
opened
3 months ago
1
Need support for fine-tuning glm and more fine-tuning models
#24
shenkunlovecoding
opened
3 months ago
0
May I ask why I am unable to download the model and use the product through Huggingface
#23
Caesarleee
closed
1 month ago
2
Is it possible to use quantized models?
#22
ManuXD32
closed
4 months ago
6
Req Support for Llama 3.1
#21
jkfnc
opened
4 months ago
3
Thanks for the FOSS! Suggestion for future possible backends runtimes: Vulkan, OpenCL, SYCL/OpenVino/intel GPU, AMD gpu/ROCm/HIP.
#20
ghchris2021
opened
4 months ago
4
第二次请求会报错
#19
JKYtydt
closed
4 months ago
3
Add support for single model model.safetensors.
#18
yaojunluo
closed
4 months ago
1
Test
#17
just5034
closed
4 months ago
0
Unable to build without CUDA
#16
damnkrat
closed
4 months ago
2
Use hf_hub crate to pull model
#15
b0xtch
opened
4 months ago
1
Standardized Android client
#14
TriDefender
opened
4 months ago
3
Error in model.forward: error in forward batch operation for block
#13
hash-momo
closed
1 month ago
6
Dockerfile support
#12
James4Ever0
opened
4 months ago
2
PTX代码使用了一个不被支持的工具链进行编译
#11
JKYtydt
closed
4 months ago
4
About the reason of having cluster nodes
#10
hafezmg48
closed
4 months ago
3
bug with tokenizer and gibberish output
#9
evilsocket
closed
1 month ago
5
无法找到指定的文件
#8
JKYtydt
closed
4 months ago
9
Inquiries about the possibility of supporting windows systems
#7
longxiaocao
closed
3 months ago
3
无法编译成功
#6
wwdhf
closed
4 months ago
1
chore: Update Makefile
#5
b0xtch
closed
4 months ago
3
Questions for Xcode setup for testing/dev
#4
chadbrewbaker
closed
4 months ago
1
Building on ubuntu errors `cuMemAdvise_v2` on cuda 12.1
#3
b0xtch
closed
4 months ago
3
Cross-device mapping
#2
b0xtch
closed
4 months ago
2
update main.rs
#1
b0xtch
closed
4 months ago
0