issues
search
evilsocket
/
cake
Distributed LLM and StableDiffusion inference for mobile, desktop and server.
Other
2.4k
stars
124
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Support running Stable Diffusion image generation models using multiple devices
#27
lukewwww
closed
1 week ago
0
request for the second time error details
#26
ddbbcc
opened
1 week ago
0
[Feature request] Will cake be able to train model in the future?
#25
fish4terrisa-MSDSM
opened
2 weeks ago
0
Need support for fine-tuning glm and more fine-tuning models
#24
shenkunlovecoding
opened
2 weeks ago
0
May I ask why I am unable to download the model and use the product through Huggingface
#23
Caesarleee
opened
2 weeks ago
1
Is it possible to use quantized models?
#22
ManuXD32
closed
4 weeks ago
6
Req Support for Llama 3.1
#21
jkfnc
opened
1 month ago
3
Thanks for the FOSS! Suggestion for future possible backends runtimes: Vulkan, OpenCL, SYCL/OpenVino/intel GPU, AMD gpu/ROCm/HIP.
#20
ghchris2021
opened
1 month ago
2
第二次请求会报错
#19
JKYtydt
closed
1 month ago
3
Add support for single model model.safetensors.
#18
yaojunluo
closed
1 month ago
1
Test
#17
just5034
closed
1 month ago
0
Unable to build without CUDA
#16
damnkrat
closed
1 month ago
2
Use hf_hub crate to pull model
#15
b0xtch
opened
1 month ago
1
Standardized Android client
#14
TriDefender
opened
1 month ago
3
Error in model.forward: error in forward batch operation for block
#13
hash-momo
opened
1 month ago
5
Dockerfile support
#12
James4Ever0
opened
1 month ago
2
PTX代码使用了一个不被支持的工具链进行编译
#11
JKYtydt
closed
1 month ago
4
About the reason of having cluster nodes
#10
hafezmg48
closed
1 month ago
3
bug with tokenizer and gibberish output
#9
evilsocket
opened
1 month ago
4
无法找到指定的文件
#8
JKYtydt
closed
1 month ago
9
Inquiries about the possibility of supporting windows systems
#7
longxiaocao
closed
2 weeks ago
3
无法编译成功
#6
wwdhf
closed
1 month ago
1
chore: Update Makefile
#5
b0xtch
closed
1 month ago
3
Questions for Xcode setup for testing/dev
#4
chadbrewbaker
closed
1 month ago
1
Building on ubuntu errors `cuMemAdvise_v2` on cuda 12.1
#3
b0xtch
closed
1 month ago
3
Cross-device mapping
#2
b0xtch
closed
1 month ago
2
update main.rs
#1
b0xtch
closed
1 month ago
0