soulteary docker-llama2-chat issues

soulteary / docker-llama2-chat

Play LLaMA2 (official / 中文版 / INT4 / llama2.cpp) Together! ONLY 3 STEPS! ( non GPU / 5GB vRAM / 8~14GB vRAM)

https://www.zhihu.com/people/soulteary/posts

Apache License 2.0

525 stars 81 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

如何在容器中把app启动改为api启动

#23 songbotao opened 8 months ago
0
docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

#22 guozhangbin opened 10 months ago
1
请问本地部署好cpu环境小模型后，怎么支持restful的API调用？

#21 gotoeasy closed 10 months ago
2
docker: invalid reference format: repository name must be lowercase

#20 China-First-KY opened 10 months ago
0
OSError: You seem to have cloned a repository without having git-lfs installed

#19 darek-ai opened 10 months ago
0
add one-key-start run.sh

#18 xiagw opened 11 months ago
0
No such file or directory

#17 MistShi closed 11 months ago
0
希望取得联系

#16 JimmyMa99 opened 11 months ago
0
llama2量化后版本加载报错

#15 WheatJH opened 11 months ago
1
【提醒】如果你没有找到 llama2:base 容器镜像

#14 soulteary opened 11 months ago
0
执行bash scripts/make-7b-cn.sh，最终报错ERROR: failed to solve: soulteary/llama2:base: docker.io/soulteary/llama2:base: not found

#13 syusama closed 11 months ago
2
执行bash make-7b-cn.sh时报错

#12 syusama closed 11 months ago
2
可以支持多GPU吗

#11 riverfell opened 11 months ago
0
请问要怎么改docker 网站分享的port 从7860换成其他port

#10 ppkliu closed 11 months ago
1
有支持70b的计划么，想要体验下。

#9 RonanDex closed 11 months ago
0
soulteary/llama2:base not found

#8 songbotao closed 11 months ago
4
Apple M系列 docker 运行出错

#7 lslzl3000 opened 11 months ago
4
scripts/run-13b.sh fails with http 401 from huggingface.co URLs

#6 DrPaulBrewer closed 11 months ago
2
接下来一些计划折腾的事（可以评论提你的想法）

#5 soulteary opened 11 months ago
5
ValueError

#4 logolemon closed 11 months ago
4
报错了，格式有问题

#3 Batmana closed 11 months ago
1
HeaderTooLarge when testing

#2 DYSpider13 closed 11 months ago
1
safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge

#1 g-rabah closed 11 months ago
1