search

soulteary / docker-llama2-chat

Play LLaMA2 (official / 中文版 / INT4 / llama2.cpp) Together! ONLY 3 STEPS! ( non GPU / 5GB vRAM / 8~14GB vRAM)
https://www.zhihu.com/people/soulteary/posts
Apache License 2.0
528 stars 82 forks source link

如何在容器中把app启动改为api启动 #23

Open songbotao opened 9 months ago

songbotao commented 9 months ago

通过容器启动后，我如果想通过api调取模型应该如何处理，是需要将容器进行变更，更改dockerfile中相应的内容么