search

yoheinakajima / babyagi

https://babyagi.org/
20.12k stars 2.63k forks source link

Docker image not llama compatible #241

Closed jmtatsch closed 1 year ago

jmtatsch commented 1 year ago

llama-cpp-python==0.1.36 should be added to requirements.txt

babyagi service in docker-compose.yml needs opened up memory limits: ulimits: memlock: -1

francip commented 1 year ago

We shouldn't make llama a requirement for people who are fine with OpenAI only. It's pretty heavy install. :-(

zba commented 1 year ago

We shouldn't make llama a requirement for people who are fine with OpenAI only. It's pretty heavy install. :-(

may be create a separate service ?

zba commented 1 year ago

llama-cpp-python==0.1.36 should be added to requirements.txt

babyagi service in docker-compose.yml needs opened up memory limits: ulimits: memlock: -1

made a docker example here (gpu support)

https://github.com/yoheinakajima/babyagi/issues/275#issuecomment-1720168614