search

docker / genai-stack

Langchain + Docker + Neo4j + Ollama
Creative Commons Zero v1.0 Universal
4.07k stars 886 forks source link

Pulling ollama model llama2: Error: accepts 1 arg(s), received 10 #91

Open elviego opened 1 year ago

elviego commented 1 year ago

While trying to get GenAI stack up (docker compost up --build) I am getting the error:

genai-stack-pull-model-1 | pulling ollama model llama2 #or any Ollama model tag, gpt-4, gpt-3.5, or claudev2 using http://host.docker.internal:11434 genai-stack-pull-model-1 | Error: accepts 1 arg(s), received 10 genai-stack-pull-model-1 exited with code 1

My .env file is basically (everything else is commented out): LLM=llama2 #or any Ollama model tag, gpt-4, gpt-3.5, or claudev2 EMBEDDING_MODEL=sentence_transformer #or openai, ollama, or aws OPENAI_API_KEY= ##MY-API-KEY>##

Getting the same error for gpt-4 (LLM=gpt-4 and _EMBEDDINGMODEL=openai): genai-stack-pull-model-1 | pulling ollama model gpt-4 #or any Ollama model tag, gpt-4, gpt-3.5, or claudev2 using http://host.docker.internal:11434 genai-stack-pull-model-1 | Error: accepts 1 arg(s), received 10 genai-stack-pull-model-1 exited with code 1

Im running docker in Windows 11.

Any thoughts?

Thank you in advance!

kaad01 commented 11 months ago

I have the same issue. Did you fix it yet?

slimslenderslacks commented 11 months ago

Can you remove the comment from the LLM environment definition line. So that it's just the following. It looks like the environment variable is holding on to the comment for you.

LLM=llama2
debanjansaha-git commented 7 months ago

This issue still persists. Even after removing the comment as @slimslenderslacks from the LLM environment variable, the genai-stack-pull-model container still fails.

genai-stack-pull-model-1 | pulling ollama model gpt-4 #or any Ollama model tag, gpt-4, gpt-3.5, or claudev2, llama2 using http://host.docker.internal:11434 genai-stack-pull-model-1 | Error: one of '--license', '--modelfile', '--parameters', '--system', or '--template' must be specified genai-stack-pull-model-1 exited with code 1

This is the part of the environment file: LLM=llama2

or any Ollama model tag, gpt-4, gpt-3.5, or claudev2, llama2

EMBEDDING_MODEL=sentence_transformer

or google-genai-embedding-001 openai, ollama, or aws, sentence_transformer

jrhoward commented 6 months ago

ok so I just started playing with this.

the problem is this line in chains.py which hard codes model to llama2 :

https://github.com/docker/genai-stack/blob/91917399c413a127fe048b5894a343018a50f98f/chains.py#L32

and this line which takes it from the .env file:

https://github.com/docker/genai-stack/blob/91917399c413a127fe048b5894a343018a50f98f/chains.py#L78

as a quick and dirty test I set in the .env LLM=llama3 and change and changed the hardcoded llama2 to llama3 in chains.py and it worked.