Closed chiu0602 closed 1 year ago
in scripts/llm_utils.py:grammar, there is a line of code
scripts/llm_utils.py:grammar
grammar = LlamaGrammar.from_file("/home/ruben/Code/Auto-Llama-cpp/grammars/json.gbnf")
The line of code should not read a file with absolute path, but I am not should what should be used instead.
Error is prompt and program terminated. As I use Docker, I need to modify Dockerfile and add the lines below and build the image:
RUN mkdir -p /home/ruben/Code/Auto-Llama-cpp COPY grammars /home/ruben/Code/Auto-Llama-cpp/grammars
The application should be able to build by
docker build -t auto-llama .
And run with
docker run -it --env-file "./.env" -v "<MODEL_PATH>:/models" auto-llama
# Paste your prompt here
Duplicates
Steps to reproduce 🕹
in
scripts/llm_utils.py:grammar, there is a line of codeThe line of code should not read a file with absolute path, but I am not should what should be used instead.
Current behavior 😯
Error is prompt and program terminated. As I use Docker, I need to modify Dockerfile and add the lines below and build the image:
Expected behavior 🤔
The application should be able to build by
And run with
Your prompt 📝