simonw / llm-replicate

LLM plugin for models hosted on Replicate
Apache License 2.0
59 stars 6 forks source link

--system flag seems to be ignored #17

Open 0xalpharush opened 1 year ago

0xalpharush commented 1 year ago

Hi, thanks for open sourcing this and writing a blog post on how to use it! I was trying to use llama2 to explain code piped from symbex like symbex BinaryOperation | llm -m llama2 --system "explain this code". It didn't seem to use the -s/--system flag and would repeatedly return:

 Hello! I'm here to help you with any questions or issues you have about the code you're working on. What can I assist you with today? Do you have a specific question or task in mind that you'd like me to help you with?

It seems that symbex BinaryOperation | llm -m llama2 "explain this code" achieves the desired behavior. I would expect the flags to work for llama2 as they do for openAI.