Default session names with / try to create directories.

[stephenwithav]

<s>[INST] Explain emacs. [/INST] attempts to create a directory in ellama-sessions because of the/ in [/INST].

Replacing / with underscores in ellama-session-file will prevent that.

Should I submit a PR with that slight ellama-generate-name refactor?

[s-kostyaev]

Sure. Have you signed FSF papers?

[s-kostyaev]

Why you send template into ollama? It should be filled on ollama side. Or you use another llm provider?

[stephenwithav]

I use Ollama. I watched this video on Prompt-Engineering for Open-Source LLMs and it mentioned using that structure, which worked well with llama2-based models.

[stephenwithav]

For more clarification, I like to test new prompts interactively. Using the <s>[INST][/INST] format appears to provide more consistent responses. After reading an article yesterday, I used the following prompt:

<s>[INST] I will ask you a biochemistry question. You will provide a thorough, step-by-step answer to me as if I were a high-school freshmen currently enrolled in biology. [/INST] </s> Alabama wants to execute a man using nitrogen gas. How would that kill a man? Provide a step-by-step explanation.

That provided a more concise answer than without the tags.

[s-kostyaev]

You can create new ollama model with this prompt template and use it with ellama. See modelfile documentation of ollama.

[stephenwithav]

Yes, I'm familiar with that. My thought is this change will make it easier to iterate on prompts when designing new ones.

[s-kostyaev]

Sure, we need this change. Case just looks strange to me

[stephenwithav]

Thanks. This will also prevent errors in filenames like either/or, true/false, yes/no, etc.