search

fblissjr / mlx-funbox

mlx and mlx-lm CLI toolbox for my own personal use, and maybe yours too
MIT License
5 stars 1 forks source link

example #1

Closed ehartford closed 3 months ago

ehartford commented 3 months ago

can you please show some examples in the readme?

fblissjr commented 3 months ago

yep, working on it, literally just whipped it together, and finding the cohere prompt template isn't doing what i want.

cat fff.py | python fff.py "Summarize" --temp 0.0 --model ./mlx-community_c4ai-command-r-plus-4bit

fblissjr commented 3 months ago

i hit a deadend for the night - kid time begins. something with piping in the values and there not being a default chat template in the tokenizer.

fblissjr commented 3 months ago

got it working. add_generation_prompt=True for when the chat template is missing in the tokenizer config is what fixed it.

fblissjr commented 3 months ago

uploading new commit