Option for max_gen_len

[simonw]

This is hard-coded here at the moment: https://github.com/simonw/llm-mlc/blob/afbafe88b35ff1935684bea8c30bac126b3b8772/llm_mlc.py#L305-L308

[simonw]

I thought about calling this -o max_length 100 - but I can't actually find documentation anywhere that confirms exactly what max_gen_len means. So I'm going to stick with the exact term, since then at least if MLC add documentation for it people will be able to find that.

[simonw]

Got it working - seems to do what I would expect:

llm -m Llama-2-7b-chat 'as many names for dogs as possible'

Of course! Here are some fun and creative names for dogs:

1. Max - a classic name that suits any breed of dog.
2. Bella - a beautiful and elegant name for a dog.
3. Duke - a strong and regal name for a dog.
4. Daisy - a sweet and playful name for a dog.
5. Buddy - a cute and affectionate name for a dog.
6. Rocky - a tough and adventurous name for a dog.
7. Luna - a celestial and mystical name for a dog.
8. Charlie - a charming and affable name for a dog.
9. Ginger - a spicy and lively name for a dog.
10. Sammy - a sweet and endearing name for a dog.
11. Toby - a playful and mischievous name for a dog.
12. Maggie - a lovely and affectionate name for a dog.
13. Jack - a strong and rugged name for a dog.
14. Dixie - a fun and lively name for a dog.
15. Cody - a rugged and adventurous name for a dog.
16. Lola - a sassy and playful name for a dog.
17. Jake - a strong and confident name for a dog.
18. Sophie - a beautiful and elegant name for a dog.
19. Cooper - a friendly and outgoing name for a dog.
20. Bailey - a fun and energetic name for a dog.

I hope these names help inspire you to find the perfect name for your new furry friend!

llm -m Llama-2-7b-chat 'as many names for dogs as possible' -o max_gen_len 30

Of course! Here are some names for dogs that are socially unbiased and positive in nature:

1. Max
2. B

llm -m Llama-2-7b-chat 'as many names for dogs as possible' -o max_gen_len 1000

Of course, I'd be happy to help! Here are some names for dogs that you might find interesting:

1. Max - a classic name that suits any breed of dog.
2. Bella - a beautiful name for a beautiful dog.
3. Charlie - a charming name for a friendly dog.
4. Rocky - a strong and adventurous name for a dog with a lot of energy.
5. Duke - a regal name for a dog with a noble personality.
6. Daisy - a sweet and innocent name for a gentle dog.
7. Buddy - a friendly and approachable name for a dog that's always by your side.
8. Ginger - a spicy and lively name for a dog with a fiery personality.
9. Luna - a celestial name for a dog with a mysterious and enchanting personality.
10. Bear - a rugged and powerful name for a dog with a strong and protective nature.
11. Sammy - a cute and affectionate name for a dog that's always happy to see you.
12. Toby - a playful and mischievous name for a dog with a fun-loving personality.
13. Lola - a sassy and confident name for a dog with a bold and outgoing personality.
14. Felix - a happy and energetic name for a dog that's always full of joy and excitement.
15. Jasmine - a delicate and fragrant name for a dog with a graceful and refined personality.
16. Oliver - a handsome and dignified name for a dog with a noble and regal personality.
17. Maggie - a sweet and affectionate name for a dog that's always loyal and loving.
18. Cooper - a friendly and outgoing name for a dog that's always eager to play and have fun.
19. Gracie - a lovely and elegant name for a dog with a gentle and refined personality.
20. Bentley - a sleek and sophisticated name for a dog with a luxurious and high-class personality.

I hope these names help inspire you to find the perfect name for your new furry friend!