search

simonw / llm-gguf

Run models distributed as GGUF files using LLM
Apache License 2.0
40 stars 3 forks source link

Collect more examples of models that work #2

Open simonw opened 4 months ago

simonw commented 4 months ago

These could go in the README.

simonw commented 4 months ago

This worked for Gemma:

llm gguf download-model \
  https://huggingface.co/lmstudio-community/gemma-2-27b-it-GGUF/resolve/main/gemma-2-27b-it-IQ4_XS.gguf

2024-07-24T03:34:16 conversation: 01j3hcvfasad0m2x2kbx61zd39

Model: gguf/gemma-2-27b-it-IQ4_XS

Prompt:

ten great names for a pet pelican

Response:

Here are ten great names for a pet pelican, with a mix of playful, majestic, and unique options:

Playful:

  1. Percy: A classic, friendly name that suits a pelican's goofy personality.
  2. Scooper: A fun name referencing their impressive beak.
  3. Captain: For a pelican who rules the roost (or pond!).

Majestic:

  1. Zephyr: Evokes a sense of grace and wind, fitting for their gliding flight.
  2. Orion: A strong, celestial name for a powerful bird.
  3. Caspian: Inspired by the Caspian Sea, where pelicans are found.

Unique:

  1. Pixel: A quirky name for a pelican with unique markings.
  2. Gullliver: A literary reference with a playful twist.
  3. Nereus: The Greek god of the sea, fitting for a water-loving bird.
  4. Juno: The Roman goddess known for her protection, symbolizing the pelican's care for its young.

Ultimately, the best name for your pelican will depend on its personality and your own preferences!

2024-07-24T03:35:09 conversation: 01j3hcvfasad0m2x2kbx61zd39

Model: gguf/gemma-2-27b-it-IQ4_XS

Prompt:

walruses

Response:

Here are ten great names for a pet walrus, keeping in mind their blubbery charm and playful nature:

Cute & Playful:

  1. Blubbers: A classic, adorable name that captures their essence.
  2. Tusk: Simple, strong, and fitting for their prominent tusks.
  3. Waddles: For their endearing, waddling gait.
  4. Nugget: A cute and cuddly name for a smaller walrus.

Majestic & Unique:

  1. Odin: The Norse god of wisdom and war, fitting for a powerful walrus.
  2. Aurora: Inspired by the Northern Lights, reflecting their Arctic home.
  3. Narwhal: A playful nod to their tusk-bearing cousin.
  4. Glacier: A cool and majestic name for a large walrus.

Funny & Quirky:

  1. Sir Tusks-a-Lot: A humorous and memorable name.
  2. Mustache Mike: A fun name highlighting their iconic whiskers.

Remember, the best name for your walrus will depend on its personality and your own sense of humor!

2024-07-24T03:35:58 conversation: 01j3hcvfasad0m2x2kbx61zd39

Model: gguf/gemma-2-27b-it-IQ4_XS

Prompt:

weasels

Response:

Here are ten great names for a pet weasel, capturing their mischievous spirit and sleek agility:

Playful & Mischievous:

  1. Ziggy: Reflects their quick, zigzagging movements.
  2. Bandit: For their sneaky and curious nature.
  3. Slinky: Perfect for their long, slender bodies.
  4. Pipsqueak: A cute name for a small and energetic weasel.

Elegant & Mysterious:

  1. Shadow: Evokes their stealthy and elusive nature.
  2. Whisper: For their quiet and graceful movements.
  3. Raven: A dark and mysterious name fitting their sleek black fur.

Unique & Quirky:

  1. Noodle: A funny name for their long, flexible bodies.
  2. Jinx: For their playful and sometimes troublesome antics.
  3. Flicker: Inspired by their quick, darting movements.

Ultimately, the best name for your weasel will depend on its personality and your own preferences!

simonw commented 4 months ago

https://huggingface.co/lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF

llm gguf download-model \
  https://huggingface.co/lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF/resolve/main/Phi-3.1-mini-128k-instruct-Q8_0.gguf \
  --alias phi3mini128

That's the 3.78GB one.

simonw commented 4 months ago

It worked! It seemed to lose count though, it said it would give me 5 weasel names:

llm chat -m phi3mini128

Chatting with gguf/Phi-3.1-mini-128k-instruct-Q8_0 Type 'exit' or 'quit' to exit Type '!multi' to enter multiple lines, then '!end' to finish

Five great names for a pet pelican

  1. Percy Pelican
  2. Penny the Pelican
  3. Pete the Pelican
  4. Penelope Pelican
  5. Pete the Pelican explain
  6. Percy Pelican: This name is reminiscent of the beloved character from Disney's "The Little Mermaid," which could evoke a sense of adventure and charm, making it suitable for a pet pelican that's playful and loves to explore.
  7. Penny the Pelican: A classic and simple name that's easy to remember, perfect for a pet pelican that's friendly and approachable.
  8. Pete the Pelican: A name that's both unique and memorable, Pete could be seen as a pet pelican with a personality that's friendly and perhaps a bit quirky.
  9. Penelope Pelican: Drawing inspiration from the Greek mythology, this name suggests a pelican with a wise and regal demeanor, perhaps one that's well-traveled or has a mysterious aura.
  10. Pete the Pelican: A more casual and laid-back name, Pete could be a pet pelican that's easygoing and enjoys the simple pleasures of life. do weasels

Certainly! Here are five unique and creative names for a weasel, each with a distinct personality or characteristic:

  1. Whiskers the Weasel: This name emphasizes the weasel's sharp, elongated whiskers, which are a defining feature of the species. It suggests a playful and curious character, perhaps one that's always on the move, exploring its surroundings with a sense of wonder.

  2. Velvet the Weasel: Velvet implies a soft and luxurious texture, which could describe the weasel's sleek fur. This name might be fitting for a weasel that's gentle and has a calm demeanor, perhaps one that enjoys the comforts of its cozy den.

  3. Shadow the Weasel: With a name like Shadow, the weasel could be imagined as a creature of the night, stealthy and elusive, with a mysterious and enigmatic personality.

  4. Gizmo the Weasel: Gizmo suggests a clever and inventive character, perhaps a weasel that's always tinkering with objects or finding creative ways to solve problems.

  5. Luna the Weasel: Luna brings to mind the moon, which could imply a weasel that's nocturnal or has a serene, moonlit presence. This name might suit a weasel that's calm and collected, with a quiet and peaceful nature.

  6. Zephyr the Weasel: Zephyr, meaning a gentle breeze, could describe a weasel that's swift and agile, gliding through the air with ease. This name might be fitting for a weasel that's light on its feet and quick to dart through the underbrush.

  7. Rusty the Weasel: Rusty suggests a weasel with a reddish-brown coat, which is typical of the species. It could also imply a weasel that's experienced and wise, with a weathered appearance that tells tales of many adventures.

  8. Jasper the Weasel: Jasper is a precious stone, which could hint at a weasel with a shiny, vibrant coat. This name might suit a weasel that's bold and vibrant, with a striking appearance that commands attention.

  9. Thorn the Weasel: Thorn evokes the idea of a weasel that's tough and resilient, perhaps one that's survived many challenges and has a rugged, hardy nature.

  10. Mira the Weasel: Mira means "peace" in Spanish, which could describe a weasel that's peaceful and non-aggressive, perhaps one that's well-liked by other animals in its territory.

  11. Breeze the Weasel: Breeze suggests a weasel that's swift and graceful, moving through the air with ease. This name might be fitting for a weasel that's light and nimble, with a carefree spirit.

  12. Patch the Weasel: Patch could refer to the weasel's distinctive patch of fur on its back, or it could imply a weasel that's a bit of a troublemaker, always leaving a mark wherever it goes.

  13. Sable the Weasel: Sable is a dark, rich color, which could describe a weasel with a sleek, dark coat. This name might suit a weasel that's sophisticated and elegant, with a regal bearing.

[...]

simonw commented 4 months ago

... it's got to 101 now, maybe I should cut it off.

simonw commented 4 months ago

weasels

simonw commented 4 months ago

OK, I hit Ctrl+C: https://gist.github.com/simonw/a5e7a9a50788c84410ac540fac916258

simonw commented 4 months ago

Oh interesting, it looks like Phi-3.1 isn't the official name - Microsoft upgraded their Phi-3 model without bumping the version number, and the LM Studio community team renamed it when they released the GGUF: https://huggingface.co/lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF

Though the name was left as Phi-3 in Microsoft's release, this is NOT the same model as before! It features massive improvements across a range of benchmarks, so we've renamed it as Phi-3.1 for clarity.