xlinx / sd-webui-decadetw-auto-prompt-llm

sd-webui-auto-prompt-llm
MIT License
46 stars 8 forks source link

prompt formatting issue? #6

Closed tazztone closed 2 months ago

tazztone commented 2 months ago

EDIT: looks like i had wrong preset in LM studio. sorry

i get prompts with <|end_of_text|><|begin_of_text|> and even some web links in it. (see code under "content": below) what do i have to change to only have clean prompt output?

[2024-08-18 14:33:23.972] [INFO] [LM STUDIO SERVER] Last message: { role: 'user', content: 'perfect landscape' } (total messages = 2)
[2024-08-18 14:33:24.326] [INFO] [LM STUDIO SERVER] Accumulating tokens ... (stream = false)
[2024-08-18 14:34:01.177] [INFO] [LM STUDIO SERVER] [mlabonne/Hermes-3-Llama-3.1-8B-lorablated-GGUF/hermes-3-llama-3.1-8b-lorablated.Q8_0.gguf] Generated prediction: {
  "id": "chatcmpl-cxuilsm0koosawfsdqrok",
  "object": "chat.completion",
  "created": 1723984403,
  "model": "mlabonne/Hermes-3-Llama-3.1-8B-lorablated-GGUF/hermes-3-llama-3.1-8b-lorablated.Q8_0.gguf",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "Clear blue sky with billowing white clouds, serene forest filled with tall majestic mountains in distance, sun rays hitting the top of mountain creating a golden glow, greenery everywhere, tiny waterfall in foreground cascading down rocks, vibrant flowers blooming along its path, small colorful birds resting on trees branches singing melodious tunes. [100]<|end_of_text|><|begin_of_text|>://trending Keywords: serene landscape, nature paradise, natural beauty, picturesque scenery, perfect harmony, tranquility, majestic mountains, golden hour lighting\n```<|end_of_text|><|begin_of_text|>.Formspring\n\n<|end_of_text|><|begin_of_text|>.ComponentPlacement<|begin_of_text|>\n<|end_of_text|><|begin_of_text|>=\"more\"]<|end_of_text|><|begin_of_text|><|end_of_text|><|begin_of_text|>.\n<|end_of_text|><|begin_of_text|>\n<|end_of_text|><|begin_of_text|>:\n<|end_of_text|><|begin_of_text|>  <h1>Perfect Paradise Landscape</h1>\n<img src=\"https://picsum.photos/800/600\" alt=\"beautiful landscape\">\n<label>In a world of stunning natural beauty, this breathtaking scene is the epitome of perfection. The crystal clear turquoise sea stretches out to the horizon, waves gently lapping at white sandy shores that disappear into"
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 61,
    "completion_tokens": 199,
    "total_tokens": 260
  }
}
xlinx commented 2 months ago

Use my system-ptompt tell LLM dont say anything others in result. And write u need in user prompt, ex a superstar on stage.

Looklike u write user-prompt into sys-prompt.