-
Hi,
It is not clear if we need to follow the prompt template for inference using pipeline as mentioned [here](https://github.com/huggingface/blog/blob/main/llama2.md#how-to-prompt-llama-2) or do w…
-
Not sure if it's a bug, or me not understanding how this should work. But let's say I have this basic prompt
Prompt: Beautiful {dog|house}
Negative: ugly
with a specific seed.
And I set that D…
-
I don't think it's correctly handling loras in wildcard prompts in a batch
I have a wildcard file of the following lines:
, TLOK_Asami_Sato, \green eyes\, black hair, main_outfit
, ((yellow ha…
-
**Describe the bug**
After some few prompts, the last one stays "on wait" forever
It must be r…
-
### Self Checks
- [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general).
- [X] I hav…
-
I'm getting OOM errors using adamw8bit on my 16GB 4080 w/32gb system ram now.
It normally doesn't fit in it's vram anyway, but on commit 0005867ba509d2e1a5674b267e8286b561c0ed71 it was able to still …
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
### What would your feature do ?
There is currently no way to take the…
-
**Describe your question/**
Login to Portainer using Authentik
**Relevant info**
Authentik is configured to login with several application (Proxmox, Proxmox Backup Server), that work fine with on…
-
# Problem
At step 10 (`As soon as the "Press the Power Button" screen appears`...), I...
- copy the LB files to my PW4 (f/w 5.16.2.1.1)
- safe unmount from macos (using the eject icon)
- then…
-
Hello, FlexFlow team!
Thank you for your outstanding work! I am attempting to reproduce the experimental results from the paper "SpecInfer: Accelerating Generative Large Language Model Serving with…