-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.…
-
## Describe the solution you'd like
We propose integrating self-hosted Langfuse, an open-source observability and analytics platform for LLM applications, into our project. This integration would p…
-
### Description
When using LoRA with prompt, it always slower than using LoRA with Load LoRA nodes
although in both case, time taken per step is similar. maybe because load/patching?
### My Setup…
-
For example: `osh -c 'trap "echo hi" EXIT; sleep 1'` should sleep for a second, and then print "hi" to the console. Instead, it prints nothing. This is due to bug in an optimization in `osh -c` (where…
-
Hi, in the protegi paper ("Automatic Prompt Optimization with “Gradient Descent” and Beam Search" 2023) the authors stated that the method was evaluated across 4 NLP benchmark tasks: Jailbreak, Ethos,…
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
-
Let's generalize the [easy_gcg]() code to optimize prompts on a dataset of `(x, y)` pairs, where each `x` is the `question` and `y` is the `answer`.
We want to solve `u := argmax_u E [P(y | u + x)…
-
- [ ] [LMOps/README.md at main · microsoft/LMOps](https://github.com/microsoft/LMOps/blob/main/README.md?plain=1)
# LMOps/README.md at main · microsoft/LMOps
## LMOps
LMOps is a research initiati…
-
Hello everyone, we are seeing slower than expected inference times on one of our CPU node with Intel(R) Xeon(R) Platinum 8362 CPU @ 2.80GHz with following instruction sets:
```
fpu vme de pse tsc…
-
The code throws `google.api_core.exceptions.InvalidArgument: 400 Unable to submit request because candidateCount must be 1 but the entered value was 2. Update the candidateCount value and try again.`…