-
Great tool and appreciate that you wrote this. I am trying it out and have run into an unexpected behavior.
This is probably best explained in an image, so please see the below image.
Basicall…
-
STR:
1) Close laptop
2) Connect (plug-in via USB-C in my case) the laptop to the external display
3) Turn on the external display
5) Launch the IDE with the plugin
6) Open Dashboard in another ta…
-
### Feature Description
We can add an argument (for example, `--context-shift`, `--no-context-shift`) to enable/disable context shift.
If disabled:
- Requests bigger than context window will re…
-
### System Info
`text-generation-launcher --env:`
```
2024-08-28T05:17:36.254761Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unknown-linux-gnu
Cargo version: 1.79.0
Comm…
-
Hi, thank you for building such a great framework!
I need to be able to generate mutations that will automatically create _id. This functionality already exists but it builds a Mongo ObjectId. I n…
-
Current (as of 2024-09-03) MS Edge versions fail on the screenshot method.
[MS Edge 128.0.2739.54](https://learn.microsoft.com/en-us/deployedge/microsoft-edge-relnote-stable-channel), if entering `…
-
Steps to reproduce:
1. Run a service with model mapping using `openai` format
Example:
```yaml
type: service
name: llama31-service-tgi
replicas: 1..2
scaling:
metric: rps
target: …
-
### IDE Information
IntellJ IDEA 2024.1.4 (Community Edition)
Build #PC-233.13763.11, built on January 26, 2024
Runtime version: 17.0.9+7-b1087.11 aarch64
VM: OpenJDK 64-Bit Server VM by JetBrains…
-
### IDE Information
PyCharm 2023.3.3 (Community Edition)
Build #PC-233.13763.11, built on January 26, 2024
Runtime version: 17.0.9+7-b1087.11 aarch64
VM: OpenJDK 64-Bit Server VM by JetBrains s.r.…
-
### System Info
Hi everyone, when trying to update from Llama 3 8B Instruct to Llama 3.1 8B Instruct, I noticed a crash:
```bash
Args {
model_id: "meta-llama/Meta-Llama-3.1-8B-Instruct",
…