-
### Your current environment
The startup command is as follows: it initiates both a standard 7B model and an n-gram speculate model. Speed tests discover that the speculate model performs more slowl…
yunll updated
2 weeks ago
-
Server:
```
vllm serve mistralai/Mistral-7B-Instruct-v0.3
```
Client:
```
guidellm --target "http://localhost:8000/v1" --model mistralai/Mistral-7B-Instruct-v0.3
```
These are some of the …
mgoin updated
1 month ago
-
**Describe the bug**
I'm using DeepSpeed MoE layer to build a multi-modal LLM, I'm using Phi-3 as the base model, and replaced the MLP layer with MoE layer in DeepSpeed. However, when I enabled exper…
-
### Describe the bug
I have created an SQS publisher and SQS receiver, my publisher works fine but my receiver fails to read messages from the queue with the exception:
```
fail: AWS.Messaging…
-
Change 1:
In the file `node_modules/sveltekit-modal/esm/src/vite/sveltekit_modal/src/app.py`
Remove `@stub.asgi_app()`
Replace with `@modal.asgi_app()` // and of course import modal
Change 2:
…
-
## Describe the bug
Commit `1bc23b83f65659ba2cac3c637974cddc04b63dc9` introduced a change in v1.3.1 to Leverage DefaultSupplier to automatically reload credentials on file refresh. This change causes…
-
**What happened**:
We are running Grafana 9.4.3 in HA, with 6 instances sharing a mysql database. We have ~800-1000 daily users with ~90 concurrent users at peak.
Occasionally we haver users rep…
-
### What happened?
`externalServiceAccounts` feature for app plugins when used along with multi Org. scenario does not work as expected. There are two different issues here:
- Even if the plugin a…
-
## Objective
we need to integrate the silkroad page frontend with the `XeonHedging_Test_V1` ABI which was added in #49 and ensure that all necessary contract interactions are correctly wired up.
…
-
* KOReader version: v2024.04
* Device: Kobo Touch
#### Issue
Memos highlight sync doesn't remember the ID of the created note in Memos and creates duplicated notes on sync.
Memos reply to n…