-
Hi @xhinker , I see that your pipeline encounters an error when run with:
```
prompt = ""
negative_prompt = ""
```
Bugs:
```
prompt_embeds = torch.cat(embeds, dim=1)
^^^^^^…
-
I'm working on this.
Just generate the issue to give it importance I also love exl2 :)
-
### Description
```
{"level":"warn","message":"Error parsing dbt json log Unexpected token 'U', \"Unsupporte\"... is not valid JSON","stack":"SyntaxError: Unexpected token 'U', \"Unsupporte\"... …
-
**Describe the bug**
I was testing a model with the team over the Exllama Discord server and encountered a hard server crash while submiting a regular request. The server worked well for about 1 hour…
-
Would be great to apply the same feature of token one-click remove in the grid generator like it is possible to do with lora's for instance
![image](https://github.com/mcmonkeyprojects/SwarmUI/asse…
-
I have a couple of requirement that I believe are not supported by Bolt's testing module yet.
This is an example of rules I’d like to be able to test:
```
path /path/to/my/queue/tasks {
write() =…
-
- [x] I have checked that the [SDK documentation][sdk-docs] doesn't solve my issue.
- [x] I have checked that the [API documentation][api-docs] doesn't solve my issue.
- [x] I have searched the [Box…
-
I tryed to use your library, but got an error:
Error: Nest can't resolve dependencies of the FormDataInterceptor (?). Please make sure that the argument Symbol(Inject token for NestJsFormData global …
-
Currently the [chat completion generator](https://github.com/stuartleeks/aoai-simulated-api/blob/2e4541f36445c2bee26fa0ee9b10b8173e923f16/src/aoai-simulated-api/src/aoai_simulated_api/generator/_gener…
-
### Your current environment
python3.11 vllm4.1 torch2.21-cu118
### 🐛 Describe the bug
here is my log with vllm, when inference gemma7b ,it shows 6 logs for one request which spend 30s ,…