-
### Jan version
0.5.6
### Describe the Bug
When I try to use "Codestral 22B Q4", prompt give no response. The app.log says failed to load.
In the log it is trying to load:
'/Volumes/T7B01/ai/ja…
-
### How would you like to use vllm
I want to run inference of a [TheBloke/Llama-2-7B-Chat-GPTQ](https://huggingface.co/TheBloke/Llama-2-7B-Chat-GPTQ). I don't know how to use it with vllm.
I try t…
-
According to [some benchmarks](https://github.com/djc/template-benchmarks-rs) the [tera](https://github.com/Keats/tera) templating engine is substantially faster than handlebars.
Consider supportin…
tmpfs updated
4 years ago
-
I would like to use DustJS in an expressJS application but I don't know how to add custom helpers to use in my templates.
From the DustJS docs I guess I need to implement code like this:
```
dust.h…
-
**Prerequisites (mark completed items with an [x]):**
- [x] I have have carried out troubleshooting steps and I believe I have found a bug.
- [x] I have searched for similar bugs in both…
-
### Have you searched for similar requests?
Yes
### Is your feature request related to a problem? If so, please describe.
* https://github.com/SillyTavern/SillyTavern/issues/1400
### Describe th…
-
**Description**
low speed in large concurrent requests
concurrent requests | 1 | 50 | 100
-- | -- | -- | --
TensorRT-llm| 73.36 | 193.30 | 193.81
Vllm| 64.13| 984.55| 1246.50
value is TPS …
-
### Is your proposal related to a problem? Yes
I'm using Hasura to communicate with OpenStack's API. Trying to make a change to existing image instance I've encountered a problem that I can't chang…
-
The following template can be successfully processed by both the old and the new templating engine:
```
```
It obviously returns 1.
However the following template can only be successfully processe…
ferki updated
9 years ago
-
### Main programming language
Node.js / Javascript
### Tutorial title
Bittorrent Protocol in 25 minutes
### Tutorial URL
https://www.tzionis.com/bittorrent-protocol-in-25-minutes
### Cat…