-
### Your current environment
```text
vllm 0.6.1.post2
vllm-flash-attn 2.6.1
```
### How would you like to use vllm
The document describes s…
-
can add a level 5 where the user will be guided to a hypothetical situation where he/she has already experienced a cyber attack. we can
provide users with realistic incident scenarios, such as malwa…
-
## What
A connection to a WhyHow graph containing desired structured terms and entity types.
## Why
For guided extraction, people want to be able to specify terms to use. These terms should …
-
In https://github.com/readium/guided-navigation?tab=readme-ov-file#22-publication-level the relation between the webpub manifest and the guided navigation structure is "alternate".
Semantically this…
-
### Is your feature request related to a problem? Please describe
Currently, when utilizing Xinference with vllm as the backend, users are unable to leverage vllm's advanced guided generation capabil…
-
Could you also share an example of generation by secondary structure, that is shown in 4.3.3 CONTROLLABLE GENERATION: SECONDARY STRUCTURE GUIDED PROTEIN SAMPLING part of your state. Thank you in advan…
-
### 🚀 The feature, motivation and pitch
I would like to implement the paper [Attributed Network Embedding via Subspace Discovery](https://arxiv.org/abs/1901.04095) by Zhang et al.
This paper…
-
### Anything you want to discuss about vllm.
Hi,
I am running some benchmarks on the `vllm.entrypoints.openai.api_server` measuring latency and throughput with different number of concurrent reque…
-
### 🚀 The feature, motivation and pitch
OpenAI API introduced a feature that supports structured output, this is basically the same as our `guided_json` feature.
1. We should simply alias it to su…
-
Hi,
When I try to download, only news content is being downloaded. Other folders as mentioned in the dataset structure are not downloading. Kindly let me know how to fix this. The keys and tokens are…