-
### Your current environment
```text
vllm 0.4.2
```
### How would you like to use vllm
I'm trying to force a json generation using outlines in offline inference. I don't see anything related in…
-
Hi!
I was interested in optimizing the library's performance even further. I evaluated Profile-Guided Optimization (PGO) on many projects - all the results are available at https://github.com/zamaz…
-
Hi!
I just read your [article](https://www.reddit.com/r/rust/comments/1cidm5o/a_21565x_performance_improvement_in_linting/) about optimizing the `graphql-lint` performance. Since I tested one speci…
-
### Your current environment
I found that in EngineArgs, guided_decoding_backend can choose to support outlines or lm-format-enforcer. How can I use it?
Specifically, the following code can be execu…
-
Hi!
Thank you for the project! I evaluated Profile-Guided Optimization (PGO) on many projects - all the results are available at https://github.com/zamazan4ik/awesome-pgo . Since this compiler opti…
-
Can spatial domain guided 3D slice alignment be used for 10X data?
-
After the first POCs were implemented for oSPARC and the Postpro/Analysis service (PAS from now on) and a first meeting with @cosfor1, a new preliminary set of requirements can be defined. Requirement…
-
### Anything you want to discuss about vllm.
Hi,
I am running some benchmarks on the `vllm.entrypoints.openai.api_server` measuring latency and throughput with different number of concurrent reque…
-
Hi Jun,
Thank you for sharing the code and data sets!
Can you please explain on a high level what is the difference between 'Denoising_Guided_EI' and 'Denoising_Guided_NoGT' -- is it just you a…
-
Tracking issue for building a guided remediation feature as part of OSV-Scanner.
Some ideas:
- Suggesting direct dependency updates to remediate transitive vulns.
- Ways to prioritize vulnerabi…