-
### 🚀 The feature, motivation and pitch
I launched a LLM service by vllm, and I use AsyncOpenAI function for high throughput output. like this:
`
async def async_llm_infer_sampling(prompt, a…
-
The ppx could generate the full module binding on each case (even when json decoding is used) and avoid users to open the runtime, which is expected to be there in the first place.
```diff
module …
-
### Proposal to improve performance
Propose synchronizing the broadcast of tensor_dict at the beginning of each decoding step or block the process after broadcast.
### Report of performance regr…
-
since i couldn't make anything of the Exception
```
Expecting property name enclosed in double quotes: line 406865 column 8 (char 11883759)
```
I got when running a SPARQL query against a Wikidat…
-
```
This is my first time posting an issue online for open source projects - hope
I'm doing it right!
What steps will reproduce the problem?
This code:
results = api.GetSearch(search_string, None, …
-
It's difficult to parse and render the logical plan (EXPLAIN) in third-party tools (e.g., DBMarlin). This issue tracks providing a JSON format option in _crdb_internal.decode_plan_gist_.
Jira …
-
I'm trying to set up parsedmarc using an existing ELK stack, hence not shipping to localhost:9200.
Instead, I'm storing the json files and letting a Custom Beats agent policy collect the json files…
-
*Sent by Lu Zhao and automatically created by email*
---
When the author's name on Medium contains Chinese characters, it appears as
garbled text. Based on tests at
https://string-functions.com/en…
-
* We spend a lot of time encoding/decoding JSON to send these notifications, which is particularly gnarly with big, noisy tailnets.
* Each platform's GUI essentially has its own version of client-sid…
-
# PLEASE POST THIS IN THE DISCUSSION TAB UNDER "PROPOSALS" OR "IDEAS/REQUESTS"
**Is your feature request related to a problem? Please describe.**
uuids are being used more and more often as id and…