-
I've been trying to run the offline_inference, with this code
``` import datetime
from tqdm import tqdm
from typing import List
from sarathi.config import ModelConfig, ParallelConfig, SarathiS…
-
[Job](https://mihubot.xyz/runtime-utils/0f647a143b11452f8d77c18139be5a82) completed in 19 minutes.
https://github.com/dotnet/runtime/pull/107116
### Diffs
Diffs
```
Found 292 files with textual di…
-
[Job](https://mihubot.xyz/runtime-utils/8c29e0c37aa446c7895da598de0f039b) completed in 18 minutes.
### Diffs
Diffs
```
Found 293 files with textual diffs.
Summary of Code Size diffs:
(Lower is b…
-
Any strategies for best using this at very high volumes/in parallel? I'm using it in an AWS Lambda and we can easily hit a rate limit for `/1.1/account/verify_credentials/ ` when posting on behalf of…
-
evalscope perf --url 'http://127.0.0.1:65000/v1/chat/completions' --parallel 128 --model 'Qwen2-72B-Instruct' --log-every-n-query 10 --read-timeout=120 --dataset-path './data/open_qa.jsonl' -n 1 --max…
-
ESI allows authenticated searches to find structures (much like the in-game search function) and also gives access to structure market orders. This can be used to add market orders of accessible struc…
-
The current implementation is sending dispute requests synchronously:
https://github.com/zellular-xyz/zsequencer/blob/66a1fd00946cdf5fa9fe0299ed6e5643010bcc6b/node/tasks.py#L217
It should be up…
-
No idea about the feasibility of this but would be really nice if `ethon` could enable non-blocking IO when using a Ruby 3.x fiber scheduler the same way as Ruby's native IO libraries.
For example …
-
A concern has been raised and discussed across several occasions with security about the desire/need to separate Access Requests from their current public repository. The intent of this ticket is to w…
-
Explore possibility of adding finer grain control to execution segment priority.
Today, there is only compute or blocking. We've encountered uses cases where even a 3rd priority such as `request` or …