-
Doing pytest parallel attack on vllm with OpenAI client. Running these on A100 each model, 70b and cabybara ares on 4*A100 80GB, Mixtral on 2*A100 80GB.
e.g. for 70b we run:
```
python -m vllm.e…
-
Great job on getting this to work on real hardware, I was following the original thread.
I was wondering if it would be possible to write a loader to a cartridge in PIO, which could insert itself i…
-
## Description
Add more test coverage over Go concurrency primitives. In particular, we should make sure to exercise [ll/sc instructions](https://github.com/ethereum-optimism/optimism/pull/11906) as…
-
### Feature idea
As you have seen in the v0.4.x releases the logic and some UI state bugs are very difficult to resolve, so we thought of building the UI and associated state/logic from the ground up…
-
```
What steps will reproduce the problem?
1. Set RestAssured.baseURL and RestAssured.port in a @BeforeClass
2. Have multiple tests using different baseURLs/ports but without specifying on
each rest-…
-
Hi, I tried to finetune Llama2-7b-chat model using megatron. I downloaded the hf checkpoint and convert it to GPT megatron checkpoint referring [https://github.com/NVIDIA/Megatron-LM/blob/fe1640a3cc48…
-
```
What steps will reproduce the problem?
1. Install busdog on Windows 32bit
2. Install a printer on LPT1
3. Run busdog, select parallel port, start capture
4. Send a job to printer
What is the expe…
-
Hey Jonathan,
hope your 2018 is going well.
I have a quick question about parallel streams. Say I want to have following configuration:
```
m += a c
m += b ["processTwo"]=> d
```
T…
-
Great work.
Can you allow modifying the port as an argument so I can run multiple instances to allow parallel processing in OpenRefine?
-
```
What steps will reproduce the problem?
1. Install busdog on Windows 32bit
2. Install a printer on LPT1
3. Run busdog, select parallel port, start capture
4. Send a job to printer
What is the expe…