-
### 🚀 The feature, motivation and pitch
The GenAI perf toolkit from NVIDIA can be used as an alternative benchmark tools for vLLM. While we already have benchmark scripts and framework in `benchmarks…
-
Code evaluation task/benchmark such as HumanEval and MBPP are missing from **lm-evaluation-harness**, but are present and maintained in **bigcode-evaluation-harness**.
https://github.com/bigcode-pr…
-
Every kola test running in `kola-openstack` runs for [rawhide][aarch64] fails with
```
harness.go:106: TIMEOUT[10m0s]: SSH unsuccessful within allotted timeframe for 16f4d302-c567-459d-9549-fb049c3f…
-
After generating a file for java: `generations_multiple-java.json`
and building a docker image for multiple eval: `sudo make DOCKERFILE=Dockerfile-multiple all`
I get the following error when runn…
-
Hyundai M harness with CAN bus pairs flipped.
- which car? Genesis GV80 2021 (Middle East only)
- https://github.com/commaai/openpilot/pull/30145
- schematics - seems to be similar to EV6's har…
-
- [x] which car is this for? 2023 Honda Pilot, 2023 CR-V, 2023 Accord
- [x] schematic - Push to neo repo once confirmed working
- [x] beta sent to tester
- [ ] in shop
- [ ] Added to openpilo…
-
Harness and CBSD have been configured. The following is the registration request received by the CBSD
The registrationresponse of SAS is not given, either in the console or in the log, only display…
-
-
im using MacOS and tried to add a plan using Safari and Chrome and i get the same error
https://app.ha…
-
Most of the setter functions are not asynchronous. This is not desirable because we often have use cases for using asynchronous code (ie: fetch requests) within beforeSet/afterSet functions as well as…