-
## **Describe the bug**
For harnesses that are not ZTest, the suite name declared in the yaml file is parsed as a test case.
Example:
```yaml
tests:
base.my_test_suite:
harness: "my…
-
## Hello!
- Vote on this issue by adding a 👍 reaction
- If you want to implement this feature, comment to let us know (we'll work with you on design, scheduling, etc.)
## Issue details
When we use…
-
Hi, While fuzzing [rexml](https://github.com/ruby/rexml) my test_harness abruptly exits with the message: `Alarm clock`.
```
#32768 pulse cov: 307 ft: 1807 corp: 387/661Kb lim: 57798 exec/s: 57 rs…
-
We currently do a lot of codegen in build.rs using the contents of `test_programs`, this results in us poisoning the build cache due to ACIR build artifacts.
One alternative is to use a custom test h…
-
### Feature request
I would like to make an example notebook for evaluating the peft model for reproducable tasks and metrics using the lm-eval harness if possible .
Library here - https://github.…
-
The previous c_gen implementation is known to be buggy.
Currently we are reusing parts of that implementation. Has such we should avoid carrying the bugs forward.
I propose that we write a test …
-
Code evaluation task/benchmark such as HumanEval and MBPP are missing from **lm-evaluation-harness**, but are present and maintained in **bigcode-evaluation-harness**.
https://github.com/bigcode-pr…
-
# 🚀 Feature request
To make it easy to test Taiga UI components and apps that use them we should provide [component harnesses](https://material.angular.io/cdk/test-harnesses/overview) for all our c…
-
## Steps to reproduce
```
2024-10-21T20:06:35.796499Z ERROR request{method=PUT path=/v1/tenant/0d3d204617651d10e4e1b6adac554419-0408/timeline/436d7c005a9d2f3e24c2494c392d4c9a/compact request_id=d6779…
-
### Environment
- scioVersion = "0.14.5"
- beamVersion = "2.56.0"
- scalaVersion := "2.13.14",
I have a simple Dataflow that reads Avro files from GCS and saves them into BigQuery.
```scala…