-
When using pyaro for an evaluation, I suspect that pyaro reads the data twice. I need to more evaluations to check if this is the case
-
I am trying to reproduce the whisper results for TEDLIUM with the provided `run_whisper.sh` script.
What I noticed is, that for TEDLIUM when I run e.g. whisper tiny the model crashes at some point …
-
Is there a way to determine the number of distance calculations performed during the kNN computation? The brute-force approach requires evaluating the distances between every query and corpus point, r…
-
I'm using a python AWS lambda function to run evaluations using Bedrock, with model Claude 3.5 sonnet and Uptrain version 0.7.1.
I'm getting an "event loop is closed" error when trying to run Factu…
-
Historically, filters (`Filter`, `WhereFilter`) and columns (`Selectable`, `SelectColumn`) have been assumed to be stateful unless we could easily prove otherwise. This prevents decomposing evaluation…
-
-
**Is your feature request related to a problem? Please describe.**
When running an experiment with evaluations, the traces which are associated with the experiment do not include the evaluation in th…
-
I have been working on running this line of code: python tools/eval.py paper/fastbev_m0_r18_s256x704_v200x200x4_c192_d2_f4
After submitting this line of code, I get the following error message: As…
-
Hi, I tried to run the following script by combining two metrics, but the error occurred:
```python
Python 3.9.16 (main, Apr 5 2023, 13:58:15)
Type 'copyright', 'credits' or 'license' for more i…
-
Given a an autoscaler using v0.4.3, with the following setup:
```
target "aws-asg-us-east-1" {
driver = "aws-asg"
config = {
aws_region = "us-east-1"
}
}
target "aws-asg-us-west-2"…