-
We are now actively developing VERSA for general-purpose speech/audio evaluation.
- Additional Metrics to add
- [x] torch-squim (metrics done, pending adding to the interface) https://pytorch.or…
-
Thanks for the evaluation toolkit. Could you provide scripts to reproduce QWen2VL results on Video Benchmarks?
-
Hello everyone,
Thank you very much for providing the toolkit. In some papers you can see the evaluation of the attributes by e.g. camera motion. In common.py the tag files are also read in. I did…
-
Hello, after reinstalling ai-toolkit, I can't seem to run my Lora training
```
(venv) PS C:\Users\User\Desktop\Tools\Stable Diffusion\ai-toolkit> python run.py config/my_lora_01.yaml
Running 1 …
-
Thanks your project!
Is there any Evaluation toolkit of WILDTRACK for estimating the MTMC tracker on WILDTRACK dataset? I can find MOTChallenge devkit for MOT. However, it seems no Evaluation toolkit…
-
- [ ] [nmslib/README.md at master · nmslib/nmslib](https://github.com/nmslib/nmslib)
# Non-Metric Space Library (NMSLIB)
## Important Notes
* NMSLIB is generic but fast, see the results of [A…
-
Like the picture above, when I click "UAV123", actually it will guides me to the paper…
-
Dear FELT research team,
First, I would like to express my sincere gratitude for your outstanding work on the FELT dataset and your [paper](https://arxiv.org/pdf/2403.05839), which has become an in…
-
### Scenario
It is important to add **observability** to an AI bot built with teams-ai SDK since the AI may have non-deterministic behaviors. Currently it is quite hard to evaluate against an AI bot …
-
We will update this soon after finishing the AWS set up on the submission system, but posting now to help ensure people getting started with tool preparation (copied from last iteration) @ChristopherB…