-
I am intrested in your paper, so I have read your paper and code about PUNet. Now, I have some problems about relative codes in calculating the MAP.
![image](https://user-images.githubusercontent.co…
-
Hello, your work is great. I want to ask Does your project have a code to evaluate model like mAP If so, can you help me to create demo as .ipynb for evaluate model?
Thank you in advance.
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
Error comming in example code for Answer Correctness
Code:…
-
Hi
It is unclear to me how you calculate $\delta_1$ and $AbsRel$ metrics in the zero-shot relative depth setting.
Are you using the normalized disparity maps $d$, the affine-invariant disparity…
-
Hi,
I was interested to evaluate the dice score on my test data and ground data and was facing an issue about an image size mismatch. What would you recommend I do in this case?
Attaching the det…
-
Hi,
I am trying to run some LLMs (currently trying openai models) on MMLU. My first question is which configuration is the standard setup (5 shot without CoT)? What does flan mean in some of the c…
-
If I interpret the https://arxiv.org/pdf/2404.16790 paper correctly, you have used transit maps for evaluation. However, I can't figure out which maps have been used: neither from the GitHub repo, nor…
-
Hi, I have tried to train a AdaTAD model on [IKEA ASM](https://github.com/IkeaASM/ikea_asm_dataset) dataset. I followed the THUMOS config using VideoMAE base model.
The final epoch output is:
``…
-
INFO:mteb.evaluation.MTEB:
## Evaluating 1 tasks:
─────────────────────────────── Selected tasks ────────────────────────────────
Retrieval
- MSMARCOv2, s2p
INFO:mteb.evaluation.MTEB:
…
-
**Is your feature request related to a problem? Please describe.**
An inefficiency in the creation of the model maps is that for some models, such as EMEP, we already have yearly files available, so …