-
Hi,
I want to benchmark my variant calls (not GIAB or platinum dataset). How should i do with the help of this tool?
Thanks
-
Hi! Appreciate for the great dataset!
I tried to do evaluation for Mathvisita with Multimath-7B according to the instruction. And I noticed that '-use_multimath_prompt' is not used in the default Mul…
-
When running `stack bench` I get
```
bench: /Users/ocramz/.cache/datasets-hs/cifar-10-imagefolder/Truck: getDirectoryContents:openDirStream: does not exist (No such file or directory)
```
I gu…
-
Hey folks!
I saw that someone asked the same question yesterday on the mailinglist, but nobody has answered so I thought I bring it here since I'm running into the same issue.
When I try to run …
-
### Issue
In order to select the best [pre-trained weights](https://torchgeo.readthedocs.io/en/latest/api/models.html#pretrained-weights), users need reliable benchmark scores on a number of datasets…
-
- [VQAv2](https://arxiv.org/pdf/1612.00837v3)
- [TallyQA: Answering Complex Counting Questions](https://arxiv.org/pdf/1810.12440)
- [GQA: A New Dataset for Real-World Visual Reasoning and Compos…
-
Hi,
I read the [paper](https://arxiv.org/pdf/2408.10609) and had a some questions. I didn't see a correspondence email on the paper so hope it's ok to start a discussion here.
My question is reg…
-
I was doing some benchmarking for a paper I am working on and found a few discrepancies in the included and eternal copies of some of the datasets. The only issue I have found so far was with `Weather…
-
Thanks for opensoucing this benchmark and dataset.
Can you please try to fix the 404 Not Found error in the Google Drive link? I tried to fill out the form last week but received no response and can …
-