-
When I am evaluating few tasks, some of which (HellaSwag, PiQA, math_word_problems) encountered the following errors:
Traceback (most recent call last):
File "/data//anaconda3/envs/eval/bin/lm_e…
-
Custom charts are great and it's hard to find metrics in the tables but somehow they show results only for 3 datasets and lack the most important ones, the ones without augmentations.
https://wandb…
-
What are some open datasets for evaluation? These will be needed to answer #3 about hyperparameters and algorithms
cc @andrenguyen
-
How to evaluate on our own datasets ?
-
I am interested in processing couple of my .txt data-sets (train and test
sets) with the KeyBench but getting an error: "WindowsError:
[Error 123] The filename, directory name, or volume label syntax…
-
Dear Author,
Thanks for releasing the RITA for protein generation!
However, I wonder how can I obtain perplexity evalutation datasets used in your paper and how to calculate perplexity.
Hope for …
-
Hello,
I have one problem about your paper, you only evaluate on Human3.6M, HumanEva, which I think is not enough to prove the generalization ability of the model. Previous papers usually evaluate on…
-
How to output datasets with evaluation accuracy of P, R, mAP, FPS, Gflops
-
Dear Authors,
Thank you for releasing the evaluation code.
Could you provide details on how to setup the training and evaluation datasets/benchmarks? Including the twitter dataset you mention in…
-
Opening statement summary
Overall your paper don't seem to be finished.
Strong positive points
I see you have changed the Rproj name and I can tell what you're trying to do in your paper.
…