-
### User story
As an evaluator, in order to evaluate a submission, I would like to be able to interact with the evaluation form along with the submission information I'm evaluating.
**Acceptance Crit…
-
Hi authors, I have the same problem with @bob35buaa that I want to retrain the FGD autoencoder on my own dataset and representation. Could you please share the train scripts?
_Originally posted by …
-
Regarding the evaluation indicators section, how can I evaluate the relevant indicators without calling the batch_ eval. py in OpenAI? Is there any other way? Or other calling methods?
-
### User story
As a challenge manager, in order to ensure that a valid form is available for the evaluators to use, I would like a form to be validated for errors and valid logic before it is saved.
…
-
The functionality defined in `src\utiliy` should be moved to a separate python package.
Perferably, we should include the evaluation functionality in CADET-Process.
This could encompass a tool tha…
-
Code evaluation task/benchmark such as HumanEval and MBPP are missing from **lm-evaluation-harness**, but are present and maintained in **bigcode-evaluation-harness**.
https://github.com/bigcode-pr…
-
FileNotFoundError: Cannot find pytorch_model.bin in /SceneVerse-main/results/FinalOVPretrain_b64_Pretrain_scanrefer_no_note/2024-10-10-09:23:20.509828/ckpt/best.pth.
Hello! I don't understand why …
-
Isotope Version 2.9.0
For sales statistics
but at Sales summary
I have run the command :python main.py -m eval -cf config/ava_config.yaml
I followed official guidance to ma…
-
Hi,
I am interested in reproducing the results from the DTIN dataset. Could you please share the evaluation code for DTIN?
Thank you.