-
Ways to measure how well the model is performing:
Perplexity
Human Eval (optional)
This is on feat/evaluation:
https://github.com/MichiganDataScienceTeam/F24-mini-copilot/tree/feat/evaluation
…
-
When I try to evaluate the quantized AWQ models using the video evalaution script, I'm getting FileNotFoundError.
```
FileNotFoundError: No such file or directory: "/hfhub/hub/models--Efficient-La…
-
Thanks for your great work! Could you additionally evaluate the Qwen2.5 and Qwen2 models? They also support 128K context length.
-
The MOT merely states that the model is pending evaluation without giving any information as to what this means and what it will take to change this.
This actually appears to be rooted in the fact th…
-
Dear author, the link to the T2M evaluation model does not grant me access. Could you please update it or grant permission?
During the train…
-
As discussed in our previous meeting, in our ML model interface we should distinguish between parameters used for training and evaluation.
- Allows for different configurations being used in the re…