-
Could you explain the pretrained models form this [page](https://github.com/qqlu/Entity/tree/main/Entityv2)?
Were all of these models pretrained using the COCO dataset and the numbers are evaluatio…
-
I am running llama2 model in wikitext dataset. I just want try some other metrics so I modify the default YAML file(`lm-evaluation-harness/lm_eval/tasks/wikitext/wikitext.yaml`) to the following, just…
-
I attempt run this file "/llm2vec/experiments/run_mntp.py"，but i am failed. I can get respondant result from the URL by browser
], max: 500 iters
2023-10-16 08:47:54,004 - mmedit - INFO - Checkpoints…
-
Hello Tomas,
On the corner plot of `plot_posterior()`, it might be practical to show with points the parameter values of the models that were available during the fit to help evaluate easily, visua…
-
# URL
- https://arxiv.org/abs/2401.07103
# Affiliations
- Zhen Li, N/A
- Xiaohan Xu, N/A
- Tao Shen, N/A
- Can Xu, N/A
- Jia-Chen Gu, N/A
- Chongyang Tao, N/A
# Abstract
- In the rapidly…
-
I looked at the bar plots of the speaker identification task on the SUPERB benchmark (Figure 3 in the paper) for the three models, hubert, hubert-iter and contentvec. However, I did not see code for t…
-
### Open Task RFP for Privacy preserving machine learning inference using MPC
#### Executive Summary
- Project Overview: In this project, we want to see current state of the privacy preserving m…
tkmct updated
4 weeks ago
-
Thanks for releasing the repo, as well as the trajectories for swebench-lite! I am trying to reproduce the results with gpt-4o, but am seeing a fix rate of 59/300, as opposed to the 27.33% reported.
…
-
### Description
Export to fmu gets failed while generating fmu through omedit and throws many translation error.
The following below listed models have same issues:
```
Buildings.Utilities.I…