-
## モデルの基本情報
**name**: jina-embeddings-v3
**type**: XLMRoBERTa (+ LoRA Adapter)
**size**: 559M (LoRA Adapterを加えると572M)
**lang**: multilingual
## モデル詳細
https://arxiv.org/abs/2409.10173
ht…
-
Not 100% sure, but right now it seems like if I updated a prompt fragment(s), these changes will get propagated to other producers. This is slightly problematic for evals, because ideally we'd have a …
-
Hey, thanks for the great work. I could be wrong, but I feel like there is a disconnect between what is mentioned in the Based paper and what is used in the Figure 2 config for MQAR eval. In the paper…
-
Document [Chess\Eval\CenterEval](https://github.com/chesslablab/php-chess/blob/main/src/Eval/CenterEval.php) with comments to briefly explain the purpose of each part. Remember to write a brief descri…
-
**Description**
These tests are disabled because they were broken by spath udf changes.
parseEvalSpathJSONCatalystTest()
parseEvalSpathXMLCatalystTest()
Will be investigate in Issue #295 i…
-
Ensure the code in the [Chess\Eval](https://github.com/chesslablab/php-chess/tree/main/src/Eval) namespace is PSR-12 compliant.
-
Currently the eval pipeline outputs an hdf5 file with motmetrics. See models/gtr_runner/on_test_epoch_end() for implementation. Proposing to add new global tracking accuracy metric into this eval file…
-
In the performance report, move the Eval Notes column to the end of the row after Confidence.
Not urgent
-
I did some smaller benchmarks (more like tests, really) and would like to continue with this endeavor to evaluate capabilities and weak spots.
Would also be interesting to test on codegen tasks vs …
-
`eval` is used [here](https://github.com/lxsmnsyc/seroval/blob/822af206c29c36b51cc5e6f24c0883b52bc0aa11/packages/seroval/src/core/tree/index.ts#L47), which unfortunately causes an error in sites which…