issues
search
sbintuitions
/
JMTEB
The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)
Creative Commons Attribution Share Alike 4.0 International
33
stars
10
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[FIX] Feature/save config
#85
akiFQC
closed
3 days ago
0
[Feature] update save config file
#84
akiFQC
closed
4 days ago
1
[EVAL REQUEST] BAAI/bge-m3
#83
cross32768
opened
1 month ago
0
[dev to main] v1.3.2
#82
lsz05
closed
4 days ago
0
[Leaderboard] Add jinaai/jina-embeddings-v3 to leaderboard
#81
lsz05
closed
4 days ago
0
[Feature] Allow setting encode kwargs in SentenceBert embedder
#80
lsz05
opened
1 month ago
0
[Quesiton] Imbalanced data for classifiers in classification tasks
#79
omihub777
opened
2 months ago
1
[Question] What does `relevance_scores` in ESCI reranking dataset represent?
#78
omihub777
closed
2 months ago
2
[EVAL REQUEST] jina-embeddings-v3
#77
kaisugi
opened
2 months ago
15
[Version bump-up] v1.3.2
#76
lsz05
closed
1 month ago
0
[Leaderboard] Fix `pkshatech/RoSEtta-base-ja` and `pkshatech/GLuCoSE-base-ja-v2` scores
#75
lsz05
closed
2 months ago
0
[Leaderboard] Fix leaderboard summary average
#74
lsz05
closed
2 months ago
0
[Leaderboard] Add `pkshatech/RoSEtta-base-ja` and `pkshatech/GLuCoSE-base-ja-v2`
#73
lsz05
closed
2 months ago
0
[EVAL REQUEST] pkshatech/GLuCoSE-base-ja-v2
#72
akiFQC
closed
2 months ago
3
[EVAL REQUEST] pkshatech/RoSEtta-base-ja
#71
akiFQC
closed
2 months ago
10
[Leaderboard] Add ruri-large/base/small to leaderboard
#70
lsz05
closed
2 months ago
0
[EVAL REQUEST] Ruri Series
#69
akiFQC
closed
2 months ago
1
[dev to main] v1.3.1 hot fixes
#68
lsz05
closed
2 months ago
0
[Hotfix v1.3.1] Livedoor clustering results of OpenAI models
#67
lsz05
closed
2 months ago
0
[Hotfix] Livedoor clustering results of OpenAI models
#66
lsz05
closed
2 months ago
0
[Hotfix v1.3.1] Revert PR template
#65
lsz05
closed
2 months ago
0
[Hotfix] Revert PR template
#64
lsz05
closed
2 months ago
0
[dev to main] v1.3.1
#63
lsz05
closed
2 months ago
0
[Version bump-up] v1.3.1
#62
lsz05
closed
2 months ago
0
[Fix] `DataParallelSentenceBertEmbedder` in README
#61
lsz05
closed
2 months ago
0
[Doc] Add example scripts
#60
lsz05
closed
2 months ago
0
[Doc] leaderboard submission guideline
#57
lsz05
closed
2 months ago
0
[README] Update v1.3.0 README
#56
lsz05
closed
3 months ago
0
[dev to main] v1.3.0
#55
lsz05
closed
3 months ago
0
[Version bump-up] v1.3.0
#54
lsz05
closed
3 months ago
1
Improve: batch size setting and multi GPU inference with SentenceTransformers+DP
#53
akiFQC
closed
3 months ago
2
[Fix] 予測値をjsonlに保存
#52
lsz05
closed
3 months ago
1
[Fix] multi-GPU rerank retrievalタスクにおいてOOM防止のための修正
#51
akiFQC
closed
3 months ago
0
[bug] retrieverタスクでmulti-GPU使用時にCUDA OOMが発生する
#50
akiFQC
closed
3 months ago
0
[bug] 複数GPU使用時、cacheを利用した場合としない場合でclassification taskのスコアが異なる
#49
akiFQC
opened
3 months ago
0
[Fix] Rewrite encoding in `TransformersEmbedder`
#48
lsz05
opened
3 months ago
0
[Fix] STSにおいてbfloat16 tensorが起こった不具合
#47
lsz05
closed
3 months ago
1
ベンチマークの引数などをyamlかjson形式で結果を保存するディレクトリに保存する
#46
akiFQC
opened
3 months ago
0
[Fix] rerankingでのformat不具合
#45
lsz05
closed
3 months ago
2
Multi-GPU使用時に`--overwrite_cache false` を指定すると、rarank taskでエラーが発生する
#44
akiFQC
closed
3 months ago
1
[Feature] Add prediction logging
#43
lsz05
closed
3 months ago
1
テストセットの予測値を出力する
#42
lsz05
closed
3 months ago
1
[Feature] Support customizing `model_kwargs`
#41
lsz05
closed
4 months ago
0
[Feature] Leaderboard作成
#40
lsz05
closed
4 months ago
0
`SentenceBertEmbedder` をbf16/fp16で推論したい
#39
akiFQC
closed
3 months ago
2
[Feature] Support data parallelism
#38
lsz05
closed
4 months ago
0
[Feature] マルチスレッド対応
#37
lsz05
closed
5 months ago
1
複数GPUで`SentenceBertEmbedder` のencodeを行いたい
#36
akiFQC
closed
4 months ago
1
[dev to main] v1.2.0
#35
lsz05
closed
5 months ago
0
[Version bump-up] v1.2.0
#34
lsz05
closed
5 months ago
0
Next