issues
search
sbintuitions
/
JMTEB
The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)
Creative Commons Attribution Share Alike 4.0 International
21
stars
3
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[README] Update v1.3.0 README
#56
lsz05
closed
1 week ago
0
[dev to main] v1.3.0
#55
lsz05
closed
1 week ago
0
[Version bump-up] v1.3.0
#54
lsz05
closed
1 week ago
1
Improve: batch size setting and multi GPU inference with SentenceTransformers+DP
#53
akiFQC
closed
2 weeks ago
2
[Fix] 予測値をjsonlに保存
#52
lsz05
closed
2 weeks ago
1
[Fix] multi-GPU rerank retrievalタスクにおいてOOM防止のための修正
#51
akiFQC
closed
3 weeks ago
0
[bug] retrieverタスクでmulti-GPU使用時にCUDA OOMが発生する
#50
akiFQC
closed
3 weeks ago
0
[bug] 複数GPU使用時、cacheを利用した場合としない場合でclassification taskのスコアが異なる
#49
akiFQC
opened
3 weeks ago
0
[Fix] Rewrite encoding in `TransformersEmbedder`
#48
lsz05
opened
4 weeks ago
0
[Fix] STSにおいてbfloat16 tensorが起こった不具合
#47
lsz05
closed
4 weeks ago
1
ベンチマークの引数などをyamlかjson形式で結果を保存するディレクトリに保存する
#46
akiFQC
opened
4 weeks ago
0
[Fix] rerankingでのformat不具合
#45
lsz05
closed
4 weeks ago
2
Multi-GPU使用時に`--overwrite_cache false` を指定すると、rarank taskでエラーが発生する
#44
akiFQC
closed
4 weeks ago
1
[Feature] Add prediction logging
#43
lsz05
closed
4 weeks ago
1
テストセットの予測値を出力する
#42
lsz05
closed
4 weeks ago
1
[Feature] Support customizing `model_kwargs`
#41
lsz05
closed
1 month ago
0
[Feature] Leaderboard作成
#40
lsz05
closed
1 month ago
0
`SentenceBertEmbedder` をbf16/fp16で推論したい
#39
akiFQC
closed
4 weeks ago
2
[Feature] Support data parallelism
#38
lsz05
closed
1 month ago
0
[Feature] マルチスレッド対応
#37
lsz05
closed
2 months ago
1
複数GPUで`SentenceBertEmbedder` のencodeを行いたい
#36
akiFQC
closed
1 month ago
1
[dev to main] v1.2.0
#35
lsz05
closed
2 months ago
0
[Version bump-up] v1.2.0
#34
lsz05
closed
2 months ago
0
[Template] PR templateにマージ先がdevであることの確認を追加
#33
lsz05
closed
2 months ago
0
[Fix] lock numpy version
#32
lsz05
closed
2 months ago
0
Sentence Transformersのtokenizerの設定追加
#31
akiFQC
closed
2 months ago
1
[Feature] prefixの対応
#30
lsz05
closed
2 months ago
5
prefixやinstructへの対応
#29
yano0
closed
2 months ago
6
Feature/correspond to sentence transformers v3
#28
akiFQC
closed
2 months ago
0
Sentence Transformers >=3.0.0への対応
#27
akiFQC
closed
2 months ago
0
Sentence Transformers v3対応
#26
lsz05
closed
2 months ago
0
[dev to main] v1.1.1
#25
lsz05
closed
3 months ago
0
[Version bump-up] v1.1.1
#24
lsz05
closed
3 months ago
1
[Test] main コマンド用のテストを追加
#23
ryokan0123
closed
3 months ago
0
[Feature] Add --eval_include option
#22
ryokan0123
closed
3 months ago
2
[dev to main] v1.1.0
#21
lsz05
closed
4 months ago
0
[Version bump-up] v1.1.0
#20
lsz05
closed
4 months ago
0
[Fix] OpenAIEmbedderにおけるempty stringの処理
#19
lsz05
closed
4 months ago
4
データセットごとに文字数制限を追加する
#18
lsz05
opened
4 months ago
0
[Fix] OpenAIEmbedderにおける長さ超過のインプットテキストの処理
#17
lsz05
closed
4 months ago
0
[Fix] AmazonCounterfactualClassificationタスク名タイポ
#16
lsz05
closed
4 months ago
0
OpenAI Embedderにおけるinput textの長さ制限
#15
lsz05
closed
4 months ago
1
[Fix] OpenAI Embedderにdimensions設定不可の場合の対応
#14
lsz05
closed
4 months ago
1
[Feature] validation setを用いてhyperparameter tuningをする
#13
lsz05
closed
4 months ago
1
[Feature] Add OpenAIEmbedder
#12
lsz05
closed
4 months ago
0
Add task/reranking/esci
#11
masaya-ohagi
closed
4 months ago
0
pip install 時にライブラリ内の config を楽に指定できるようにする
#10
ryokan0123
opened
4 months ago
0
Reranking のタスクの実装
#9
ryokan0123
closed
4 months ago
0
単語ベクトルベースのテキスト埋め込みを実装する
#8
ryokan0123
opened
5 months ago
0
単語レベルの埋め込みの評価データセットを加える
#7
ryokan0123
opened
5 months ago
0
Next