-
Problem when .gradle is in a symlink directory.
Currenty I am experiencing issues with cdi-unit.
Final problem is that on some PCs it is impossible to Inject classes from cdi-unit - such as `Co…
-
-
-
Thank you for sharing evaluation codes for Japanese LLM!
Are you planning to evaluate all JGLUE tasks?
I found following tasks
JCoLA, JSTS, JNLI, JSQuAD, JCommonsenseQA
https://github.com/llm-…
-
Hey!
Are there any plans to upgrade or support [JUnit 5 extension model](http://junit.org/junit5/docs/current/user-guide/#extensions)?
-
Please provide a version based on jakarta.** APIs.
Even a milestone/snapshot release would be very welcome!
-
-
Hi, I just run the meter eval today and found this issue:
```
File "/usr/local/lib/python3.10/dist-packages/datasets/load.py", line 133, in resolve_trust_remote_code
raise ValueError(
ValueE…
-
- JSTSのテンプレートでは類似度スコアを0-5の整数値で回答するよう指示があるがfewshotの事例と矛盾している
- fewshotの4例は全て小数点以下1桁を含んでいる
- fewshotの4例中2例のスコアは誤差で桁数が多くなっている
- output_length=3が指定されている+samplesのスコアの精度が小数点以下1桁である
- テンプレートを修正して0.…
-
Recently I found that JSNLI is (unofficially?) converted to huggingface/datasets formats (https://huggingface.co/datasets/shunk031/jsnli ), which seems really helpful.
I wonder if we could make JGL…