issues
search
KLUE-benchmark
/
KLUE
📖 Korean NLU Benchmark
https://klue-benchmark.com
Creative Commons Attribution Share Alike 4.0 International
554
stars
55
forks
source link
Bump up KLUE-NER version
#24
Closed
inmoonlight
closed
3 years ago
inmoonlight
commented
3 years ago
Description
resolves #21
[⚠️ BREAKING CHANGE] normalize the raw text (use
nfkc
normalization)
To support multilingual PLM, we preprocess the raw text with XLM's default normalization method.
This normalization expands
㎝
,
㏊
to
cm
,
ha
respectively
Description
nfkc
normalization)㎝
,㏊
tocm
,ha
respectively