kobert 대신 kcbert 사용

[tucan9389]

• kcbert가 huggingface 인터페이스를 따르기 때문에 쉽게 사용이 가능
• KcELECTRA도 고려 가능할듯 → 더 최신의 bert 모델

[tucan9389]

KcBERT

from transformers import AutoTokenizer, AutoModelWithLMHead

# Base Model (108M)

tokenizer = AutoTokenizer.from_pretrained("beomi/kcbert-base")
model = AutoModelWithLMHead.from_pretrained("beomi/kcbert-base")

# Large Model (334M)

tokenizer = AutoTokenizer.from_pretrained("beomi/kcbert-large")
model = AutoModelWithLMHead.from_pretrained("beomi/kcbert-large")

[tucan9389]

KcELECTRA

from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("beomi/KcELECTRA-base")
model = AutoModel.from_pretrained("beomi/KcELECTRA-base")