search

lxaw / shijin

A small language model trained on famous literary works in Japanese.
2 stars 0 forks source link

transfer learning from large english model to japanese #1

Open lxaw opened 4 months ago

lxaw commented 4 months ago

Would this work? I would imagine so. Languages mathematically should all share some similarity; even Japanese and English should be similar.

lxaw commented 4 months ago

Perhaps along the lines of https://arxiv.org/abs/2108.02340