Sosuke115 / japanese-llm-evaluation

Apache License 2.0
0 stars 0 forks source link

特殊トークンの影響を調べる #4

Open Sosuke115 opened 11 months ago

Sosuke115 commented 11 months ago

https://github.com/Sosuke115/japanese-llm-evaluation/blob/69a0509e1221427b6b643d8b7ec8eb7a739b5a5b/jrank/gen_model_answer.py#L144-L147

Sosuke115 commented 11 months ago

https://github.com/lm-sys/FastChat/blob/decceed4cd2a36611639004193aab15633d4cf00/fastchat/model/model_adapter.py#L1445

多分上記のようにBaseModelAdapterサブクラスのload_modelで書く必要ありそう