search

mindspore-lab / mindrlhf

Apache License 2.0
26 stars 12 forks source link

Support for gpt2 #32

Closed kfertakis closed 10 months ago

kfertakis commented 11 months ago

Hi,

GPT2 is supported based on the documentation and previous working version of mindrlhf. However, in the latest code, there is a hardcoded check allowing only pangu and bloom models. How can we enable gpt2 training?

Thanks

Commit: 5fb1273

ChessQian commented 11 months ago

GPT2：https://github.com/mindspore-lab/mindrlhf/pull/33