how to do prompt learning with bloom?

bigscience-workshop / Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Other

1.3k stars 211 forks source link

how to do prompt learning with bloom? #376

Open moseshu opened 1 year ago

moseshu commented 1 year ago

how to do in-context-learning based on bloom? like instructGPT . the bloom can be as a rewardmodel? if I use bloom train a prompt learning ,how to do that?