togethercomputer / RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.
Apache License 2.0
4.43k stars 335 forks source link

what does the prefix "rps_" mean? #114

Closed bpwl0121 closed 2 months ago

bpwl0121 commented 2 months ago

Hi,

thanks for the text toolkit ! but a question just regarding the prefix "rps_", it is RP signal? what is rp actually?

thanks.

mauriceweber commented 2 months ago

Hi @bpwl0121 , that's correct:) RP stands for RedPajama.

bpwl0121 commented 2 months ago

Hi @bpwl0121 , that's correct:) RP stands for RedPajama.

aha, I see. RP for RedPajama. ;)