SkyworkAI / Skywork

Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数,训练数据,评估数据,评估方法。
Other
1.21k stars 111 forks source link

请问数据清洗,预处理代码,有计划开源吗? #62

Closed zdaiot closed 9 months ago

zdaiot commented 9 months ago

感谢开源这么好的模型,如题~

zhao1iang commented 9 months ago

感谢支持,暂时没有数据清洗和预处理代码的开源计划哈~