Open sunpengsdu opened 5 months ago
a very simple on-the-fly dataloader is needed to support most pubic dataset
Completed in https://github.com/InternLM/InternEvo/pull/244
streaming
Describe the feature
a very simple on-the-fly dataloader is needed to support most pubic dataset
Will you implement it?