Better multilingual support

huggingface / datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Apache License 2.0

2.05k stars 147 forks source link

Open guipenedo opened 2 months ago