The CCMatrix dataset was collected from web crawls and released by Meta. The dataset is constructed based on the margin-based bitext mining which can be applied to monolingual corpora of billions of sentences to produce high quality aligned translation data.
Dataloader name:
ccmatrix/ccmatrix.py
DataCatalogue: http://seacrowd.github.io/seacrowd-catalogue/card.html?ccmatrix