search

thammegowda / mtdata

A tool that locates, downloads, and extracts machine translation corpora
https://pypi.org/project/mtdata/
Apache License 2.0
147 stars 22 forks source link

Faster downloads with multiple streams #141

Open thammegowda opened 1 year ago

thammegowda commented 1 year ago

Datasets are getting bigger ( #140 ) , it means longer times to download.

Improve download speed using multiple streams via download accelerators. Example: here is a Python lib https://github.com/iTaybb/pySmartDL