Cleaning script in `clean_data.py` - Githubissues

LalitaDeelert / lalita-mt-zhth

Apache License 2.0

4 stars 0 forks source link

Cleaning script in `clean_data.py` #2

Closed cstorm125 closed 3 years ago

cstorm125 commented 3 years ago

Add cleaning scripts with

minimum mUSE similarity score
range for word ratio

cstorm125 commented 3 years ago

done by @LalitaDeelert