hplt-project / OpusPocus

Marian machine translation training pipeline for thousands of models
2 stars 0 forks source link

fixed sharding in pipeline_steps.translate + added test_translate #48

Closed varisd closed 3 months ago

varisd commented 3 months ago

TranslateStep did not support the updated corpus sharding. This PR fixes that. Also adds basic unit tests for the step.