search

ufal / mtmonkey

Distributed infrastructure for Machine Translation web services (using Moses, Python, JSON-RPC/web interface)
Other
33 stars 9 forks source link

Piped processors #14

Open lefterav opened 9 years ago

lefterav commented 9 years ago

Modified MT-monkey that encapsulates perl pre- and post-processors.

tuetschek commented 9 years ago

We've found out that the util.preprocessor Python module is missing from the commits. Could you please add it?

martinpopel commented 9 years ago

This PR replaces the current Worker implementation, so it would break our systems running the current (master) version of Worker, where Moses has been trained with the Python preprocessing in mind. Note that the current version of Worker is thread-safe and faster than anything using Perl and pipes, so it's worth keeping.

This PR should be changed to an alternative (configurable in the config file) in order to be merged.