Unbabel / OpenKiwi

Open-Source Machine Translation Quality Estimation in PyTorch
https://unbabel.github.io/OpenKiwi/
GNU Affero General Public License v3.0
229 stars 48 forks source link

Where is ape-qe and all its files? #26

Closed HuihuiChyan closed 5 years ago

HuihuiChyan commented 5 years ago

There are six files in directory "models": linear_word_qe_classifier.py -> linear model nuqe.py -> nuqe model predictor.py -> predictor part of predictor-estimator model predictor_estimator.py -> estimator part of predictor-esitmator model quetch.py -> quetch model utils.py -> all kinds of tools model.py -> the inlet to all models But there is not a file accords to ape-qe model! And the same to other directories, where I can find files for nuqe\predest\quetch\linear, but no one is for ape-qe! Not any one! Where the hell is ape-qe and all its related files? Or did I misunderstand something?

captainvera commented 5 years ago

Hey @BonjourDeutsch,

Ape-QE is not actually a model created specifically for QE. Our APE-QE worked by training a translation model using a pre-existing framework (e.g. OpenNMT), using that model to generate new translations which can then be compared to the original files in order to generate QE labels (using the official WMT QE corpus generation script available here )

We decided not to include capability to train this system in OpenKiwi as it is a translation model and as such it doesn’t make sense to include it in a pure QE framework.

Apologies if our project description gave the wrong impression, we'll update the Repo description to better reflect this.

HuihuiChyan commented 5 years ago

Thank you so much for your explanation. @captainvera Now I know what I should do. Thank you a lot.

captainvera commented 5 years ago

You are welcome, let me know if you have any other doubts! I'm closing this issue for now.