qe-team / marmot

MARMOT - the open source framework for feature extraction and machine learning, designed to estimate the quality of Machine Translation output
ISC License
21 stars 7 forks source link

simplify parsers #15

Open chrishokamp opened 9 years ago

chrishokamp commented 9 years ago

parsers should return an object with {'key': [[seg1_tok1, seg1_tok2, ...]]}

in the future we may find usecases where we do not need the list of lists representation (i.e. one field for each token in each segment, but for now this is the only usage we support.