search

lanwuwei / SPM_toolkit

Neural network toolkit for sentence pair modeling.
302 stars 70 forks source link

Preprocessing? #8

Closed andra-pumnea closed 6 years ago

andra-pumnea commented 6 years ago

how did you generate a.toks, b.toks and what kind of preprocessing did you apply to questions?

lanwuwei commented 6 years ago

Hi andra-pumnea, I followed this code to do data preprocessing.

andra-pumnea commented 6 years ago

cool, thanks!