search

anoopkunchukuttan / indic_nlp_library

Resources and tools for Indian language Natural Language Processing
http://anoopkunchukuttan.github.io/indic_nlp_library/
MIT License
546 stars 158 forks source link

stdin/stdout versions of tokenizer and detokenizer. breaks python2 co… #24

Closed bhaddow closed 4 years ago

bhaddow commented 4 years ago

…mpatibility

This updates the tokenizer and detokenizer so that they can read/write from stdin/stdout. To do this, just use a dash (-) for the filename.

It breaks python2 compatibility. If this is a problem, then I could find a workaround, but it may be messy.

anoopkunchukuttan commented 4 years ago

Thanks, I will do this integration cross this library sometime in January.

anoopkunchukuttan commented 4 years ago

Added a new commandline interface for indicnlp library that also supports stdin/stdout support. Hence, this pull request is redundant and closing it.