search

perseids-project / perseids_tokenize

Perseids Tokenization Service
GNU General Public License v3.0
0 stars 0 forks source link

tokenizer needs to skip empty tags #1

Closed balmas closed 10 years ago

balmas commented 10 years ago

if the first element in mixed content node is an empty tag, the tokenizer is skipping the text in the node.