guillaumegenthial / tf_ner

Simple and Efficient Tensorflow implementations of NER models with tf.estimator and tf.data
Apache License 2.0
923 stars 275 forks source link

Handling empty annotations neural NER #24

Open arunespku opened 5 years ago

arunespku commented 5 years ago

Consider the example,

Travel to dummylocation BIO annotation would be O O B_LOC

How to make the neural network to understand that the content inside the is dummy ?

Is it possible ?

guillaumegenthial commented 5 years ago

@arunespku , You can mask the input, i.e. replace it with an unknown token.