search

CogComp / cogcomp-nlp

CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.
http://nlp.cogcomp.org/
Other
473 stars 142 forks source link

NER not able to figure non-traditional numbers #559

Open danyaljj opened 7 years ago

danyaljj commented 7 years ago

This example: "This vulnerability happened in Firefox 1.x before 1.8, Safari 2.x before 2.8."

not able to recognize that 1.x and 2.x is one single number.

danr-ccg commented 7 years ago

Why is this an NER issue?

The quantifier identifies 1.2, 2.3, 2.8.

          Dan

From: Daniel Khashabi [mailto:notifications@github.com] Sent: Tuesday, September 26, 2017 9:31 AM To: CogComp/cogcomp-nlp cogcomp-nlp@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Subject: [CogComp/cogcomp-nlp] NER not able to figure non-traditional numbers (#559)

This example: "This vulnerability happened in Firefox 1.x before 1.8, Safari 2.x before 2.8."

not able to recognize that 1.x and 2.x is one single number.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/CogComp/cogcomp-nlp/issues/559, or mute the threadhttps://github.com/notifications/unsubscribe-auth/APLC6jgFWIUaHfAnMfo9l8bh_FOP7Sm8ks5smPyXgaJpZM4PkPvX.

danr-ccg commented 7 years ago

Depending on how you view it, it can be either an NER (ontonotes) issue or Quantifier issues: none of the them get the numbers I mentioned in the previous sentence: "This vulnerability happened in Firefox 1.x before 1.8, Safari 2.x before 2.8." Surprisingly there are lots of things not captured by quantities or temporal. Here is a problematic issue for temporal: "I'm traveling from Spain to India i.e on 23/09/2017 to 27/09/2017." None of these dates are caught by the temporal package.

Daniel

On Wed, Sep 27, 2017 at 9:33 PM, Roth, Dan danroth@seas.upenn.edu wrote:

Why is this an NER issue?

The quantifier identifies 1.2, 2.3, 2.8.

          Dan

From: Daniel Khashabi [mailto:notifications@github.com] Sent: Tuesday, September 26, 2017 9:31 AM To: CogComp/cogcomp-nlp cogcomp-nlp@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Subject: [CogComp/cogcomp-nlp] NER not able to figure non-traditional numbers (#559)

This example: "This vulnerability happened in Firefox 1.x before 1.8, Safari 2.x before 2.8."

not able to recognize that 1.x and 2.x is one single number.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/CogComp/cogcomp-nlp/issues/559, or mute the thread https://github.com/notifications/unsubscribe-auth/APLC6jgFWIUaHfAnMfo9l8bh_FOP7Sm8ks5smPyXgaJpZM4PkPvX .