Improve MWE recognition - Githubissues

ProjetPP / PPP-QuestionParsing-Grammatical

Question Parsing module for the PPP using a grammatical approch

GNU Affero General Public License v3.0

33 stars 11 forks source link

Improve MWE recognition #123

Open yhamoudi opened 9 years ago

yhamoudi commented 9 years ago

See: https://github.com/ProjetPP/PPP-QuestionParsing-Grammatical/issues/122, https://github.com/ProjetPP/PPP-QuestionParsing-Grammatical/issues/64, https://github.com/ProjetPP/PPP-QuestionParsing-Grammatical/issues/85

Ex:

date of birth of Barack Obama
Where is the Panama canal?
Who is the US president?
Who is the United States president?
When is the birth of Obama
What is the location of the Sea of Tranquility?
Idea 1
Build a database of MWE (using Wikidata, ConceptNet...)
Concatenate all words of the question that are part of a same MWE (same algorithm than with quotations)
Idea 2

Improve the NER

Idea 3

Collapse the final normal form using MWE:

collapse ((A, B, ?), C, ?) to (A, B+C, ?) if there exists b in B and c in C such that b c is an existing MWE // only if all b in B or all c in C do not exist in our database.

Ex:

((Barack Obama, birth,?),date,?) > (Barack Obama, birth ,date,?)
How much are tickets to Disney World? > (Disney World, ticket cost, ?)

Ezibenroc commented 9 years ago

See http://discourse.askplatyp.us/t/expressions-recognition/19