shallow and syntactic parsing

[nnop]

相关名词：

• 短语提取
• 语块提取
• 新词发现
• 关键词提取
• keyword/keyphrase extraction/chunking
• NLTK collocation

研究员

• Anette Hulth
• Wenliang Chen

[nnop]

codes

• https://github.com/titipata/keyphrase_extraction
• https://github.com/GeorgeBourne/grid
• https://github.com/sing1ee/dict_build
• https://github.com/letiantian/TextRank4ZH

[nnop]

posts

• Intro to Automatic Keyphrase Extraction
• Matrix67 - 互联网时代的社会语言学：基于SNS的文本数据挖掘

papers

• Hulth, Anette. “Improved Automatic Keyword Extraction Given More Linguistic Knowledge.” (2003).
• Mihalcea, Rada and Paul Tarau. “TextRank: Bringing Order into Text.” EMNLP (2004).
• Chen, Wenliang et al. “An Empirical Study of Chinese Chunking.” ACL (2006).

[nnop]

方法步骤

一般分两步：Candidate Identification和Keyphrase Selection

• Candidate Identification

  • Common heuristics include removing stop words and punctuation
  • filtering for words with certain parts of speech or, for multi-word phrases, certain POS patterns
  • using external knowledge bases like WordNet or Wikipedia as a reference source of good/bad keyphrases

• Keyphrase Selection

  • frequency statistics, such as TF*IDF or BM25
  • unsupervised
  • graph-based ranking
  • supervised
  • binary classification
  • ranking

[nnop]

lectures

• Dependency Parsing: Past, Present, and Future @ COLING-2014
• Automatic Entity Recognition and Typing from Massive Text Corpora - A Phrase and Network Mining Approach -KDD 2015 Tutorial (kdd15, video)
  • WWW 2016 Tutorial