Literature Review

[kasparvonbeelen]

• [x] Hu, R., Li, S., & Liang, S. (2019). Diachronic Sense Modeling with Deep Contextualized Word Embeddings: An Ecological View, 3899–3908. https://doi.org/10.18653/v1/p19-1379
 - Barbara 10/11
• [x] Renfen Hu, Shen Li, Shichen Liang (2019), From Word to Sense Embeddings: A Survey on Vector Representations of Meaning, https://arxiv.org/abs/1805.04032

[BarbaraMcG]

There is also this article: https://www.mdpi.com/2504-4990/1/2/34/htm which I just skim-read. It's about combining lexical taxonomies like WordNet into semantic representations. Noone has done this diachronically, and it could be interesting to see what happens if we try and adapt this model to historical texts, using the OED thesaurus as a diachronic semantic taxonomy and we apply this to the task of diachronic word sense disambiguation.

[kasparvonbeelen]

ACL 2020 Papers

Essential reading for the paper

• [ ] Similarity Analysis of Contextual Word Representation Models John Wu | Yonatan Belinkov | Hassan Sajjad | Nadir Durrani | Fahim Dalvi | James Glass

• [x] SenseBERT: Driving Some Sense into BERT Yoav Levine | Barak Lenz | Or Dagan | Ori Ram | Dan Padnos | Or Sharir | Shai Shalev-Shwartz | Amnon Shashua | Yoav Shoham

• [x] Analysing Lexical Semantic Change with Contextualised Word Representations Mario Giulianelli | Marco Del Tredici | Raquel Fernández

• [ ] Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encoders Terra Blevins | Luke Zettlemoyer

• [ ] Learning and Evaluating Emotion Lexicons for 91 Languages Sven Buechel | Susanna Rücker | Udo Hahn

• [ ] Contextual Embeddings: When Are They Worth It? Simran Arora | Avner May | Jian Zhang | Christopher Ré

• [ ] Investigating Word-Class Distributions in Word Vector Spaces Ryohei Sasano | Anna Korhonen

• [ ] BiRRE: Learning Bidirectional Residual Relation Embeddings for Supervised Hypernymy Detection Chengyu Wang | Xiaofeng He

• [ ] (Re)construing Meaning in NLP Sean Trott | Tiago Timponi Torrent | Nancy Chang | Nathan Schneider

• [x] Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information Michele Bevilacqua | Roberto Navigli

• [ ] Why Overfitting Isn’t Always Bad: Retrofitting Cross-Lingual Word Embeddings to Dictionaries Mozhi Zhang | Yoshinari Fujinuma | Michael J. Paul | Jordan Boyd-Graber

• [ ] Hypernymy Detection for Low-Resource Languages via Meta Learning Changlong Yu | Jialong Han | Haisong Zhang | Wilfred Ng

• [ ] Clinical Concept Linking with Contextualized Neural Representations Elliot Schumacher | Andriy Mulyar | Mark Dredze

Possibly interesting

• [ ] In Layman’s Terms: Semi-Open Relation Extraction from Scientific Texts Ruben Kruiper | Julian Vincent | Jessica Chen-Burger | Marc Desmulliez | Ioannis Konstas

• [ ] Contextualized Weak Supervision for Text Classification Dheeraj Mekala, Jingbo Shang

• [x] Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corpora Hila Gonen | Ganesh Jawahar | Djamé Seddah | Yoav Goldberg

Not sure yet, good to keep in mind

• [ ] TXtract: Taxonomy-Aware Knowledge Extraction for Thousands of Product Categories Giannis Karamanolakis | Jun Ma | Xin Luna Dong

• [ ] Semi-supervised Contextual Historical Text Normalization Peter Makarov | Simon Clematide

• [ ] Taxonomy Construction of Unseen Domains via Graph-based Cross-Domain Knowledge Transfer Chao Shang | Sarthak Dash | Md. Faisal Mahbub Chowdhury | Nandana Mihindukulasooriya | Alfio Gliozzo

• [ ] Active Learning for Coreference Resolution using Discrete Annotation Belinda Z. Li | Gabriel Stanovsky | Luke Zettlemoyer

• [ ] To Boldly Query What No One Has Annotated Before? The Frontiers of Corpus Querying Markus Gärtner | Kerstin Jung

• [ ] Machine Reading of Historical Events Or Honovich | Lucas Torroba Hennigen | Omri Abend | Shay B. Cohen

General relevance

• [x] Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data Emily M. Bender | Alexander Koller

• [ ] Returning the N to NLP: Towards Contextually Personalized Classification Models Lucie Flek

• [ ] How Can We Accelerate Progress Towards Human-like Linguistic Generalization? Tal Linzen

[kasparvonbeelen]

Sense Embeddings

• [x] Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddings Gregor Wiedemann, Steffen Remus, Avi Chawla, Chris Biemann

• [ ] GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledge Luyao Huang, Chi Sun, Xipeng Qiu, Xuanjing Huang

[mcollardanuy]

Hi, is there a date/time for the literature review discussion?

[BarbaraMcG]

Hi, is there a date/time for the literature review discussion?

We're discussing the times and dates in this ticket https://github.com/Living-with-machines/HistoricalDictionaryExpansion/issues/15

[BarbaraMcG]

I suggest we decide on a schedule for the readings in today's meeting. If you want to volunteer for a paper, please add your name and a date next to it in the list above!

I'm assigning this to Mariona to start the round of comments.

[kasparvonbeelen]

Keep track of other potentially relevant papers:

• [ ] Towards better substitution-based word sense induction Asaf Amrami and Yoav Goldberg, https://arxiv.org/pdf/1905.12598.pdf

[mcollardanuy]

Also this one seems interesting:

• [ ] When Hearst Is not Enough: Improving Hypernymy Detection from Corpus with Distributional Models (Changlong Yu, Jialong Han, Peifeng Wang, Yangqiu Song, Hongming Zhang, Wilfred Ng, Shuming Shi) https://www.aclweb.org/anthology/2020.emnlp-main.502/