search

anikl9705 / NLP-Project-Paws

0 stars 0 forks source link

Look at papers on semantic similarity of sentences #4

Open anikl9705 opened 4 years ago

anikl9705 commented 4 years ago

Note: Could be on different datasets.

Yuanyuan-T commented 4 years ago

related paper (1): Cer, D., Yang, Y., Kong, S. Y., Hua, N., Limtiaco, N., John, R. S., ... & Sung, Y. H. (2018). Universal sentence encoder. arXiv preprint arXiv:1803.11175.

Aim: document dissimilarity, WMD -> reduce the computational cost, and scale to other algorithms

Application domain: document dissimilarity Conclusion: an alignment-aware text kernel using WMD for texts of variable lengths, which takes into account both word alignments and pre-trained high-quality word embeddings in learning an effective semantics-preserving feature representation. unsupervised.

Yuanyuan-T commented 4 years ago

related paper (2): Reimers, N., & Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084.

Aim: Sentence-BERT (SBERT), a modification of the pretrained BERT network that uses siamese and triplet network structures to derive semantically meaningful sentence embeddings that can be compared using cosine-similarity.

Application domain: Semantic Textual Similarity. Conclusion: The new model is computationally efficient.

commented by Ani: related to QQP

Yuanyuan-T commented 4 years ago

related paper (3): Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019). Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942.

Yuanyuan-T commented 4 years ago

related paper (4): Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., ... & Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692.

zheminzhang96 commented 4 years ago

Li, Y., McLean, D., Bandar, Z. A., O'shea, J. D., & Crockett, K. (2006). Sentence similarity based on semantic nets and corpus statistics. IEEE transactions on knowledge and data engineering, 18(8), 1138-1150.

zheminzhang96 commented 4 years ago

Achananuparp, P., Hu, X., & Shen, X. (2008, September). The evaluation of sentence similarity measures. In International Conference on data warehousing and knowledge discovery (pp. 305-316). Springer, Berlin, Heidelberg.

zheminzhang96 commented 4 years ago

An Efficient Framework for Sentence Similarity Modeling Zhe Quan, Zhi-Jie Wang, ...