[논문리뷰] REALM: Retrieval-Augmented Language Model Pre-Training | Deep Learner
REALM: Retrieval-Augmented Language Model Pre-Training Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, Ming-Wei Chang https://kentonl.com/pub/gltpc.2020.pdf Abstract Language model pre-training은 QA와 같은 NLP task에 많은 양의 world knowledge를 포착하는 것으로 나타났다.
그러나 이 knowledge는 neural…
[논문리뷰] REALM: Retrieval-Augmented Language Model Pre-Training | Deep Learner
REALM: Retrieval-Augmented Language Model Pre-Training Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, Ming-Wei Chang https://kentonl.com/pub/gltpc.2020.pdf Abstract Language model pre-training은 QA와 같은 NLP task에 많은 양의 world knowledge를 포착하는 것으로 나타났다. 그러나 이 knowledge는 neural…
https://jeonsworld.github.io/NLP/realm/