search

toriving / Plz_Read_The_Paper

Paper reading logs
11 stars 0 forks source link

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks #23

Closed toriving closed 3 years ago

toriving commented 4 years ago

https://arxiv.org/pdf/2005.11401.pdf image

toriving commented 3 years ago

언어생성을 위해 pre-trained model과 non-parametric memory를 결합한 RAG를 제안

image

쿼리를 통해 Document를 retriever하고, 쿼리와 document를 concat후, seq2seq (bart)를 통해 출력 (answer)를 생성한다.

이렇게 생성된 answer는 marginalization을 통해 최종 answer를 얻는다.

toriving commented 3 years ago

https://github.com/toriving/Plz_Read_The_Paper/blob/master/PAPERS/Retrieval-Augmented%20Generation%20for%20Knowledge-Intensive%20NLP%20Tasks.pdf