caiyinqiong / Semantic-Retrieval-Models

A curated list of awesome papers for Semantic Retrieval (TOIS Accepted: Semantic Models for the First-stage Retrieval: A Comprehensive Review).
318 stars 27 forks source link

ToUpdate #6

Open caiyinqiong opened 1 year ago

caiyinqiong commented 1 year ago

Pre-training:

  1. Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering(ACL2022)
  2. RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models(Arxiv, 2022)
xiahaoyun commented 1 year ago

Multi-vector Representation:

  1. Rethinking the Role of Token Retrieval in Multi-Vector Retrieval (arXiv ,twitter)
  2. SparseEmbed: Learning Sparse Lexical Representations with Contextual Embeddings for Retrieval(SIGIR2023)
caiyinqiong commented 1 year ago

end-to-end training:

  1. Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer
caiyinqiong commented 1 year ago

few-shot:

  1. Rethinking Dense Retrieval’s Few-Shot Ability
caiyinqiong commented 1 year ago

Retrieval-Augment LLM:

  1. REPLUG: Retrieval-Augmented Black-Box Language Models
  2. Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study
caiyinqiong commented 1 year ago

可解释性:

  1. Explain like I am BM25: Interpreting a Dense Model’s Ranked-List with a Sparse Approximation