YeonwooSung / ai_book

AI book for everyone
23 stars 4 forks source link

Contrastive search for longer sequence decoding #38

Open YeonwooSung opened 1 year ago

YeonwooSung commented 1 year ago

Contrastive search is originally proposed in "[A Contrastive Framework for Neural Text Generation"](Contrastive search is originally proposed in "A Contrastive Framework for Neural Text Generation") at NeurIPS 2022.

The contrastive search is well-known for text-generation for long sequence text data.

HuggingFace blog: Generating Human-level Text with Contrastive Search in Transformers