How to make Drafter Models

[medduk9871]

LSTM, CNN, T5-finetune...

• Summerization Task
• T5 Tokenizer 맞추기, Distillation Objective를 정해야함.
• 원표: T5기반 CNN Daily Summerization 코드 작성
• 재석: LSTM 기반 Summerization, CNN 기반.