search

leecs0503 / NLP_FinalProject

FinalProject
1 stars 3 forks source link

Vil Bert 구현 #19

Closed leecs0503 closed 2 years ago

leecs0503 commented 2 years ago

https://arxiv.org/pdf/1908.02265.pdf 해당 논문을 읽고 모델을 구현하는 작업

DomesticDriedJujube commented 2 years ago

ref github) https://github.com/facebookresearch/vilbert-multi-task

DomesticDriedJujube commented 2 years ago

huggingface - pytorch Transformer) https://github.com/huggingface/transformers

DomesticDriedJujube commented 2 years ago

VILBERT = BERT의 text처리와 LXmert의 cross-modality를 적절히 섞어놓은 듯.. Paper) https://arxiv.org/pdf/1908.07490.pdf Review) https://baekyeongmin.github.io/paper-review/lxmert-review/