LLM incoporation as decoder or encoder

ruotianluo / self-critical.pytorch

Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning. and others.

MIT License

991 stars 278 forks source link

LLM incoporation as decoder or encoder #284

Open pankajchoudhury opened 7 months ago

pankajchoudhury commented 7 months ago

HI How do i incorporate GPT2 or other LLMs as decoder. I think BertCapModel file has the capacity but dont know how to do. did anyone tried it?please reply