lucidrains / PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
MIT License
7.67k stars 668 forks source link

Are there some pictures that describe PaLM architecture? #29

Closed guotong1988 closed 1 year ago

guotong1988 commented 1 year ago

Thank you very much!

lucidrains commented 1 year ago

Screenshot from 2023-02-14 09-59-23

yea sure, they actually used it for vision recently with great results https://arxiv.org/pdf/2302.05442.pdf