Closed fen0s closed 3 years ago
https://colab.research.google.com/drive/1lSx9P4C60umxpoROgz3b0OZfy7EcDgrg Perhaps, it could be added in readme? Got it running with help of gradient checkpointing and change of optimizer from AdamW to SM3. Uses fork of aitextgen library.
Please make pull request
king-menin
commented
3 years ago king-menin
commented
3 years ago
https://colab.research.google.com/drive/1lSx9P4C60umxpoROgz3b0OZfy7EcDgrg Perhaps, it could be added in readme? Got it running with help of gradient checkpointing and change of optimizer from AdamW to SM3. Uses fork of aitextgen library.