Closed fen0s closed 3 years ago
Hi @fen0s, thanks for your kind words :) We are currently investigating if and how PET can be used in combination with generative models like GPT-2. We'll update this repo once our experiments are finished, but this is probably going to take a while.
This thing looks amazing so far! Anyone tried using it for minimized costs GPT training? If yes, can anyone share examples of generated text, and preferably, how to do it?