search

lucidrains / big-sleep

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun
MIT License
2.57k stars 304 forks source link

About warmup step of CLIP #138

Closed Asthestarsfalll closed 2 years ago

Asthestarsfalll commented 2 years ago

I notice that there is a warmup step of CLIP, could you please tell me what the issue is?

with torch.no_grad():
    self.model(self.encoded_texts["max"][0]) # one warmup step due to issue with CLIP and CUDA