search

lucidrains / DALLE2-pytorch

Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
MIT License
11.06k stars 1.08k forks source link

Using home made clip #223

Closed ethancohen123 closed 2 years ago

ethancohen123 commented 2 years ago

Hi, Is there a way to use a different CLIP modules that is home made ? If yes, is there any guidelines for what it should return to work with dalle-2 ?

lucidrains commented 2 years ago

@ethancohen123 Hi Ethan

Yea it is possible, if you adhere to this interface https://github.com/lucidrains/DALLE2-pytorch/blob/main/dalle2_pytorch/dalle2_pytorch.py#L196

What does your home made CLIP look like? Is it sitting in a repository somewhere?

RaSah673 commented 2 years ago

Hi, Is the DALLE-2 Pytorch an open source project? Can I use it to develop for absolutely different text-to-image generation project? If yes, how can I remove pretreating images and add my own ones?

lucidrains commented 2 years ago

@RaSah673 yup, it is MIT licensed, which means you can do whatever you want with the codebase!

RaSah673 commented 2 years ago

Thank you [lucidrains], but with "... you can do whatever you want with the codebase!" do you mean that there is also something else besides the codebase that is not open source?

lucidrains commented 2 years ago

@RaSah673 not really, everything is open sourced

you can play around with a preliminary model here