openai / DALL-E

PyTorch package for the discrete VAE used for DALL·E.
Other
10.77k stars 1.94k forks source link

questions on notebook #13

Closed metaphorz closed 3 years ago

metaphorz commented 3 years ago

I just downloaded the repo to my local file system and used jupyter notebook and then opened and played the notebook. I also downloaded the encoder and decoder to the same folder for ease of loading. It says that 'preprocess' is not defined, but it seems to be. Admittedly, a bit rusty. Running Python 3.9 on Mac OSX. Also, I may be way out of line with respect to the purpose, but I was expecting to see code that took natural language input (e.g. "Show me a penguin on snow") and then DALL*E returns the provided image.

Screen Shot 2021-02-27 at 9 51 37 PM

Originally posted by @metaphorz in https://github.com/openai/DALL-E/issues/5#issuecomment-787310649

woctezuma commented 3 years ago

I was expecting to see code that took natural language input (e.g. "Show me a penguin on snow") and then DALL*E returns the provided image.

The text encoder was not publicly released.

https://github.com/openai/DALL-E/issues/4

amish-logicwind commented 3 years ago

@woctezuma What do you mean? Can't we input a sentence and expect images as output? Forgive me, if this is silly. Please let me know.

woctezuma commented 3 years ago

Can't we input a sentence and expect images as output?

You don't have access to the text encoder, so you cannot input a sentence.