-
screens / installation
https://disk.yandex.ru/i/kCSzh6LodRkWlQ
![Снимок экрана 2021-03-03 в 16 35 14](https://user-images.githubusercontent.com/19212675/110199956-34108e00-7e6c-11eb-9ae0-e749f46…
-
I just downloaded the repo to my local file system and used jupyter notebook and then opened and played the notebook. I also downloaded the encoder and decoder to the same folder for ease of loading. …
-
_# Original post by @kobiso https://github.com/lucidrains/DALLE-pytorch/discussions/131#discussioncomment-640446_
**Go give them a rocket emoji!**
## Attention type ('full', 'axial_row', 'axial_…
-
The snails on the README have always been curious to me. I wasn't around when that was produced - but it's definitely not a result any of us have been even close to producing yet. What's the story the…
-
I would love to start training with this! I helped to write a Dataloader for the "COCO" format i.e. images and text files containing line separated captions. They are matched in the data loader via th…
-
# GPT-3 : Language Models are few-shot Learner
## 2. Approach
- GPT2의 Pretraining 방법론과 전반적으로 동일하며, GPT3는 모델의 사이즈와 데이터의 사이즈, 다양성, 학습의 길이를 키운 것임.
- in-context learning 같은 기법들도 역시 GPT2와 유사함 (입력 데이터를…
-
In case you haven't read my usual disclaimer: this data set is weird. The repetition in the OpenAI images causes those to be highly overfit (mannequins) and the remainder of the dataset is _much_ more…
-
- AI News
- NeurIPS submission 수고 많으셨습니다. 드디어 2021년도 한해농사 작업까진 종료!
- KLUE Day: https://www.facebook.com/groups/TensorFlowKR/permalink/1489810094693377
- 6월 1일, 19:30!
- KLUE 연구자들이 모여 직…
-
@lucidrains I believe the relevant line is here:
https://github.com/lucidrains/DALLE-pytorch/blob/2268864941d8eef2ba73a4488fe05673d447d493/dalle_pytorch/dalle_pytorch.py#L306
I tried adding it i…
-
> A token is any symbol from a discrete vocabulary; for humans, each English letter is a token from a 26-letter alphabet. DALL·E’s vocabulary has tokens for both text and image concepts. Specificall…