design inspiration - Githubissues

dmarx / Multi-Modal-Comparators

Unified API to facilitate usage of pre-trained "perceptor" models, a la CLIP

39 stars 4 forks source link

design inspiration #1

Closed dmarx closed 2 years ago

dmarx commented 2 years ago

https://github.com/rwightman/pytorch-image-models/blob/master/timm/models/registry.py

dmarx commented 2 years ago

crowsonkb's clip-guided diffusion 256 - https://colab.research.google.com/drive/12a_Wrfi2_gwwAuN3VvMTwVMz9TfqctNj
nshepp's JAX CLIP v2.7 - https://colab.research.google.com/drive/1Z5kK1WXTkYoMAVN6FqkQg0Fa4bE5BnxG#scrollTo=OXQ2Di_LRM46
PyTTI-tools (bloated) - https://github.com/pytti-tools/pytti-core/tree/main/src/pytti/Perceptor
pbaylies CLIP/TIMM feature extraction - https://gist.github.com/pbaylies/a9358252df1b874d3248071e6fe6dd25
AK's clip-guided diffusion - https://github.com/afiaka87/clip-guided-diffusion
https://github.com/bes-dev/pytorch_clip_guided_loss
https://github.com/pixray/pixray
https://github.com/kakaobrain/minDALL-E
https://github.com/gnobitab/FuseDream

dmarx commented 2 years ago

Victor recommends this multi-perceptor implementation: https://colab.research.google.com/drive/1peZ98vBihDD9A1v7JdH5VvHDUuW5tcRK?usp=sharing#scrollTo=YWGR8q9AT8uk