search

LumenPallidium / neural-file-sorter

A neural network based file sorter. Trains an autoencoder to sort images or audio based on the similarity of their encodings, or uses the OpenAI CLIP model.
MIT License
27 stars 1 forks source link

Add CLIP related features #12

Open LumenPallidium opened 3 years ago

LumenPallidium commented 3 years ago

Distillation on CLIP in image training to facilitate image "understanding" CLIP to describe directories of images

tough stuff

LumenPallidium commented 3 years ago

added main clip functionality in 442db98 (includes CLIP model and methods to get text probs from images, which can then be encoded + embedded)

next step is to add more clip-related dashboard and embedding features