Refactor in several libs to make this smaller and easier to reason about

rom1504 / clip-retrieval

Easily compute clip embeddings and build a clip retrieval system with them

https://rom1504.github.io/clip-retrieval/

MIT License

2.42k stars 213 forks source link

Refactor in several libs to make this smaller and easier to reason about #144

Open rom1504 opened 2 years ago

rom1504 commented 2 years ago

Initially this repo was about integrating multiple small components into a simple retrieval system it now growed a lot and got a lot more features and it's becoming too big

to grow in a reasonable way, let's extract big components in smaller libs and use them here:

[ ] clip inference
[ ] clip back
[ ] clip filter
[x] all-clip

should be independent libs

img2dataset and autofaiss are already independent

rom1504 commented 2 years ago

Now even more important with clip client has it wouldn't need much dependencies at all if it was its own module

dmarx commented 2 years ago

i might tinker with this refactor