iejMac / clip-video-encode

Easily compute clip embeddings from video frames
MIT License
136 stars 19 forks source link

support for separate multi-node cpu/gpu worker functionality #30

Closed iejMac closed 2 years ago

iejMac commented 2 years ago

implement some class that gets a set of file names (numpy arrays), watches directory for them, and loads/encodes them using CLIP and saves somewhere else

this will be useful for when we have a process that can be put on a cpu worker that will decode videos and place them in some common directory for the GPU worker to encode

w need this because CLIP encode/GPU samples/s >>> Video decode/CPU samples/s

iejMac commented 2 years ago

Implemented here - https://github.com/iejMac/clip-video-encode/pull/31

Will close issue when some testing is implemented for this + New Release is made