iejMac / clip-video-encode

Easily compute clip embeddings from video frames
MIT License
132 stars 19 forks source link

Improve webdataset code #80

Closed iejMac closed 11 months ago

iejMac commented 11 months ago

https://github.com/iejMac/clip-video-encode/blob/ff390b01091e9d93263d3cb4e8a747fb4143cc1d/clip_video_encode/clip_video_encode.py#L133 - this function sucks

iejMac commented 11 months ago

it doesn't need to be overfit to those 3 types of extensions. Instead make a dict of types of files inside

iejMac commented 11 months ago

dict["ext"] = ["1.ext", "2.ext", ...] ids = [1, 2, ...]