iejMac / clip-video-encode

Easily compute clip embeddings from video frames
MIT License
136 stars 19 forks source link

clip-video-encode: allow setting starting webdataset shard ID for con… #40

Closed iejMac closed 1 year ago

iejMac commented 2 years ago

…tinuing/splitting work

iejMac commented 2 years ago

Not sure if I should merge this, if jobs don't fail often it won't be needed also if they do it's pretty easy to change in the code for those unique cases

iejMac commented 1 year ago

already have a solution for this - the first shard id from the input shards