issues
search
iejMac
/
clip-video-encode
Easily compute clip embeddings from video frames
MIT License
132
stars
19
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Getting bus error while trying to run example code
#86
vedlettuce
opened
8 months ago
0
Use MoVQGAN instead of taming-transformers for tokenization
#85
iejMac
opened
10 months ago
0
Support nested input format for webdataset
#84
iejMac
closed
10 months ago
0
read_shards: generalize and improve
#83
iejMac
closed
11 months ago
0
refactor: move code out of cve.py
#82
iejMac
closed
11 months ago
0
move things out of clip-video-encode.py
#81
iejMac
closed
11 months ago
1
Improve webdataset code
#80
iejMac
closed
11 months ago
2
Chunk selection modes
#79
iejMac
opened
11 months ago
0
clip-video-encode: add target_fps option (video2numpy update)
#78
iejMac
closed
1 year ago
0
clip-video-encode: add VQ-GAN frame tokenization
#77
iejMac
closed
1 year ago
0
remove npz support (no one uses this)
#76
iejMac
closed
1 year ago
0
clip-video-encode: add img_size parameter
#75
imliuruiqi
closed
1 year ago
2
loosen the package version for torch 2.0
#74
imliuruiqi
opened
1 year ago
4
captioning: allow setting params
#73
iejMac
closed
1 year ago
0
ShardWriter: add shard_suffix for external metadata shards
#72
iejMac
closed
1 year ago
0
WebDataset input: pass_through_keys param
#71
iejMac
closed
1 year ago
0
generate_caption_key: Write CoCa to txt or json + add try for shard failures
#70
iejMac
closed
1 year ago
0
Add CLIP similarity if caption exists + add autocast in FrameMapper
#69
iejMac
closed
1 year ago
1
Add similarity to metadata if caption exists
#68
iejMac
closed
1 year ago
0
Add CoCa captioning
#67
iejMac
closed
1 year ago
0
pass_through_mp4: allow saving mp4 as well
#66
iejMac
closed
1 year ago
0
pass through mp4 in input_format="webdataset"
#65
iejMac
closed
1 year ago
0
add support for reading WebDataset inputs
#64
danielmend
closed
1 year ago
0
implement reading video2dataset webdataset format
#63
iejMac
closed
1 year ago
0
clip-video-encode: implement resuming failed runs
#62
iejMac
opened
1 year ago
1
embed the text as well
#61
iejMac
opened
1 year ago
4
examples: add example of EmbeddingWebDatasetReader usage
#60
danielmend
closed
1 year ago
0
add example of how to use EmbeddingWebDataset reader with tar files
#59
iejMac
closed
1 year ago
0
Questions on Data donwload
#58
Buzz-Beater
closed
1 year ago
2
set up resuming for failed runs
#57
iejMac
opened
1 year ago
4
make chunk size variable (can't use 200 size chunks for H/14 clip)
#56
iejMac
opened
1 year ago
2
clip-video-encode: fix, take last chunk as well
#55
iejMac
closed
1 year ago
0
bug fix: each webdataset loses the last 4% of the data
#54
iejMac
closed
1 year ago
2
Multi-GPU distribution for models slower than video decoding
#53
iejMac
closed
1 year ago
0
Fix: Take preprocessing from open_clip + Add sim test
#52
iejMac
closed
1 year ago
0
change the preprocess so it works with open_clip
#51
iejMac
closed
1 year ago
0
multi-gpu distribution
#50
iejMac
closed
1 year ago
0
clip-video-encode: shift to open_clip
#49
iejMac
closed
1 year ago
3
standard process for releasing the best model
#48
iejMac
closed
1 year ago
1
cli : replace fire with argparse
#47
AbdullahAlfaraj
closed
1 year ago
0
README.md, dataset.md + other small updates
#46
iejMac
closed
1 year ago
0
MultiNode (Slurm) - Allow distributing large datasets creation across multiple Slurm nodes
#45
iejMac
closed
1 year ago
1
implement multi-node distribution
#44
iejMac
closed
1 year ago
0
shift to open_clip
#43
iejMac
closed
1 year ago
1
add test for correctness of embeddings
#42
iejMac
closed
1 year ago
0
update README + examples
#41
iejMac
closed
1 year ago
0
clip-video-encode: allow setting starting webdataset shard ID for con…
#40
iejMac
closed
1 year ago
2
clip-video-encode: take parquet as input and save metadata
#39
iejMac
closed
2 years ago
1
clip-video-encode: combine video frames into one chunk for more batch…
#38
iejMac
closed
2 years ago
0
writer.py: option to output in WebDataset format
#37
iejMac
closed
2 years ago
0
Next