mlfoundations / open_clip

An open source implementation of CLIP.
Other
9.15k stars 908 forks source link

Default Transformer MHA to batch_first, enables fastpath for vit #906

Closed rwightman closed 5 days ago

rwightman commented 6 days ago

still need to look at mask changes for text fastpath