search

soniajoseph / ViT-Prisma

ViT Prisma is a mechanistic interpretability library for Vision Transformers (ViTs).
Other
165 stars 18 forks source link

Support loading tiny clip #85

Closed themachinefan closed 6 months ago

themachinefan commented 7 months ago

work with @PraneetNeuro

Tinyclip adds a layernorm near start of the model but doesn't use bertblock so I had to change the config a bit

Unrelated but I also added back the stop_at_layer option