Add support for PaliGemma and Quant Siglip

Blaizzy / mlx-vlm

MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.

MIT License

234 stars 20 forks source link

Closed Blaizzy closed 4 months ago

Blaizzy commented 4 months ago

Add right padding for irregular size models(i.e., SigLip)
Add PaliGemma (image-text-to-text). Supported: google/paligemma-3b-mix-224 & google/paligemma-3b-mix-448

Closes #23

awni commented 4 months ago

Let's go 🚀 !

Blaizzy commented 4 months ago

Thanks @josefalbers for helping me pinpoint the bug!