search

jhc13 / taggui

Tag manager and captioner for image datasets
GNU General Public License v3.0
749 stars 35 forks source link

[Feature Request] Phi3 Vision 128K Instruct #158

Closed Njasa2k closed 3 months ago

Njasa2k commented 5 months ago

https://huggingface.co/microsoft/Phi-3-vision-128k-instruct

Koitenshin commented 4 months ago

I would like support for this model as well. Supposedly it can be run with less than 8GB of VRAM.

https://huggingface.co/microsoft/Phi-3-vision-128k-instruct/discussions/44

jhc13 commented 3 months ago

This model has been added in v1.30.0.

Seedmanc commented 2 months ago

I wonder what kind of Rtx 30xx has less than 8Gb of ram and what is even the point of low VRAM requirements if it won't run on larger but older cards.