how to run llava on google cloud TPU?

haotian-liu / LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

https://llava.hliu.cc

Apache License 2.0

19.27k stars 2.12k forks source link

how to run llava on google cloud TPU? #250

Open mbaloch opened 1 year ago

mbaloch commented 1 year ago

Question

I am trying to run the LLaVa project on a Google Cloud TPU VM. However, I am encountering an error message stating that no GPU is available. I am wondering if there is a way to make LLaVa compatible with Google Cloud TPU.

haotian-liu commented 1 year ago

Unfortunately I do not have access to TPU currently. Hope the community can have a solution to this!

coolrazor007 commented 10 months ago

@haotian-liu I have access to TPU hardware (like several servers) if you're interested in getting Llava working on it. Free compute. Could train models too.

We are currently doing Whisper and Mistral right now. STT and NLP respectively

ImKeTT commented 4 months ago

Is there a solution for running LLaVA on TPU right now?