Has Moondream be tried with Microsoft DirectML?

vikhyat / moondream

tiny vision language model

https://moondream.ai

Apache License 2.0

5.59k stars 463 forks source link

Open Tsardoz opened 5 months ago

Tsardoz commented 5 months ago

Other GPU's eg. Intel ARC 770? Thinking of buying a server for Moondream and the ARC 770's are cheap.

vikhyat commented 3 weeks ago

This should be possible now with the ONNX client implementation.