search

microsoft / onnxruntime-genai

Generative AI extensions for onnxruntime
MIT License
448 stars 105 forks source link

Loading Image from bytes #565

Closed msciancalepore98 closed 3 months ago

msciancalepore98 commented 3 months ago

Hey, I am trying to integrate your phi-3-vision script into LitServe.

How can I use the already loaded image (bytes) and pass it to the processor? (I don't want to save it as local/tmp file)

Thanks

baijumeswani commented 3 months ago

Hi sorry for the late response. We do not have support for loading an image from bytes at this point.

We can enhance the usage for the next release 0.4.0.