Open AmazDeng opened 1 month ago
Hi, thanks for your interest!
it works well at my side. What GPU do you use?
Hi, thanks for your interest!
it works well at my side. What GPU do you use?
A100 80G,only one GPU card
Hi, thanks for your interest!
it works well at my side. What GPU do you use?
I have also tested llava-next-image demo code, the output is right, not empty. which version of sglang do you use?
Could you please take a look at this issue? @merrymercy
I tested the code srt_example_llava_v.py and found that it was unable to produce inference results (the results are empty). The code is as follows: str_example_llava_v.py
srt_example_llava_v.sh
running bash script
terminal output
why?