请问MiniCPM-V能使用类似stream为True的参数来实现流式生成吗？

OpenBMB / MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

Apache License 2.0

11.83k stars 831 forks source link

Closed huu3301 closed 3 months ago

huu3301 commented 5 months ago

请问MiniCPM-V如何使用流式的方式生成？像是使用transformers的streamer之类的。

iceflame89 commented 5 months ago

感谢关注，我们近期会支持流式输出

Cuiunbo commented 3 months ago

Add this to future plan

chuangzhidan commented 2 months ago

感谢关注，我们近期会支持流式输出

现在可以了吗