search

BAAI-DCAI / Bunny

A family of lightweight multimodal models.
Apache License 2.0
894 stars 67 forks source link

Quick start The demo running time is abnormal #59

Closed chenzhu005774 closed 5 months ago

chenzhu005774 commented 5 months ago

image image I used a fast-start demo that took 30 seconds to complete on a 4090Ti. image But I use the web service interface processing time only needs 200ms, read the code, the core reasoning method and parameters are basically the same, could you tell me why, thank you

RussRobin commented 5 months ago

We've updated quick-start snippet, please check it out. Sorry for previous confusions.

BTW, offset_bos should be 0 for Bunny-v1.0-3B.