search

sail-sg / CLoT

CVPR'24, Official Codebase of our Paper: "Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation".
https://zhongshsh.github.io/CLoT
296 stars 12 forks source link

Use int4 version of Qwen-VL? #6

Open kexul opened 5 months ago

kexul commented 5 months ago

Hi, since int4 version of Qwen-vl is avaialble and more friendly for low end gpu, is it a plug and play model for clot?

kexul commented 5 months ago

Result with int4 version of QwenVL: 图片 Not as funny as your example.

zhongshsh commented 5 months ago

Our model is based on Qwen/Qwen-VL-Chat, and using the int4 version of Qwen-VL directly might compromise the quality of responses. Humor is subjective. You can try generating a few more times to find responses that match your sense of humor.