search

DachengLi1 / LongChat

Official repository for LongChat and LongEval
Apache License 2.0
504 stars 29 forks source link

Web GUI for longchat #12

Open VVNMA opened 1 year ago

VVNMA commented 1 year ago

Hi, thanks for the great job! But I'd like to know is there a web GUI for this longchat model, it seems that the model worker in Vicuna does not support this model directly, there should be a condense ratio process.

DachengLi1 commented 1 year ago

@VVNMA Thanks for trying out! LongChat is compatible in FastChat that we have implemented the monkey patch in the load_model function. The model worker is using load_model so it should work. Let me know if it does not work and we will take time to fix it!

VVNMA commented 1 year ago

@DachengLi1 Thanks. I saw the replace in the model adapter. But for the gradio server, I have to modify the input and max output token to fit the long chat.

jalajthanaki commented 1 year ago

How can I see an option on UI to increase the context length from 1024 to 16K?