When using a larger model on CPU, I tend to switch between chats and queue multiple requests for the model. It would be helpful to have some kind of style/color/icon/tag indication in the Chats pane to show the status of each chat, e.g.:
queued: chats with submitted requests awaiting their turn with the model,
generating: the chat on which the model is currently working (perhaps an animated indicator here),
unread: chats with new, finished, unread responses,
When using a larger model on CPU, I tend to switch between chats and queue multiple requests for the model. It would be helpful to have some kind of style/color/icon/tag indication in the Chats pane to show the status of each chat, e.g.: