chrisrude / oobabot

A Discord bot which talks to Large Language Model AIs running on oobabooga's text-generation-webui
MIT License
101 stars 34 forks source link

Feature request : Can you do something so it can generate full text, not always splitting #15

Closed TruthSearchers closed 1 year ago

TruthSearchers commented 1 year ago

First of all i tried bot and it's amazing really loved it

Some improvement if i can suggest like let's suppose someone want an article or code But the problem coming is that it split the code making in multiple lines

If you can do something it can generate long replies and code Plus also split when needed

Skrownerve commented 1 year ago

I would also prefer it not to send multiple messages in rapid succession, just in general. If this could be configurable, that'd be great. I saw that this is apparently considered "good Discord hygiene", but as a long-time Discord user and admin/moderator of large communities, I'm not really sure how rapid-fire messages when you have a lot to say could be "good hygiene". I've always thought it made more sense to include everything in a single message.

TruthSearchers commented 1 year ago

If text streaming can be done on discord , it will be so cool

chrisrude commented 1 year ago

I've added a --dont-split-responses option which will bundle the entire response into a single message.

This doesn't address the "only split when needed" request, though, but should address @Skrownerve's concern.

The fix should be included in v0.1.6, which I expect to have show up next week.

chrisrude commented 1 year ago

Closing issue even though I don't have it sometimes-splitting, because I honestly don't know how I'd detect when to split and when not to. If anyone has any ideas on a reliable heuristic for that, please feel free to drop a comment.