SillyTavern / SillyTavern-Extras

Extensions API for SillyTavern.
GNU Affero General Public License v3.0
549 stars 124 forks source link

Tasks Checks failing, "Could not extract reply in 5 attempts." #114

Closed fanafo closed 1 year ago

fanafo commented 1 year ago

Running locally. Struggling to get the Objectives plugin to work. When a task check is performed, I get the following error message after a few seconds: "Could not extract reply in 5 attempts. Try generating again." In Oobabooga/text-gen-ui log, I see the following with each check:

127.0.0.1 - - [09/Aug/2023 06:03:16] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.87 seconds (1.15 tokens/s, 1 tokens, context 1767, seed 442926529)
127.0.0.1 - - [09/Aug/2023 06:03:19] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.77 seconds (3.92 tokens/s, 3 tokens, context 1767, seed 894830108)
127.0.0.1 - - [09/Aug/2023 06:03:23] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.86 seconds (3.47 tokens/s, 3 tokens, context 1767, seed 196638932)
127.0.0.1 - - [09/Aug/2023 06:03:28] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.80 seconds (1.25 tokens/s, 1 tokens, context 1767, seed 2105262321)
127.0.0.1 - - [09/Aug/2023 06:03:33] "POST /api/v1/generate HTTP/1.1" 200 -
Output generated in 0.89 seconds (1.12 tokens/s, 1 tokens, context 1767, seed 955783745)
127.0.0.1 - - [09/Aug/2023 06:03:40] "POST /api/v1/generate HTTP/1.1" 200 -

In SillyTavern log, I see the check returning

{ results: [ { text: '\nfalse' } ] }

In SillyTavern Extras:

127.0.0.1 - - [09/Aug/2023 06:03:08] "POST /api/classify HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:15] "OPTIONS /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:16] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:19] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:22] "OPTIONS /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:22] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:27] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:32] "OPTIONS /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:33] "POST /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:39] "OPTIONS /api/chromadb/query HTTP/1.1" 200 -
127.0.0.1 - - [09/Aug/2023 06:03:40] "POST /api/chromadb/query HTTP/1.1" 200 -

Tried with Python versions 3.10 and 3.11. This isn't something I've tried in previous versions of SillyTavern, so I do not know if it used to work before. I know I'm connected to the Extras server, and summarization is working just fine.

I apologize if that's not enough info, please let me know if there's anything else I should add.

Cohee1207 commented 1 year ago

Do you have "trim incomplete sentences" setting enabled? I think it might trim too much from your reply when it receives a reply.

fanafo commented 1 year ago

That was exactly the issue, Cohee, thank you.

Cohee1207 commented 1 year ago

Updated in staging to fix this for future users. Thanks. https://github.com/SillyTavern/SillyTavern/commit/e39e9428b616628e10579369d83a1a88307919bf