your-papa / obsidian-Smart2Brain

An Obsidian plugin to interact with your privacy focused AI-Assistant making your second brain even smarter!
GNU Affero General Public License v3.0
526 stars 33 forks source link

a single document was longer than the context. should not happen as we split documents #68

Open STOI123 opened 5 months ago

STOI123 commented 5 months ago

What happened?

image

Error Statement

No response

Smart Second Brain Version

0.6.0

Debug Info

[PAPA] Retrieved Docs (1000) [AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, …] [0 … 99] [100 … 199]

PAPA] Running RAG... Input: {isRAG: true, userQuery: '我有在哪里描述了我个人的生活细节吗', chatHistory: 'Assistant: Hello, I am your assistant. How can I h…ts by length in post processing!,). Please retry.', lang: 'en'} chatHistory : "Assistant: Hello, I am your assistant. How can I help you?\nUser: 我有在哪里描述了我个人的生活细节吗\nAssistant: Failed to run Smart Second Brain (Error: ,Error: A single document was longer than the context length. Should not happen as we split documents by length in post processing!,). Please retry.\nUser: 我有在哪里描述了我个人的生活细节吗\n\n\nAssistant: Failed to run Smart Second Brain (Error: ,Error: A single document was longer than the context length. Should not happen as we split documents by length in post processing!,). Please retry." isRAG : true lang : "en" userQuery : "我有在哪里描述了我个人的生活细节吗" [[Prototype]] : Object

jkunczik commented 4 months ago

I get the same error. However, I do only see it as a notification in obsidian, not in the console (although the debugging console is enabled)

Obsidian Log:

[PAPA] Running RAG... Input: {isRAG: true, userQuery: 'Gib mir eine Zusammenfassung über meine Aufgaben.', chatHistory: 'Assistant: Hallo, ich bin dein Assistent. Ich gebe…wenn ich nicht sicher über einen Sachverhalt bin.', lang: 'de'}chatHistory: "Assistant: Hallo, ich bin dein Assistent. Ich gebe kurze und prägnante Antworten und suche dir die relevanten Informationen heraus. Dabei gebe ich dir immer Quellen an und sage, wenn ich nicht sicher über einen Sachverhalt bin."isRAG: truelang: "de"userQuery: "Gib mir eine Zusammenfassung zum Dedalus Architektur-Review"[[Prototype]]: Object

ollama log:

Apr 22 14:21:51 llm ollama[5355]: {"function":"process_single_task","level":"INFO","line":1506,"msg":"slot data","n_idle_slots":1,"n_processing_slots":0,"task_id":16,"tid":"140626095165440","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"log_server_request","level":"INFO","line":2734,"method":"GET","msg":"request","params":{},"path":"/health","remote_addr":"127.0.0.1","remote_port":41390,"status":200,"tid":"140625005064192","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"process_single_task","level":"INFO","line":1506,"msg":"slot data","n_idle_slots":1,"n_processing_slots":0,"task_id":17,"tid":"140626095165440","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"log_server_request","level":"INFO","line":2734,"method":"GET","msg":"request","params":{},"path":"/health","remote_addr":"127.0.0.1","remote_port":41390,"status":200,"tid":"140625005064192","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"launch_slot_with_data","level":"INFO","line":830,"msg":"slot is processing task","slot_id":0,"task_id":18,"tid":"140626095165440","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"update_slots","level":"INFO","line":1836,"msg":"kv cache rm [p0, end)","p0":0,"slot_id":0,"task_id":18,"tid":"140626095165440","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"update_slots","level":"INFO","line":1640,"msg":"slot released","n_cache_tokens":21,"n_ctx":2048,"n_past":21,"n_system_tokens":0,"slot_id":0,"task_id":18,"tid":"140626095165440","timestamp":1713788511,"truncated":false}
Apr 22 14:21:51 llm ollama[5355]: {"function":"log_server_request","level":"INFO","line":2734,"method":"POST","msg":"request","params":{},"path":"/embedding","remote_addr":"127.0.0.1","remote_port":41390,"status":200,"tid":"140625005064192","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[2108]: [GIN] 2024/04/22 - 14:21:51 | 200 |  105.618767ms |   XXX.XXX.100.67 | POST     "/api/embeddings"
richardstevenhack commented 2 months ago

I get the same error.