SystemSculpt / obsidian-systemsculpt-ai

Enhance your Obsidian App experience with AI-powered tools for note-taking, task management, and much, MUCH more.
MIT License
100 stars 13 forks source link

Ollama context length setting "num_ctx" for a very long text #61

Open antonsapt4 opened 2 months ago

antonsapt4 commented 2 months ago

Hi I just installed this great plugin, and looking if there are setting to for "num_ctx" because I seems cannot find it on the Brain sections.

Forgive me if its already present and if not, it might be a good additions because Ollama will use default value that make the context and prompt truncated. https://github.com/ollama/ollama/blob/main/docs/api.md

image

Thanks!

SystemSculpt commented 2 months ago

This isn't a feature yet, but I may add it. I'm really teetering on a fine line of trying my best not to overcomplicate things for users, but also allow for fine-tuning in cases such as your own. I'm going to keep this issue open to see if there's any interest from other people, as well as open for when I do the larger update of offering both a simplified, typical user-friendly version in combination with an expert mode that you can toggle on and mess with all of these more specific settings.

josh-stephens commented 2 months ago

That sounds like a great idea Mike, I want control over advanced settings with clear descriptions of what they do, but with sensible easy mode defaults. I’m glad you’re leaving this PR open for additional feedback. On Sep 13, 2024 at 11:34 AM -0700, SystemSculpt @.***>, wrote:

This isn't a feature yet, but I may add it. I'm really teetering on a fine line of trying my best not to overcomplicate things for users, but also allow for fine-tuning in cases such as your own. I'm going to keep this issue open to see if there's any interest from other people, as well as open for when I do the larger update of offering both a simplified, typical user-friendly version in combination with an expert mode that you can toggle on and mess with all of these more specific settings. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: @.***>