search

khoj-ai / khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (e.g gpt, claude, gemini, llama, qwen, mistral).
https://khoj.dev
GNU Affero General Public License v3.0
15.92k stars 785 forks source link

[FIX] Allow Setting File Types to Sync from Obsidian #893

Closed Haqbani closed 2 months ago

Haqbani commented 3 months ago

Describe the bug

i get this eveytime i click update or restart "Failed to sync your content with Khoj server.Requests were throttled. Upgrade your subscription or try again "

To Reproduce

Steps to reproduce the behavior:

Screenshots

Xnapper-2024-08-20-23 41 30

Platform

If self-hosted

Additional context

Add any other context about the problem here.

sabaimran commented 3 months ago

Hey @Haqbani , do you mind shooting me an email to tell me what email address is associated with your Khoj cloud account? We do have a limit configured for a given packet of data to be limited to 75mb for unsubscribed users and 100mb for subscribed users. Is it possible that your Obsidian knowledge base is larger than that?

Haqbani commented 3 months ago

Hello Dear,

Thanks for getting back to me. my email in Khoj is @.***

best,

On Wed, Aug 21, 2024 at 3:32 AM sabaimran @.***> wrote:

Hey @Haqbani https://github.com/Haqbani , do you mind shooting me an email to tell me what email address is associated with your Khoj cloud account? We do have a limit configured for a given packet of data to be limited to 75mb for unsubscribed users and 100mb for subscribed users. Is it possible that your Obsidian knowledge base is larger than that?

— Reply to this email directly, view it on GitHub https://github.com/khoj-ai/khoj/issues/893#issuecomment-2299990576, or unsubscribe https://github.com/notifications/unsubscribe-auth/AV77CVTDYYX4C3MD7KDQHALZSPN3TAVCNFSM6AAAAABM2VSO7KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJZHE4TANJXGY . You are receiving this because you were mentioned.Message ID: @.***>

Haqbani commented 3 months ago

are there any feedback on this ?

On Wed, Aug 21, 2024 at 1:15 PM Mohammad Haqbani @.***> wrote:

Hello Dear,

Thanks for getting back to me. my email in Khoj is @.***

best,

On Wed, Aug 21, 2024 at 3:32 AM sabaimran @.***> wrote:

Hey @Haqbani https://github.com/Haqbani , do you mind shooting me an email to tell me what email address is associated with your Khoj cloud account? We do have a limit configured for a given packet of data to be limited to 75mb for unsubscribed users and 100mb for subscribed users. Is it possible that your Obsidian knowledge base is larger than that?

— Reply to this email directly, view it on GitHub https://github.com/khoj-ai/khoj/issues/893#issuecomment-2299990576, or unsubscribe https://github.com/notifications/unsubscribe-auth/AV77CVTDYYX4C3MD7KDQHALZSPN3TAVCNFSM6AAAAABM2VSO7KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJZHE4TANJXGY . You are receiving this because you were mentioned.Message ID: @.***>

sabaimran commented 3 months ago

Can you send me an email from your account to team at khoj.dev? It gets censored out in the GitHub issue.

Haqbani commented 3 months ago

Can you send me an email from your account to team at khoj.dev? It gets censored out in the GitHub issue.

hi, i have sent it.

huachuman commented 2 months ago

is there a way to only upload notes and not the entire vault? a single piece of media or audio file could send someone over the limit.

Haqbani commented 2 months ago

is there a way to only upload notes and not the entire vault? a single piece of media or audio file could send someone over the limit.

I certainly hope so. From what I understand, there is no option to exclude file types. Although I don't have any media, I do have over 300 notes, and I think I have exceeded the limit. Unfortunately, this isn't worth the $30 monthly price. I'm currently waiting for their feedback.

sabaimran commented 2 months ago

@huachuman are you also using obsidian? We're going to add in a filter to the plugin that allows you to exclude media files. Others have reported this issue as well.

@Haqbani sorry for the delay! Just responded back to you via email. Let's see if we can increase the rate limits to support your data size.

huachuman commented 2 months ago

@sabaimran yes I'm using Obsidian. Now I understand why it never worked. Even just a single media file can send you over the limit despite the fact that all my .md notes combined are less than 5mb.