Mintplex-Labs / anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.
https://anythingllm.com
MIT License
26.55k stars 2.65k forks source link

[BUG]: Error importing Github repository #1296

Closed giovanniscalar closed 6 months ago

giovanniscalar commented 6 months ago

How are you running AnythingLLM?

Docker (local)

What happened?

When you use data connector for import an entire Github repository, the folders on the repo aren't imported.

Are there known steps to reproduce?

image
timothycarambat commented 6 months ago

If you hover over the triangle icon you will see why that is the case. if you do not define a PAT for this connector only the top-level files are retrieved as to prevent a rate-limiting error from deep-nesting of the repo

giovanniscalar commented 6 months ago

Sorry I thought the access token was required for private repositories only. I will try that.

Freffles commented 6 months ago

FYI, you can get your PAT via this link (assuming you are logged in 😁) https://github.com/settings/tokens?type=beta