[Cloud] Create new Knowledge Base from Notion - Batch upload limit

[davidphamle]

Self Checks

• [X] This is only for bug report, if you would like to ask a question, please head to Discussions.
• [X] I have searched for existing issues search for existing issues, including closed ones.
• [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [X] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• [X] Please do not modify this template :) and fill in all the required fields.

Dify version

0.6.13

Cloud or Self Hosted

Cloud

Steps to reproduce

As a Pro Dify customer:

1. In Knowledge - Click on create knowledge
2. Click on Sync from Notion
3. Select a folder
4. Click on Save and Process

✔️ Expected Behavior

Able to save and process

❌ Actual Behavior

Cannot save, error message of 20 batch upload limit appears

[dosubot[bot]]

To resolve the batch upload limit of 20 when trying to create a new Knowledge Base by syncing from Notion in Dify.ai cloud service, version 0.6.13, you will need to split your uploads into multiple batches, each containing no more than 20 files. The documentation specifies:

validation: {
  filesNumber: 'You have reached the batch upload limit of {{filesNumber}}.',
}

Therefore, if you have more than 20 files to upload, you should divide them into groups of 20 or fewer and upload each group separately ^[1][2].

To continue talking to Dosu, mention @dosu.

[crazywoola]

@JohnJyong

[crazywoola]

I have checked this setting, we do have a limit on total numbers that can be uploaded. Not only for the free tier, but also for team and pro subscription.

[davidphamle]

Yeah, but it didn't make sense since with a knowledge base of more than 20 pages, I can't not add the knowledge in or break it down to into smaller batch to upload

On Fri, Jul 12, 2024, 4:52 PM crazywoola @.***> wrote:

I have checked this setting, we do have a limit on total numbers that can be uploaded. Not only for the free tier, but also for team and pro subscription.

— Reply to this email directly, view it on GitHub https://github.com/langgenius/dify/issues/6218#issuecomment-2224981215, or unsubscribe https://github.com/notifications/unsubscribe-auth/A43SUMVWLRMLX2AO2ZBBKQLZL572NAVCNFSM6AAAAABKYCCBSWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMRUHE4DCMRRGU . You are receiving this because you authored the thread.Message ID: @.***>

[crazywoola]

In order to maintain the stability of our platform services, we previously imposed a limit on the number of batch uploads. We have now adjusted the batch upload limit for paid customers to 50, allowing you to upload up to 50 files/webpage contents simultaneously. We will continue to optimize new solutions to meet customer needs for flexible resource expansion.

Link https://discord.com/channels/1082486657678311454/1263361877157613688