Uploading large pdf times out - chrome browser pops up message to wait or exit page

intel-analytics / ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, MiniCPM, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, GraphRAG, DeepSpeed, vLLM, FastChat, Axolotl, etc.

Apache License 2.0

6.45k stars 1.24k forks source link

Uploading large pdf times out - chrome browser pops up message to wait or exit page #11645

Open js333031 opened 1 month ago

js333031 commented 1 month ago

Attaching startup console output and console output while trying to use "manage knowledge base" UI. startup.txt browse to UI and switch to manage knowledge base.txt

Setup:

Ubuntu 24.04 LTS
Linux llmtest 6.8.0-38-generic #38-Ubuntu SMP PREEMPT_DYNAMIC Fri Jun 7 15:25:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Hardware (no accelerator): Intel(R) Xeon(R) Gold 6454S
Instructions used: https://github.com/intel-analytics/Langchain-Chatchat/blob/ipex-llm/INSTALL_linux_xeon.md#

Oscilloscope98 commented 1 month ago

Hi @js333031,

Langchain-Chatchat has a limit as 200MB for uploading each knowledge file:

Would you mind letting us know the file size of your pdf so that we could better reproduce your problem?

js333031 commented 1 month ago

My file is around 92MB.

On Tue, Jul 23, 2024 at 10:29 PM Yuwen Hu @.***> wrote:

Hi @js333031 https://github.com/js333031,

Langchain-Chatchat has a limit as 200MB for uploading each knowledge file: image.png (view on web) https://github.com/user-attachments/assets/41c59ad4-759b-4207-997b-4a87b69f347e

Would you mind letting us know the file size of your pdf so that we could better reproduce your problem?

— Reply to this email directly, view it on GitHub https://github.com/intel-analytics/ipex-llm/issues/11645#issuecomment-2246742902, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABT2PN3FJAGZ3GMUSJWXJNDZN4GOZAVCNFSM6AAAAABLKNQ5IWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENBWG42DEOJQGI . You are receiving this because you were mentioned.Message ID: @.***>

hzjane commented 1 month ago

I follw this guide to set up ENV and this guide to load this public 92MB pdf. And it does work normally. Maybe you could try to load this pdf file to test. If it still fails, it may be a problem with the kernel version. We have not tested it on kernels above 6.5 .

Test ENV: Linux spr-14 6.2.0-37-generic 38~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Thu Nov 2 18:01:13 UTC 2 x86_64 x86_64 x86_64 GNU/Linux Hardware:Intel(R) Xeon(R) Platinum 8468 ipex-llm:2.1.0b20240724