search

h2oai / h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
http://h2o.ai
Apache License 2.0
10.96k stars 1.2k forks source link

Windows fatal exception: Access violation #1608

Open InesBenAmor99 opened 1 month ago

InesBenAmor99 commented 1 month ago

Why im getting this error when i upload a scanned pdf file ? everything was working correctly until i changed some configs to make mistral model work on gpu but i guess that is not related to the probleme i have now ''access violation"

Windows fatal exception: access violation

Thread 0x00001828 (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\concurrent\futures\thread.py", line 81 in _worker File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Current thread 0x000014fc (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\compat.py", line 189 in load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\compat.py", line 242 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "", line 241 in _call_with_frames_removed File "", line 1078 in _handle_fromlist File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic__init.py", line 433 in _add_compat File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\init__.py", line 469 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\unstructured\file_utils\filetype.py", line 25 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\unstructured\partition\pdf.py", line 58 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\langchain_community\document_loaders\pdf.py", line 71 in _get_elements File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\langchain_community\document_loaders\unstructured.py", line 88 in lazy_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\langchain_core\document_loaders\base.py", line 29 in load File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4384 in file_to_doc File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4636 in path_to_doc1 File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4933 in File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4933 in path_to_docs File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 8938 in _update_user_db File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 8732 in update_user_db File "C:\Windows\System32\h2ogpt\src\gradio_runner.py", line 7187 in update_user_db_gr File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\gradio\utils.py", line 771 in wrapper File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\anyio_backends_asyncio.py", line 851 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x0000087c (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 324 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 607 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\tqdm_monitor.py", line 60 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00000708 (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 324 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\queue.py", line 180 in get File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\posthog\consumer.py", line 107 in next File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\posthog\consumer.py", line 76 in upload File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\posthog\consumer.py", line 65 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x000019dc (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 797 in _poll File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 444 in select File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 1871 in _run_once File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 603 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 321 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 636 in run_until_complete File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\runners.py", line 44 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\uvicorn\server.py", line 65 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\uvicorn\main.py", line 575 in run File "C:\Windows\System32\h2ogpt\openai_server\server.py", line 374 in run_server File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00000e7c (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 797 in _poll File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 444 in select File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 1871 in _run_once File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 603 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 321 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 636 in run_until_complete File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\runners.py", line 44 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\uvicorn\server.py", line 65 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00000e88 (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 324 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 607 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\apscheduler\schedulers\blocking.py", line 30 in _main_loop File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00000e6c (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\selectors.py", line 315 in _select File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\selectors.py", line 324 in select File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 1871 in _run_once File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 603 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00001aec (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\gradio\blocks.py", line 2507 in block_thread File "C:\Windows\System32\h2ogpt\src\gradio_runner.py", line 6849 in go_gradio File "C:\Windows\System32\h2ogpt\src\gen.py", line 2334 in main File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\fire\core.py", line 691 in _CallAndUpdateTrace File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\fire\core.py", line 475 in _Fire File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\fire\core.py", line 141 in Fire File "C:\Windows\System32\h2ogpt\src\utils.py", line 73 in H2O_Fire File "C:\Windows\System32\h2ogpt\generate.py", line 16 in entrypoint_main File "C:\Windows\System32\h2ogpt\generate.py", line 20 in Windows fatal exception: access violation

Thread 0x00001828 (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\concurrent\futures\thread.py", line 81 in _worker File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Current thread 0x000014fc (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\compat.py", line 189 in load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\compat.py", line 242 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "", line 241 in _call_with_frames_removed File "", line 1078 in _handle_fromlist File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic__init.py", line 433 in _add_compat File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\init__.py", line 469 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\unstructured\file_utils\filetype.py", line 25 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\unstructured\partition\pdf.py", line 58 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\langchain_community\document_loaders\pdf.py", line 71 in _get_elements File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\langchain_community\document_loaders\unstructured.py", line 88 in lazy_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\langchain_core\document_loaders\base.py", line 29 in load File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4384 in file_to_doc File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4636 in path_to_doc1 File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4933 in File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4933 in path_to_docs File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 8938 in _update_user_db File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 8732 in update_user_db File "C:\Windows\System32\h2ogpt\src\gradio_runner.py", line 7187 in update_user_db_gr File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\gradio\utils.py", line 771 in wrapper File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\anyio_backends_asyncio.py", line 851 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x0000087c (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 324 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 607 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\tqdm_monitor.py", line 60 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00000708 (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 324 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\queue.py", line 180 in get File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\posthog\consumer.py", line 107 in next File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\posthog\consumer.py", line 76 in upload File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\posthog\consumer.py", line 65 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x000019dc (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 797 in _poll File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 444 in select File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 1871 in _run_once File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 603 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 321 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 636 in run_until_complete File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\runners.py", line 44 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\uvicorn\server.py", line 65 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\uvicorn\main.py", line 575 in run File "C:\Windows\System32\h2ogpt\openai_server\server.py", line 374 in run_server File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00000e7c (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 797 in _poll File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 444 in select File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 1871 in _run_once File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 603 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py", line 321 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 636 in run_until_complete File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\runners.py", line 44 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\uvicorn\server.py", line 65 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00000e88 (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 324 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 607 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\apscheduler\schedulers\blocking.py", line 30 in _main_loop File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00000e6c (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\selectors.py", line 315 in _select File "Windows fatal exception: access violation

C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\selectors.py", line 324 in select File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 1871 in _run_once File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 603 in run_forever File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00001aec (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\gradio\blocks.py", line 2507 in block_thread File "C:\Windows\System32\h2ogpt\src\gradio_runner.py", line 6849 in go_gradio File "C:\Windows\System32\h2ogpt\src\gen.py", line 2334 in main File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\fire\core.py", line 691 in _CallAndUpdateTrace File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\fire\core.py", line 475 in _Fire File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\fire\core.py", line 141 in Fire File "C:\Windows\System32\h2ogpt\src\utils.py", line 73 in H2O_Fire File "C:\Windows\System32\h2ogpt\generate.py", line 16 in entrypoint_main File "C:\Windows\System32\h2ogpt\generate.py", line 20 in 0 [main] python (6896) C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\python.exe: *** fatal error - Internal error: TP_NUM_C_BUFS too small: 50 Windows fatal exception: access violation

Thread 0x00001828 (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\concurrent\futures\thread.py", line 81 in _worker File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 953 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Current thread 0x000014fc (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\compat.py", line 189 in load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\compat.py", line 242 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "", line 241 in _call_with_frames_removed File "", line 1078 in _handle_fromlist File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic__init.py", line 433 in _add_compat File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\init__.py", line 469 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\unstructured\file_utils\filetype.py", line 25 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\unstructured\partition\pdf.py", line 58 in File "", line 241 in _call_with_frames_removed File "", line 883 in exec_module File "", line 688 in _load_unlocked File "", line 1006 in _find_and_load_unlocked File "", line 1027 in _find_and_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\langchain_community\document_loaders\pdf.py", line 71 in _get_elements File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\langchain_community\document_loaders\unstructured.py", line 88 in lazy_load File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\langchain_core\document_loaders\base.py", line 29 in load File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4384 in file_to_doc File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4636 in path_to_doc1 File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4933 in File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 4933 in path_to_docs File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 8938 in _update_user_db File "C:\Windows\System32\h2ogpt\src\gpt_langchain.py", line 8732 in update_user_db File "C:\Windows\System32\h2ogpt\src\gradio_runner.py", line 7187 in update_user_db_gr File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\gradio\utils.py", line 771 in wrapper File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\anyio_backends_asyncio.py", line 851 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x0000087c (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 324 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 607 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\tqdm_monitor.py", line 60 in run File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 973 in _bootstrap

Thread 0x00000708 (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 324 in wait File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\queue.py", line 180 in get File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\posthog\consumer.py", line 107 in next File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\posthog\consumer.py", line 76 in upload File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\posthog\consumer.py", line 65 in run File "Fatal Python error: Segmentation fault

C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line 1016 in _bootstrap_inner File " Extension modules: _brotliC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, _cffi_backend", line 973 in , _bootstrap

Thread 0x000019dczstandard.backend_c (most recent call first): , charset_normalizer.md File , "mkl._mklinitC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py, mkl._py_mkl_service", , line numpy.core._multiarray_umath797, in numpy.core._multiarray_tests_poll, File "numpy.linalg._umath_linalgC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py, "numpy.fft._pocketfft_internal, line 444, numpy.random._common in , selectnumpy.random.bit_generator File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py"numpy.random._bounded_integers, line , numpy.random._mt199371871, numpy.random.mtrand in , _run_oncenumpy.random._philox , numpy.random._pcg64 File , "numpy.random._sfc64C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 603, in numpy.random._generatorrun_forever File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py"pandas._libs.tslibs.np_datetime, line , pandas._libs.tslibs.dtypes321, in pandas._libs.tslibs.baserun_forever, File "pandas._libs.tslibs.nattypeC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py, ", line 636 in run_until_complete File "pandas._libs.tslibs.timezonesC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\runners.py, "pandas._libs.tslibs.tzconversion, line 44, pandas._libs.tslibs.ccalendar in , runpandas._libs.tslibs.fields File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\uvicorn\server.py"pandas._libs.tslibs.timedeltas, line 65, pandas._libs.tslibs.timestamps in , runpandas._libs.properties File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\uvicorn\main.py"pandas._libs.tslibs.offsets, line , pandas._libs.tslibs.parsing575, in pandas._libs.tslibs.conversionrun, File "pandas._libs.tslibs.periodC:\Windows\System32\h2ogpt\openai_server\server.py, "pandas._libs.tslibs.vectorized, line , pandas._libs.ops_dispatch374, in pandas._libs.missingrun_server, File "pandas._libs.hashtableC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "pandas._libs.algos, line , pandas._libs.interval953, pandas._libs.tslib in , runpandas._libs.lib , pandas._libs.hashing File , "pyarrow.libC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "pandas._libs.ops, line 1016, numexpr.interpreter in , _bootstrap_innerpyarrow._compute , pandas._libs.arrays File , "pandas._libs.indexC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "pandas._libs.join, line 973, pandas._libs.sparse in , _bootstrappandas._libs.reduction , pandas._libs.indexing , pandas._libs.internalsThread 0x, 00000e7cpandas._libs.writers (most recent call first): File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py"pandas._libs.window.aggregations, line , pandas._libs.window.indexers797, in pandas._libs.reshape_poll, File "pandas._libs.tslibs.strptimeC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py, "pandas._libs.groupby, line 444, pandas._libs.testing in , selectpandas._libs.parsers , pandas._libs.json File , "lz4._versionC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py, "lz4.frame._frame, line 1871, psutil._psutil_windows in _run_once, File "fontTools.misc.bezierToolsC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py, "PIL._imaging, line 603, lxml._elementpath in , run_foreverlxml.etree , fontTools.varLib.iup File , "torch._CC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\windows_events.py, "torch._C._fft, line 321, torch._C._linalg in , run_forevertorch._C._nested , torch._C._nn File , "torch._C._sparseC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py, "torch._C._special, line 636, matplotlib._c_internal_utils in , run_until_complete File "matplotlib._pathC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\runners.py, "kiwisolver._cext, line , 44 in runmatplotlib._image , scipy._lib._ccallback_c File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\uvicorn\server.py"scipy.sparse._sparsetools, line 65, _csparsetools in , runscipy.sparse._csparsetools File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", , line 953 in scipy.sparse.linalg._isolve._iterativerun File ", scipy.linalg._fblasC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "scipy.linalg._flapack, line , scipy.linalg.cython_lapack1016, in scipy.linalg._cythonized_array_utils_bootstrap_inner, File "scipy.linalg._solve_toeplitzC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "scipy.linalg._decomp_lu_cython, line 973, scipy.linalg._matfuncs_sqrtm_triu in , _bootstrapscipy.linalg.cython_blas

Thread 0x00000e88, scipy.linalg._matfuncs_expm (most recent call first): File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", , line scipy.linalg._decomp_update324, in scipy.linalg._flinalgwait File ", scipy.sparse.linalg._dsolve._superluC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", , line scipy.sparse.linalg._eigen.arpack._arpack607 in , scipy.sparse.csgraph._toolswait, File "scipy.sparse.csgraph._shortest_pathC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\apscheduler\schedulers\blocking.py", line , 30scipy.sparse.csgraph._traversal in , _main_loop File "C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py"scipy.sparse.csgraph._min_spanning_tree, line 953, scipy.sparse.csgraph._flow in , runscipy.sparse.csgraph._matching File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py"scipy.sparse.csgraph._reordering, line , 1016scipy.optimize._minpack2 in _bootstrap_inner, scipy.optimize._group_columns , scipy._lib.messagestream File , "scipy.optimize._trlib._trlibC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py", line , 973scipy.optimize._lbfgsb in , _bootstrap_moduleTNC , scipy.optimize._moduleTNC , scipy.optimize._cobylaThread 0x, 00000e6cscipy.optimize._slsqp (most recent call first): File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\selectors.py"scipy.optimize._minpack, line , 315scipy.optimize._lsq.givens_elimination in _select, File "scipy.optimize._zerosC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\selectors.py, "scipy.optimize.__nnls, line , scipy.optimize._highs.cython.src._highs_wrapper324, in scipy.optimize._highs._highs_wrapperselect, File "scipy.optimize._highs.cython.src._highs_constantsC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py", line 1871, in scipy.optimize._highs._highs_constants_run_once, File "scipy.linalg._interpolativeC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\asyncio\base_events.py, "scipy.optimize._bglu_dense, line 603, scipy.optimize._lsap in , run_foreverscipy.spatial._ckdtree , scipy.spatial._qhull File , "scipy.spatial._voronoiC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "scipy.spatial._distance_wrap, line 953, scipy.spatial._hausdorff in , runscipy.special._ufuncs_cxx , scipy.special._ufuncs File , "scipy.special._specfunC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "scipy.special._comb, line 1016, scipy.special._ellip_harm_2 in , _bootstrap_innerscipy.spatial.transform._rotation , scipy.optimize._direct File , "PIL._imagingftC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "yaml._yaml, line 973, google._upb._message in _bootstrap , scipy.io.matlab._mio_utils , scipy.io.matlab._streamsThread 0x, 00001aecscipy.io.matlab._mio5_utils (most recent call first): , h5py._errors File , "h5py.defsC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\gradio\blocks.py, "h5py._objects, line 2507, h5py.h5 in , block_thread File "h5py.utilsC:\Windows\System32\h2ogpt\src\gradio_runner.py, "h5py.h5t, line , 6849h5py.h5s in , go_gradioh5py.h5ac File ", h5py.h5pC:\Windows\System32\h2ogpt\src\gen.py, "h5py.h5r, line , 2334h5py._proxy in , mainh5py._conv , h5py.h5z File , "h5py.h5aC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\fire\core.py, "h5py.h5d, line , h5py.h5ds691, in h5py.h5g_CallAndUpdateTrace, File "h5py.h5iC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\fire\core.py, "h5py.h5f, line , 475h5py.h5fd in _Fire, h5py.h5pl , h5py.h5o File , "h5py.h5lC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\fire\core.py, "h5py._selector, line 141 in , pyclipper._pyclipperFire, File "shapely.speedups._speedupsC:\Windows\System32\h2ogpt\src\utils.py, ", line rapidfuzz._feature_detector_cpp73, in H2O_Fire File "rapidfuzz.distance._initialize_cppC:\Windows\System32\h2ogpt\generate.py, "rapidfuzz.distance.metrics_cpp_avx2, line , rapidfuzz.fuzz_cpp_avx216, in rapidfuzz.process_cpp_implentrypoint_main, File "rapidfuzz.utils_cppC:\Windows\System32\h2ogpt\generate.py, "scipy.cluster._vq, line , 20scipy.cluster._hierarchy in , scipy.cluster._optimal_leaf_ordering , sentencepiece._sentencepiece, cython.cimports.libc.mathWindows fatal exception: , access violation

Thread 0x00001828grpc._cython.cygrpc (most recent call first): , scipy.ndimage._nd_image File , _ni_label", scipy.ndimage._ni_labelC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\concurrent\futures\thread.py", line 81, in scipy.integrate._odepack_worker, File "scipy.integrate._quadpackC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "scipy.integrate._vode, line 953 in run File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py"scipy.integrate._dop, line , 1016scipy.integrate._lsoda in _bootstrap_inner File ", scipy.special.cython_specialC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\threading.py, "scipy.stats._stats, line 973, scipy.stats.beta_ufunc in _bootstrap, scipy.stats._boost.beta_ufunc, scipy.stats.binom_ufunc

, scipy.stats._boost.binom_ufuncCurrent thread 0x, 000014fc (most recent call first): scipy.stats.nbinom_ufunc File , scipy.stats._boost.nbinom_ufunc", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\compat.py", line scipy.stats.hypergeom_ufunc189, in scipy.stats._boost.hypergeom_ufunc, scipy.stats.ncf_ufuncload File ", C:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic\compat.py"scipy.stats._boost.ncf_ufunc, line 242 in , scipy.stats.ncx2_ufunc , scipy.stats._boost.ncx2_ufunc File , "scipy.stats.nct_ufunc, "scipy.stats._boost.nct_ufunc, line 241, in scipy.stats.skewnorm_ufunc_call_with_frames_removed, File "scipy.stats._boost.skewnorm_ufunc, "scipy.stats.invgauss_ufunc, line , 883 in exec_module File "scipy.stats._boost.invgauss_ufunc, "scipy.interpolate._fitpack, line , 688scipy.interpolate.dfitpack in _load_unlocked, scipy.interpolate._bspl , scipy.interpolate._ppoly File , "scipy.interpolate.interpnd", , line scipy.interpolate._rbfinterp_pythran1006 in , scipy.interpolate._rgi_cython_find_and_load_unlocked, File "scipy.stats._biasedurn, "scipy.stats._levy_stable.levyst, line , 1027scipy.stats._stats_pythran in _find_and_load, scipy._lib._uarray._uarray , scipy.stats._statlib File , "scipy.stats._sobol, "scipy.stats._qmc_cy, line , 241scipy.stats._mvn in _call_with_frames_removed, scipy.stats._rcont.rcont File "", line , 1078multidict._multidict in , _handle_fromlist File "yarl._quoting_cC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic__init__.py, "aiohttp._helpers, line 433, aiohttp._http_writer in , aiohttp._http_parser_add_compat, aiohttp._websocket File ", frozenlist._frozenlistC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\magic__init.py, "sqlalchemy.cyextension.collections, line 469, sqlalchemy.cyextension.immutabledict in , sqlalchemy.cyextension.processors File ", sqlalchemy.cyextension.resultproxy, "sqlalchemy.cyextension.util, line , 241greenlet._greenlet in _call_with_frames_removed File ", PIL._imagingmath, "PIL._webp, line , 883regex._regex in , exec_module File "sklearn.check_build._check_build, "sklearn.utils._isfinite, line , 688sklearn.utils.murmurhash in _load_unlocked, sklearn.utils._openmp_helpers , sklearn.utils.sparsefuncs_fast File , "sklearn.preprocessing._csr_polynomial_expansion, ", line 1006 in sklearn.preprocessing._target_encoder_fast_find_and_load_unlocked, File "sklearn.utils._vector_sentinel, "sklearn.feature_extraction._hashing_fast, line , pycrfsuite._pycrfsuite1027 in , sklearn.utils._random_find_and_load, File "sklearn.utils._seq_datasetC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\unstructured\file_utils\filetype.py", line 25, in sklearn.metrics.cluster._expected_mutual_info_fast, File "sklearn.metrics._dist_metrics, "sklearn.metrics._pairwise_distances_reduction._datasets_pair, line 241, sklearn.utils._cython_blas in , _call_with_frames_removedsklearn.metrics._pairwise_distances_reduction._base File ", sklearn.metrics._pairwise_distances_reduction._middle_term_computer, "sklearn.utils._heap, line 883, sklearn.utils._sorting in , exec_modulesklearn.metrics._pairwise_distances_reduction._argkmin File ", sklearn.metrics._pairwise_distances_reduction._argkmin_classmode, "sklearn.metrics._pairwise_distances_reduction._radius_neighbors, line 688, sklearn.metrics._pairwise_distances_reduction._radius_neighbors_classmode in _load_unlocked, sklearn.metrics._pairwise_fast , sklearn.linear_model._cd_fast File , "sklearn._loss._loss, "sklearn.utils.arrayfuncs, line 1006 in , _find_and_load_unlocked File "sklearn.svm._liblinear, "sklearn.svm._libsvm, line , 1027sklearn.svm._libsvm_sparse in , sklearn.utils._weight_vector_find_and_load, sklearn.linear_model._sgd_fast File , "sklearn.linear_model._sag_fastC:\Users\Ines_Ben_Amor\miniconda3\envs\weensi\lib\site-packages\unstructured\partition\pdf.py", line 58, in sklearn.datasets._svmlight_format_fast , websockets.speedups File , "ujson, "markupsafe._speedups, line 241, in httptools.parser.parser_call_with_frames_removed File ", "httptools.parser.url_parser, line , 883fitz._extra in , exec_modulefitz._mupdf File ", _pillow_heif (total: "286, line )688 in _load_unlockedWindows fatal exception: access violation File "

", line
pseudotensor commented 1 month ago

Looks like pymupdf or scipy is failing. I am not sure what to do about that.

InesBenAmor99 commented 1 month ago

After testing multiple times, I consistently encounter the same error: "Windows fatal exception: access violation." This occurs sometimes even when attempting to import PDF (sometimes it works for pdf files and sometimes no) or DOCX files, or choosing ocr option , I am working on a Windows virtual machine deployed on Azure. Could the issue be related to memory constraints?

pseudotensor commented 1 month ago

Hi, sorry you are having trouble. It could be related to using a windows virtual machine instead of native windows, but I don't know for sure.