NVIDIA / ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM
Other
2.67k stars 312 forks source link

infinite loading screen. #90

Closed 111100001 closed 3 weeks ago

111100001 commented 3 weeks ago

i reinstalled multiple times and that didn't fix it. someone on reddit comments reported the same issue (op is me)

image

image

sueyda commented 3 weeks ago

resim_2024-08-26_162743606 same problem very annoying.

anujj commented 3 weeks ago

Can you please launch the 'Nvidia chatrtx.exe' from cmd and share me the cmd logs the exe is located at: C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\dist\win-unpacked

anujj commented 3 weeks ago

are you installing though the NvAPP ?

sueyda commented 3 weeks ago

yes

spacevini8 commented 3 weeks ago

yea I have the exact same issue

111100001 commented 3 weeks ago

UPDATE: i have fixed the issue by launching the app_launch.py from the CMD (admin mode) python3 app_launch.py and i got an error that said no module named win32process was found

i looked it up and found similar issue in another software but the solution was to install pypiwin32 using pipand tried running the app again and it worked

pip install -U pypiwin32

spacevini8 commented 3 weeks ago

still not working for me

edit: nope, it's working, thanks bro.

drandarov-io commented 2 weeks ago

UPDATE: i have fixed the issue by launching the app_launch.py from the CMD (admin mode) python3 app_launch.py and i got an error that said no module named win32process was found

i looked it up and found similar issue in another software but the solution was to install pypiwin32 using pipand tried running the app again and it worked

pip install -U pypiwin32

@111100001 I don't think this issue should be closes. While you found a workaround/the underlying cause, this is still an issue with the default installation.

HappyDoubleG commented 2 weeks ago

UPDATE: i have fixed the issue by launching the app_launch.py from the CMD (admin mode) python3 app_launch.py and i got an error that said no module named win32process was found

i looked it up and found similar issue in another software but the solution was to install pypiwin32 using pipand tried running the app again and it worked

pip install -U pypiwin32

Didn't work for me. I'm still stuck on loading screen.

drandarov-io commented 2 weeks ago

UPDATE: i have fixed the issue by launching the app_launch.py from the CMD (admin mode) python3 app_launch.py and i got an error that said no module named win32process was found i looked it up and found similar issue in another software but the solution was to install pypiwin32 using pipand tried running the app again and it worked pip install -U pypiwin32

Didn't work for me. I'm still stuck on loading screen.

In addition to installing the depencency, try running the application as administrator.

HappyDoubleG commented 2 weeks ago

UPDATE: i have fixed the issue by launching the app_launch.py from the CMD (admin mode) python3 app_launch.py and i got an error that said no module named win32process was found i looked it up and found similar issue in another software but the solution was to install pypiwin32 using pipand tried running the app again and it worked pip install -U pypiwin32

Didn't work for me. I'm still stuck on loading screen.

In addition to installing the depencency, try running the application as administrator.

Didn't work.

MegaMind2999 commented 2 weeks ago

The error in my case is:

22:52:26.958 > Error while loading C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\engine\ChatRTXUIEngine.py PY Python Error Call to 'fileImport' failed:

    chatbot = await python(pyfile)

at async initializeChatbot (C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\dist\win-unpacked\resources\app.asar\build\bridge_commands\chatbot\chatbot.js:33:19) at async initializeBridgeCommands (C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\dist\win-unpacked\resources\app.asar\build\bridge_commands\index.js:21:18)

... across the bridge ...

nltk.data.find("tokenizers/punkt") at init (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\llama_index\core\utils.py:65) raise LookupError(resource_not_found) at find (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\nltk\data.py:579) at exec_module (:883) at _call_with_frames_removed (:241) from backend import Backend, Mode at (C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\engine\ChatRTXUIEngine.py:33) from ChatRTX.chatrtx import ChatRTX at (C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\engine\backend.py:2) from ChatRTX.inference.pytorch.CLIP import ClipInference at (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\ChatRTX\chatrtx.py:23) from llama_index.core.schema import TextNode at (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\ChatRTX\inference\pytorch\CLIP.py:26) from llama_index.core.base.response.schema import Response at (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\llama_index\core__init__.py:10) from llama_index.core.schema import NodeWithScore at (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\llama_index\core\base\response\schema.py:9) from llama_index.core.utils import SAMPLE_TEXT, truncate_text at (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\llama_index\core\schema.py:18) globals_helper = GlobalsHelper() at (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\llama_index\core\utils.py:89) nltk.download("punkt_tab", download_dir=self._nltk_data_dir) at init (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\llama_index\core\utils.py:67) for msg in self.incr_download(info_or_id, download_dir, force): at download (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\nltk\downloader.py:774) yield from self._download_package(info, download_dir, force) at incr_download (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\nltk\downloader.py:642) os.makedirs(os.path.join(download_dir, info.subdir), exist_ok=True) at _download_package (C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\nltk\downloader.py:699) at makedirs (os.py:225) JS PermissionError: [WinError 5] Access is denied: 'C:\Program Files\NVIDIA Corporation\ChatRTX\env_nvd_rag\lib\site-packages\llama_index\core\_static/nltk_cache\tokenizers' 22:52:26.959 > Error while getting bridge commands TypeError: Cannot read properties of undefined (reading 'ChatBot') at new Chatbot (C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\dist\win-unpacked\resources\app.asar\build\bridge_commands\chatbot\chatbot.js:79:27) at Chatbot.init (C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\dist\win-unpacked\resources\app.asar.unpacked\node_modules\pythonia\src\pythonia\Bridge.js:48:18) at initializeChatbot (C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\dist\win-unpacked\resources\app.asar\build\bridge_commands\chatbot\chatbot.js:227:38) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async initializeBridgeCommands (C:\Program Files\NVIDIA Corporation\ChatRTX\RAG\trt-llm-rag-windows-ChatRTX_0.4.0\ChatRTXUI\dist\win-unpacked\resources\app.asar\build\bridge_commands\index.js:21:18)

I went to that location and didnt find the file "tokenizers"

corang commented 2 weeks ago

Same error here

ArturKasymov commented 6 days ago

Once I've started powershell as admin Nvidia chatrtx.exe works