Connection Refused Error using the UI

[schwaa]

I can run the shell version. When I run the UI web version, I have started it with host=0.0.0.0 as well as the 127.0.0.1 and the local 10.x.x.x version. It starts on port 5111 by default. I get an error that port 5110 on localhost has connection refused. I have open 5110 on ufw, but not having any luck getting this to work. Thx

[Octavian11]

Is the port already in use by another program? Can you also post the details about the server and OS etc.

[schwaa]

Ubuntu 22.04. Netstat doesn't show 5111 or 5110. The webpage does show up when I go to localhost to make a query. From pip list:Package Version --------------------------- ----------- accelerate 0.22.0 aiohttp 3.8.5 aiosignal 1.3.1 altair 5.0.1 annotated-types 0.5.0 anyio 3.7.1 astunparse 1.6.3 async-timeout 4.0.3 attrs 23.1.0 auto-gptq 0.4.2 backoff 2.2.1 bcrypt 4.0.1 beautifulsoup4 4.12.2 bitsandbytes 0.41.1 blinker 1.6.2 boltons 23.0.0 brotlipy 0.7.0 cachetools 5.3.1 certifi 2023.7.22 cffi 1.15.1 charset-normalizer 2.0.4 chroma-bullet 2.2.0 chroma-hnswlib 0.7.2 chroma-migrate 0.0.7 chromadb 0.3.22 click 8.1.7 clickhouse-connect 0.6.6 cmake 3.27.2 coloredlogs 15.0.1 conda 23.7.3 conda-package-handling 2.2.0 conda_package_streaming 0.9.0 contourpy 1.1.0 cryptography 41.0.2 cycler 0.11.0 dataclasses-json 0.5.14 datasets 2.14.4 dill 0.3.7 diskcache 5.6.1 docx2txt 0.8 duckdb 0.7.1 et-xmlfile 1.1.0 exceptiongroup 1.1.3 faiss-gpu 1.7.2 Faker 19.3.1 fastapi 0.99.1 favicon 0.7.0 filelock 3.12.2 Flask 2.3.3 flatbuffers 23.5.26 fonttools 4.42.1 frozenlist 1.4.0 fsspec 2023.6.0 gitdb 4.0.10 GitPython 3.1.32 greenlet 2.0.2 h11 0.14.0 hnswlib 0.7.0 htbuilder 0.6.1 httptools 0.6.0 huggingface-hub 0.16.4 humanfriendly 10.0 idna 3.4 importlib-metadata 6.8.0 importlib-resources 6.0.1 InstructorEmbedding 1.0.1 itsdangerous 2.1.2 Jinja2 3.1.2 joblib 1.3.2 jsonpatch 1.32 jsonpointer 2.1 jsonschema 4.19.0 jsonschema-specifications 2023.7.1 kiwisolver 1.4.5 langchain 0.0.274 langsmith 0.0.26 lit 16.0.6 llama-cpp-python 0.1.79 lxml 4.9.3 lz4 4.3.2 Markdown 3.4.4 markdown-it-py 3.0.0 markdownlit 0.0.7 MarkupSafe 2.1.3 marshmallow 3.20.1 matplotlib 3.7.2 mdurl 0.1.2 monotonic 1.6 more-itertools 10.1.0 mpmath 1.3.0 multidict 6.0.4 multiprocess 0.70.15 mypy-extensions 1.0.0 networkx 3.1 ninja 1.11.1 nltk 3.8.1 numexpr 2.8.5 numpy 1.25.2 nvidia-cublas-cu11 11.10.3.66 nvidia-cuda-cupti-cu11 11.7.101 nvidia-cuda-nvrtc-cu11 11.7.99 nvidia-cuda-runtime-cu11 11.7.99 nvidia-cudnn-cu11 8.5.0.96 nvidia-cufft-cu11 10.9.0.58 nvidia-curand-cu11 10.2.10.91 nvidia-cusolver-cu11 11.4.0.1 nvidia-cusparse-cu11 11.7.4.91 nvidia-nccl-cu11 2.14.3 nvidia-nvtx-cu11 11.7.91 onnxruntime 1.15.1 openpyxl 3.1.2 overrides 7.4.0 packaging 23.0 pandas 2.0.3 pdfminer.six 20221105 peft 0.5.0 Pillow 9.5.0 pip 23.2.1 pluggy 1.0.0 posthog 3.0.2 protobuf 4.24.2 psutil 5.9.5 pulsar-client 3.2.0 pyarrow 13.0.0 pycosat 0.6.4 pycparser 2.21 pydantic 1.10.12 pydantic_core 2.6.3 pydeck 0.8.0 Pygments 2.16.1 pymdown-extensions 10.1 Pympler 1.0.1 pyOpenSSL 23.2.0 pyparsing 3.0.9 PyPika 0.48.9 PySocks 1.7.1 python-dateutil 2.8.2 python-dotenv 1.0.0 pytz 2023.3 pytz-deprecation-shim 0.1.0.post0 PyYAML 6.0 referencing 0.30.2 regex 2023.8.8 requests 2.31.0 rich 13.5.2 rouge 1.0.1 rpds-py 0.9.2 ruamel.yaml 0.17.21 ruamel.yaml.clib 0.2.6 safetensors 0.3.3 scikit-learn 1.3.0 scipy 1.11.2 sentence-transformers 2.2.2 sentencepiece 0.1.99 setuptools 68.0.0 six 1.16.0 smmap 5.0.0 sniffio 1.3.0 soupsieve 2.4.1 SQLAlchemy 2.0.20 st-annotated-text 4.0.0 starlette 0.27.0 streamlit 1.26.0 streamlit-camera-input-live 0.2.0 streamlit-card 0.0.61 streamlit-embedcode 0.1.2 streamlit-extras 0.3.0 streamlit-faker 0.0.2 streamlit-image-coordinates 0.1.6 streamlit-keyup 0.2.0 streamlit-toggle-switch 1.0.2 streamlit-vertical-slider 1.0.2 sympy 1.12 tenacity 8.2.3 threadpoolctl 3.2.0 tokenizers 0.13.3 toml 0.10.2 toolz 0.12.0 torch 2.0.1 torchvision 0.15.2 tornado 6.3.3 tqdm 4.65.0 transformers 4.32.0 triton 2.0.0 typing_extensions 4.7.1 typing-inspect 0.9.0 tzdata 2023.3 tzlocal 4.3.1 urllib3 1.26.16 uvicorn 0.23.2 uvloop 0.17.0 validators 0.21.2 watchdog 3.0.0 watchfiles 0.20.0 websockets 11.0.3 Werkzeug 2.3.7 wheel 0.38.4 xxhash 3.3.0 yarl 1.9.2 zipp 3.16.2 zstandard 0.19.0
I'm using Nvidia GPU 535.86.10, driver version 535.86.10, cuda version 12.2. Nvcc says cuda 12_2. Torch is 2.0.1.