mohamed-mc
commented
7 months ago basically you can't do it directly as you are trying, I got around it began with using ngrok
option 1: 1st- clone the repo and go into the LLMStack folder 2nd- do the pip install llmstack, run make python3 manage.py migrations app and migrate app 3rd- pip install ngrok to install, then ngrok http 3000, 4th- go to llmstack/server/settings.py and add the generated link to both ALLOWED_HOSTS and the CSRF allowed list, make sure you do this when its running on local host, it will forward the traffic, and you can access it with the generated link
option 2: use docker and a load balancer, you can use nginx option 3: edit the project for your use case
Describe the bug When binding LLMstack to 0.0.0.0:3000 there is an issue where whenever you run the server it keeps saying, "Waiting for LLMStack server to be up...". Even when it is up, and I can access it from another machine on the same network.
System check identified no issues (0 silenced). November 02, 2023 - 18:47:39 Django version 4.2.1, using settings 'llmstack.server.settings' Starting ASGI/Daphne version 4.0.0 development server at http://0:3000/ Quit the server with CONTROL-C. Waiting for LLMStack server to be up... Waiting for LLMStack server to be up... Waiting for LLMStack server to be up... Waiting for LLMStack server to be up...
Expected result. System check identified no issues (0 silenced). November 02, 2023 - 18:47:39 Django version 4.2.1, using settings 'llmstack.server.settings' Starting ASGI/Daphne version 4.0.0 development server at http://0:3000/ Quit the server with CONTROL-C.
To Reproduce Steps to reproduce the behavior: Edit the config file located at ~/.llmstack/config and change port = 3000 -> port = "0:3000"
And run: ┌─[user@fedora]─[~] └──╼ $ llmstack
Expected behavior The server starts up and does not continue outputting "Waiting for LLMStack server to be up...". This begins to fill up the screen.
Version 0.0.17?
Environment Linux fedora 6.5.8-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Oct 20 2023 x86_64 GNU/Linux pip 22.3.1 from /usr/lib/python3.11/site-packages/pip (python 3.11)
Screenshots