[Improvements] Add support for local running LLM's

[Mishalabdullah]

• User's must be able to use the web UI even for running local LLM's
• User's can you ngrok to expose their port.
• Past ngrok URL in the web UI and then use this as a client.