A local version of WebSim.AI, the prompt to webpage engine. Infinite possibilities to cure your boredom. ( I made it so you dont have to.... Youll thank me later)
Using Lm-Studio with this model "https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF", I was able to get a decent output.
pip3 install -r requirements.txt
main.py lmstudio
and navigate to http://127.0.0.1:5000
in your browser.
BAM! You should see the web interface.
Enjoy if you got issues let me know please...As the owner of this repo I dont know docker. But dont let my lack of knowledge stop you. Heres a guide from the github user: genwch. Environment Variables for Initialization:
API_URL
: The URL for the API you’re interacting with.API_KEY
: Your API key for authentication.model
: The specific model you want to use.To make the Flask application listen on all available network interfaces, set the host to 0.0.0.0 in your Flask app configuration.
build the Dockerfile and use CI/CD to make the docker image release.