Closed CarlAmko closed 1 year ago
Adds an example showcasing spinning up an ngrok tunnel that points to a GPT4All model backend. Uses Gradio for visualization.
Requires that you download a model from the GPT4All site above.
Response times vary but can take a while depending on the nature of the prompt. It is possible to run out of resources, so be careful.
What
Adds an example showcasing spinning up an ngrok tunnel that points to a GPT4All model backend. Uses Gradio for visualization.
Notes
Requires that you download a model from the GPT4All site above.
Response times vary but can take a while depending on the nature of the prompt. It is possible to run out of resources, so be careful.