search

DFKI-NLP / perseus-textgen

A repository for scripts to run awesomely large language models with text generation inference APIs and (chat) UIs
MIT License
0 stars 0 forks source link

frontend #7

Closed ArneBinder closed 12 months ago

ArneBinder commented 12 months ago

This PR adds a Gradio based frontend that can be used with text-generation-inference based backends.

Setup

  1. Install requirements: pip install -r frontend/requirements.txt
  2. Start the frontend: python frontend/app.py
  3. Start a backend with any of the scripts, get the API URL as described in the script files and put it into the Address field of the frontend.
  4. (OPTIONAL) Adjust the parameters and template.
  5. Happy chatting!