Nan Li, Bo Kang, Tijl De bie
IDLAB - Department of Electronics and Information Systems (ELIS), Ghent University
Make sure you have all the requirements listed above
Clone the repository
git clone https://github.com/aida-ugent/SkillGPT.git
Navigate to the directory where the repository was downloaded
cd SkillGPT
Install the required dependencies
pip install -r requirements.txt
Configure SkillGPT
Set the following settings in .env
API_HOST="127.0.0.1" # the IP or domain to launch the api gateway
API_PORT=21002
REDIS_HOST=localhost # the IP or domain of the running redis instance
REDIS_PORT=6379
MODEL_PATH=models/vicuna_13b # the path to Huggingface AutoModelForCausalLM model
Launch docker service
sudo docker run --name redis-stack-server -p 6379:6379 redis/redis-stack-server:latest
Run api
Python module in your terminal
python -m api
Launch gradio interface
python gradio_server.py
Process via API requests. See examples in api_request.ipynb
.
(Optional) initalize Redis vector DB. See example in the last cell "Initialize ESCO embeddings" in api_request.ipynb
.
Please fill in the form https://forms.gle/vKXKxCegWjzni1aM7 .