Add GPU support via CUDA

evangineer / alpaca-roleplay-discordbot

A discord bot that roleplays!

MIT License

1 stars 0 forks source link

Closed evangineer closed 1 year ago

evangineer commented 1 year ago

Add entries in config.yml and make sure that the relevant code loads them.

Try gpu_layers = 30 for hermes

evangineer commented 1 year ago

Added support and documentation