Closed velazquej1 closed 1 year ago
Take a look at the marella/ctransformers readme. I believe it has the documentation you are looking for. You can also look at the default chatdocs.yml to see some more options.
Thanks you! that was what I was looking for.
Where do I find all the available yml config options? for example I see nothing on increasing the threads chatdocs can use but I found a reddit thread that tells what the config options is. I there Documentation, a example file, or some where in the source you can point me to to find this information.