Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
829
stars
80
forks
source link
feat: use multiple machines for evaluating large models that require a lot of RAM #86
Open
giladgd opened 10 months ago