This PR will add JavaScript bindings for llama.cpp
import { Model, Context, Grammar } from 'socket:llm'
// include a model file in your project
const model = new Model('./mistral-7b-openorca.Q4_0.gguf')
// create a grammar
const grammar = new Grammar('...') // supports (json)gbnf
// create a context
const context = new Context({ model, grammar })
// use the context to evaluate the input and produce output
context.eval(tokens, params)
This PR will add JavaScript bindings for llama.cpp