Initial llama.cpp logits processor - Githubissues

uiuc-focal-lab / syncode

Efficient and general syntactical decoding for Large Language Models

MIT License

181 stars 10 forks source link

Initial llama.cpp logits processor #86

Open tarsur909 opened 2 months ago