search

microsoft / BitNet

Official inference framework for 1-bit LLMs
MIT License
11.43k stars 773 forks source link

How to compile a server.exe? #78

Open clilyn1234 opened 1 month ago

clilyn1234 commented 1 month ago

Functionality similar to LLaMA.cpp HTTP Server. ./llama-server

grctest commented 2 weeks ago

This can provide you a form of HTTP server: https://github.com/microsoft/BitNet/discussions/110

It's for local use only though, not for production