tjake / Jlama

Jlama is a modern LLM inference engine for Java
Apache License 2.0
656 stars 60 forks source link

Range based http loader for distributed inf and cli improvements #59

Closed tjake closed 1 month ago