search

tjake / Jlama

Jlama is a modern LLM inference engine for Java
Apache License 2.0
500 stars 48 forks source link

Maybe int8 #3

Closed tjake closed 1 year ago