issues
search
tjake
/
Jlama
Jlama is a modern LLM inference engine for Java
Apache License 2.0
499
stars
48
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Error while trying to generate from the given prompt
#61
vaibhav-singh-bi
opened
22 hours ago
2
Adds split by layer for distributed inference
#60
tjake
opened
1 day ago
0
Range based http loader for distributed inf and cli improvements
#59
tjake
closed
5 days ago
0
Add classifier support
#58
tjake
closed
1 week ago
3
Adds Bert prefixes
#57
lordofthejars
closed
1 week ago
9
Improve warning message when native library is not present
#56
geoand
closed
1 week ago
1
add jbang catalog
#54
maxandersen
closed
1 week ago
3
Add DEBERTA-V2
#53
tjake
opened
1 week ago
3
Add basic paged attention for kv cache (no copy on write)
#51
tjake
closed
2 weeks ago
0
Exception in thread "main" java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
#50
maxbrito500
closed
2 weeks ago
4
distributed inference v2
#49
tjake
closed
2 weeks ago
0
List of supported models and path
#48
jesuino
closed
1 week ago
18
Create stand alone downloadable cli for all platforms
#47
tjake
closed
2 weeks ago
5
Dependency Conflict with `com.google.guava:guava` in `jlama-core`
#46
PrimosK
closed
4 weeks ago
1
Error while running locally using run-cli.sh
#45
ved-asole
opened
1 month ago
13
Add tool calling support
#44
tjake
closed
1 month ago
0
Add openai-api built from openapi spec
#43
tjake
closed
1 month ago
0
Create multi-release jar that supports Java 20/21/22
#42
tjake
closed
1 month ago
0
Support Java 20/21/22
#41
tjake
closed
1 month ago
0
Apple Silicon native compilation
#40
sydneypdx
closed
2 months ago
1
Is this still being worked on? The example program won't run and it appears to require a very specific JVM version.
#39
SkyAphid
closed
2 months ago
1
BF16 Support
#38
tjake
closed
2 months ago
0
GGUF Support
#36
vaiju1981
opened
2 months ago
9
Add Tool support
#35
tjake
closed
4 weeks ago
1
Add BNF Grammar enforcement
#34
tjake
opened
3 months ago
0
Switch all tensor operations to use longs
#33
tjake
closed
2 months ago
0
fix typo in error message `tokenizer.jsom`
#32
kishida
closed
3 months ago
0
Gemm support for batch processing
#30
tjake
closed
3 months ago
0
Unable to resolve artifact: Missing: com.google.protobuf:protoc:exe:linux-x86_64-fedora:3.17.3
#29
tkobayas
closed
3 months ago
3
In fedora39, got error when running './run-cli.sh download tjake/llama2-7b-chat-hf-jlama-Q4'
#28
wangfei304187
closed
2 months ago
2
Got error when running './run-cli.sh download tjake/llama2-7b-chat-hf-jlama-Q4'
#27
wangfei304187
closed
3 months ago
1
Multimodal support?
#26
jrtp
opened
4 months ago
1
Support M1/2/3 with Rosetta enabled
#25
tjake
opened
5 months ago
0
Add OpenAI compatible chat completion endpoint
#23
phact
closed
1 month ago
1
WIP openai endpoint
#22
phact
closed
6 months ago
0
Adding FineTune Command
#21
vaiju1981
closed
6 months ago
1
streaming server support?
#20
kevintanhongann
closed
1 month ago
6
Add Gemma support
#18
tjake
closed
7 months ago
18
Feature request: support for the smallest reasonable codegen model
#17
jbellis
closed
7 months ago
4
CodeLlama loading is broken?
#16
jbellis
closed
7 months ago
1
token parameter is -t now instead of -a
#15
jbellis
closed
7 months ago
0
cli should look in JAVA_HOME first (take 2)
#14
jbellis
closed
7 months ago
1
is that ment to be a cli tool, or can I integrate it with another java application, without using cli?
#12
benayat
closed
6 months ago
4
Jlama net + Mistral + Mixtral
#11
tjake
closed
7 months ago
0
./download-hf-model.sh wont work on Windows
#10
skanga
closed
7 months ago
8
Removed unused imports that caused issues with Eclipse and OpenJDK
#9
wmsouza
closed
10 months ago
1
make it easier to consume jlama
#8
jbellis
closed
7 months ago
1
cli wrapper should look in JAVA_HOME
#7
jbellis
closed
11 months ago
1
Windows build failures
#6
spullara
closed
1 year ago
2
Quantizations
#5
tjake
closed
1 year ago
0
Next