kherud java-llama.cpp issues

kherud / java-llama.cpp

Java Bindings for llama.cpp - A Port of Facebook's LLaMA model in C/C++

MIT License

274 stars 27 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Java 1.8 support

#73 kherud opened 1 month ago
0
JNI

#72 ys2940 opened 1 month ago
3
Upgrade llama.cpp to b3265, support gemma2, remove beam parameter[ https://github.com/ggerganov/llama.cpp/pull/7985 ]

#71 zdl010 closed 2 weeks ago
4
Add vocab_only

#70 ardinursyamsu opened 2 months ago
1
What's the model path in android?

#69 Raffa064 closed 2 months ago
5
Can't pass the test

#68 ardinursyamsu closed 2 months ago
2
Implement Logging

#67 kherud closed 3 months ago
0
Issues with logging in v3

#66 martinhybergTE closed 2 months ago
8
Upgrade to llama.cpp b2969

#65 kherud closed 3 months ago
0
Generate with chat template

#64 lesters closed 3 months ago
3
Update to b2885

#63 kherud closed 3 months ago
0
Interrupting inference?

#62 jrtp closed 3 months ago
7
'ggml-common.h' file not found On MacOS

#61 MarchLiu closed 3 months ago
2
Upgrade to llama.cpp b2797

#60 kherud closed 3 months ago
0
fail with snowflake-arctic-embed-l

#59 fbellomi closed 2 months ago
6
Update to llama.cpp b702

#58 kherud closed 4 months ago
0
Test Pull

#57 jr-nazareth closed 4 months ago
0
Some C++ refactoring

#56 kherud closed 4 months ago
0
Correct import for nlohmann/json

#55 hvisser closed 4 months ago
0
Java tests failed when CUDA enabled on version 3.0.0

#54 RFYoung closed 3 months ago
5
"Failed to load native library" when using custom llama.cpp with GPU acceleration build

#53 PauloIVM closed 4 months ago
3
Version 3.0

#52 kherud closed 4 months ago
0
Update to a newer version of llama.cpp

#51 RFYoung closed 4 months ago
2
Android build error : libllama.so is incompatible with aarch64linux

#50 RageshAntonyHM opened 5 months ago
1
SIGSEGV Error During Execution of Embedding Code

#49 hide212131 closed 4 months ago
3
Suggestion: make obtaining the language model from the web more convenient

#48 mbofb closed 4 months ago
1
Handling multi token utf8 bytes in streaming mode

#47 hvisser closed 4 months ago
3
Set handling of special tokens in tokenizer to true

#46 hvisser closed 6 months ago
4
Completion seems to ignore EOS token

#45 hvisser closed 6 months ago
3
where is default llama and jllama dlls?

#44 siddhsql closed 6 months ago
2
not getting gpu acceleration on windows

#43 siddhsql closed 6 months ago
3
Fix android library loading

#42 samolego closed 7 months ago
3
Fix invalid references in log levels

#41 samolego closed 7 months ago
2
How build project on windows?

#40 Maxon081102 closed 4 months ago
4
Fixes #38 and another oversight

#39 samolego closed 7 months ago
0
Deleting local references where it doesn't exist

#38 samolego closed 7 months ago
0
Android support?

#37 samolego closed 7 months ago
19
java 8 patch

#36 litongjava closed 4 months ago
1
Fixing build and defaulting models.home

#35 cestella closed 8 months ago
0
Support multimodal inputs

#34 yeroc opened 8 months ago
1
Upgrade llama.cpp to most recent release (b1645) so it supports mixtral

#33 cestella closed 8 months ago
3
How to use GPU to run the modes, like to set "-ngl N, -- n-Gpu-layers N" in the llama.cpp project?

#32 Void-nebula closed 8 months ago
2
java.lang.NoSuchFieldError: de.kherud.llama.InferenceParameters.antiPrompt [Ljava/lang/String;

#31 enimatek-nl closed 4 months ago
2
SIGILL (0x4) at pc=0x00007fe92acb5142, pid=3952, tid=4017

#30 siddhsql closed 4 months ago
1
model.generate aborts with "libc++abi: terminating due to uncaught exception of type std::length_error: basic_string"

#29 abadelt closed 4 months ago
1
Latest version did not publish to Maven

#28 AutonomicPerfectionist closed 4 months ago
0
Core dump on Ubuntu

#27 DWAA1660 closed 4 months ago
5
WSL/Java 17 is supported?

#26 javierfd closed 4 months ago
8
Prebuilt x86 linux libs use EVEX encoding for AVX instructions, causing SIGILL

#25 AutonomicPerfectionist closed 4 months ago
3
Need help: No native library found for os.name=Windows, os.arch=x86_64

#24 j0schihatake closed 4 months ago
1