issues
search
kaust-generative-ai
/
local-deployment-llama-cpp
Project to help you get started working with LLMs locally with LLaMA C++.
Apache License 2.0
1
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Automatically launch a server with a default model
#30
davidrpugh
opened
3 weeks ago
0
Added example of using the LLAMA_CACHE variable.
#29
davidrpugh
closed
4 weeks ago
1
Add curl support
#28
davidrpugh
closed
4 weeks ago
1
Hotfix build scripts
#27
davidrpugh
closed
4 weeks ago
0
Tutorial on the Open AI compatible API endpoints
#26
davidrpugh
opened
1 month ago
0
This PR adds tutorial on the completions API endpoint
#25
davidrpugh
opened
1 month ago
0
Added tokenization examples.
#24
davidrpugh
closed
1 month ago
0
Added example of using metrics for a server
#23
davidrpugh
closed
1 month ago
0
Add llama server reranking api notebook
#22
davidrpugh
closed
1 month ago
0
Added a basic tutorial for an embedding server.
#21
davidrpugh
closed
1 month ago
0
Add llama server basics notebook
#20
davidrpugh
closed
1 month ago
0
Add tutorials covering the contents of the main LLaMA C++ example
#19
davidrpugh
closed
1 month ago
0
Add tutorial on grammars
#18
davidrpugh
opened
1 month ago
0
Add reverse prompting example
#17
davidrpugh
opened
1 month ago
0
Add chat template examples
#16
davidrpugh
opened
1 month ago
0
LoRA adaptor examples
#15
davidrpugh
opened
1 month ago
1
Add some logging examples
#14
davidrpugh
opened
1 month ago
0
Usage examples for `--logit-bias`
#13
davidrpugh
opened
1 month ago
0
Tail free sampling issues
#12
davidrpugh
opened
1 month ago
0
Modify build scripts to enable curl support
#11
davidrpugh
closed
4 weeks ago
1
Configure the cache directory used by LLaMA C++
#10
davidrpugh
closed
4 weeks ago
1
LLaMA C++ integration with HF
#9
davidrpugh
closed
4 weeks ago
3
Make notebooks out of the LLaMA C++ examples
#8
davidrpugh
opened
1 month ago
1
Add install instructions
#7
davidrpugh
closed
1 month ago
0
Add nvidia gpu support
#6
davidrpugh
closed
1 month ago
0
Need to invlude the CMAKE_INSTALL_RPATH.
#5
davidrpugh
closed
1 month ago
0
Fixed build scripts to support conda run.
#4
davidrpugh
closed
1 month ago
0
Add llama-cpp-python metal GPU support
#3
davidrpugh
closed
1 month ago
0
Add llama cpp python blas support
#2
davidrpugh
closed
1 month ago
0
Install whisper.cpp
#1
davidrpugh
opened
1 month ago
0