issues
search
InftyAI
/
llmlite
🌵 A library helps to communicate with all kinds of LLMs consistently.
MIT License
6
stars
2
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Fall back support across several providers
#60
kerthcet
opened
4 days ago
2
Support counting tokens
#59
kerthcet
opened
4 days ago
1
Add workflow
#58
kerthcet
closed
4 days ago
0
Support deepspeed-fastgen as another backend
#57
kerthcet
opened
5 months ago
0
Update readme
#56
kerthcet
closed
6 months ago
0
vLLM not working as expected with ChatGLM2
#55
kerthcet
opened
6 months ago
0
update readme
#54
kerthcet
closed
6 months ago
0
Release 0.0.15
#53
kerthcet
closed
6 months ago
0
Support Stream output
#52
kerthcet
opened
6 months ago
0
Support loading different adapter
#51
kerthcet
opened
6 months ago
0
support vllm
#50
kerthcet
closed
6 months ago
1
Refactor
#49
kerthcet
closed
6 months ago
0
Update readme to include support system prompt or not
#48
kerthcet
closed
6 months ago
0
support baichuan2
#47
kerthcet
closed
6 months ago
0
support batching
#46
Jerry-Kon
closed
6 months ago
1
batching
#45
Jerry-Kon
closed
6 months ago
4
Add codellama example
#44
kerthcet
closed
6 months ago
0
Support different backends
#43
kerthcet
closed
6 months ago
0
add feature about vllm backend
#42
Jerry-Kon
closed
6 months ago
1
Support different backends
#41
kerthcet
closed
6 months ago
0
Support serving via HTTP/RPC server
#40
kerthcet
opened
7 months ago
0
Support serving fine-tuning layers easily
#39
kerthcet
opened
7 months ago
0
Integration with langchain
#38
kerthcet
opened
7 months ago
0
Support quantization
#37
kerthcet
opened
7 months ago
0
Update readme.md to support different backends
#36
kerthcet
closed
7 months ago
0
support text-generation-inference
#35
kerthcet
opened
7 months ago
0
Support Baichuan2 Model
#34
kerthcet
closed
6 months ago
1
Add codeLlama example
#33
kerthcet
opened
7 months ago
0
Support vLLM as the backend
#32
kerthcet
closed
6 months ago
2
Support system_prompt can be empty
#31
kerthcet
opened
7 months ago
0
recognize model
#30
Jerry-Kon
opened
8 months ago
3
Update README.md to support codellama
#29
kerthcet
closed
8 months ago
0
Support CodeLlama
#28
kerthcet
closed
8 months ago
0
Support for codeLlama
#27
kerthcet
closed
8 months ago
0
Support ChatGPT
#26
kerthcet
closed
8 months ago
7
Support ChatGPT
#25
kerthcet
closed
9 months ago
0
degrade python to 3.10 as 3.11 is experimental
#24
kerthcet
closed
9 months ago
0
Update README.md
#23
kerthcet
closed
9 months ago
0
Update README.md
#22
kerthcet
closed
9 months ago
0
Release 0.0.6
#21
kerthcet
closed
9 months ago
0
Downgrade poetry to < 2 for compatible with ray server
#20
kerthcet
closed
9 months ago
0
User pytest for test framework
#19
kerthcet
closed
9 months ago
0
Set do_sample default to False
#18
kerthcet
closed
9 months ago
0
Add to PyPi
#17
kerthcet
closed
9 months ago
0
Add to PyPi
#16
kerthcet
closed
9 months ago
0
Support for Baichuan LLM
#15
kerthcet
closed
6 months ago
0
Support other features, e.g. temperature, top_p
#14
kerthcet
closed
9 months ago
0
Modify the readme
#13
kerthcet
closed
9 months ago
0
Change the API
#12
kerthcet
closed
9 months ago
0
Support for StableLM
#11
kerthcet
opened
10 months ago
0
Next