foldl chatllm.cpp issues

foldl / chatllm.cpp

Pure C++ implementation of several models for real-time chatting on your computer (CPU)

MIT License

357 stars 28 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

LlaMA 3.2 1B & 3B generate garbage after hundreds of tokens

#38 foldl opened 3 days ago
0
Tutorial on RAG: Convert fruit vector store failed - GGML_ASSERT: ...... Aborted

#37 GentleYo opened 2 weeks ago
8
Question:Can we use chatllm.cpp in Android System

#36 FranzKafkaYu closed 2 weeks ago
1
Convert reranker model failed - TypeError: 'type' object is not subscriptable

#35 GentleYo closed 2 weeks ago
11
phi-3.5 moe

#34 ayttop closed 1 month ago
1
sparsemixer function in Phi-3.5-MoE-insturct

#33 JustQJ opened 1 month ago
1
Phi-3.5-MoE-instruct

#32 ayttop closed 1 month ago
1
phi 3.5 moe usage

#31 GlasslessPizza opened 1 month ago
5
LlaMA 3.1 70B not work

#30 foldl opened 2 months ago
0
Model id for mistral nemo?

#29 mlsterpr0 closed 2 months ago
1
F16 quantization not work

#28 foldl closed 2 months ago
1
baichuan13 does not work well

#27 cagev opened 3 months ago
1
gemma模型的bug

#26 phpk closed 3 months ago
3
validate performance issues

#25 RobinQu closed 3 months ago
0
bge-reranker is extreamly slow

#24 RobinQu opened 3 months ago
10
你好，请问支持GLM-4V吗？

#23 yhl41001 opened 3 months ago
2
bindings里面的openai_api.ts好像读不到历史信息

#22 gabrielpondc closed 3 months ago
3
crashed using qwen2 72b

#21 cagev closed 3 months ago
2
RuntimeError: Internal: could not parse ModelProto from /home/james/glm-4-9b-chat/tokenizer.model

#20 jamfor352 closed 3 months ago
3
The same sentence appears in loop

#19 ChenHuge closed 3 months ago
3
quantized InternLM2 failed

#18 cagev closed 4 months ago
2
请问可否给个docker镜像

#17 zhanpengjie closed 4 months ago
1
Support GGUF

#16 trufae opened 4 months ago
1
Does this project have a communication group?

#15 wyrjob closed 4 months ago
1
build libchatllm error

#14 wzg-zhuo closed 4 months ago
1
How to use GPU?

#13 li904775857 opened 4 months ago
2
Compilation of bindings under macOS does not succeed

#12 phpk closed 5 months ago
1
mac打包报错

#11 phpk closed 5 months ago
4
CPU inferencing a lot slower than llama.cpp

#10 netspym closed 2 months ago
3
LLM conversion is a issue.

#9 netspym closed 5 months ago
2
can't build on arm termux

#8 coinight closed 6 months ago
2
请问如何部署BCEmbedding的rerank模型？

#7 chenchun0629 closed 6 months ago
1
calculate required scratch memory

#6 foldl closed 1 month ago
1
core dumped

#5 MarsMeng1994 closed 7 months ago
2
用-p提供命令行的prompt参数时，不支持中文。

#4 yg1988 closed 7 months ago
1
提供python调用方式

#3 wzg-zhuo closed 6 months ago
5
introduce isocline (a readline alternative) and make multiline input default

#2 dingmaotu closed 8 months ago
3
how do i run phi-2 on cpu (x86 ec2)

#1 kirilligum closed 8 months ago
4