issues
search
kennethleungty
/
Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
https://towardsdatascience.com/running-llama-2-on-cpu-inference-for-document-q-a-3d636037a3d8
MIT License
947
stars
210
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
How, where and what to configure if I have to migrate this to a GPU based system??? Please help me with this
#30
VIGHNESH1521
closed
4 months ago
1
where should we need to make modifications for it run on GPU based systems?
#29
VIGHNESH1521
closed
4 months ago
1
Any idea how to let it remember all previous prompt and answers like ChatGPT so it can have continuous chat?
#28
jhhspace
opened
9 months ago
0
ModuleNotFoundError: No module named 'langchain' is occured
#27
diqksk
opened
9 months ago
0
Can I run the same code for different data formats like .xlsx, .docx, .txt and .pptx? or should I include or modify any part of the code? If yes, please share the code
#26
VIGHNESH1521
opened
9 months ago
0
I want to add my personal files.
#25
VIGHNESH1521
closed
9 months ago
1
Added final changes
#24
tentacool9
closed
10 months ago
0
git lfs error
#23
arun-raze19
opened
10 months ago
0
Is there a way to make the system answer in a specific language?
#22
marbona
opened
12 months ago
0
[Feature Request] Support InternLM Deploy
#21
vansinhu
opened
1 year ago
0
config customization
#20
AleksandrTulenkov
opened
1 year ago
0
how to change data files?
#19
Janeyanhong
closed
1 year ago
2
A Question.
#18
manbehindthemadness
opened
1 year ago
0
modify input to --input in main.py
#17
msfasha
closed
10 months ago
0
Please copy / post instructions in GitHub.. Medium blog instructions are paywalled
#16
gidzr
closed
11 months ago
0
error model config
#15
malv-c
opened
1 year ago
2
Aborted (core dumped) when executing dbqa()
#14
wennycooper
opened
1 year ago
0
Any ideas what "Illegal Instruction" indicates?
#13
jediwarpraptor
opened
1 year ago
1
Support for 70b by updating ctransformers
#12
thirtysix
opened
1 year ago
0
Configure system prompt
#11
sumitsoman
opened
1 year ago
0
how to improve response time ?
#9
pawanGithub10
opened
1 year ago
0
Fix issue with Pytorch 2.0.1
#8
seyedsaeidmasoumzadeh
closed
1 year ago
1
can we use a gpu for increased speed and use of a bigger better llama2 model
#7
stevedipaola
opened
1 year ago
4
"error loading model: unrecognized tensor type 11"
#6
brainartfu
opened
1 year ago
1
Added Milvus as an optional vector database, and load pdf and txt files
#5
bemau
closed
1 year ago
0
Fix typo in prompts.py
#4
eltociear
closed
1 year ago
3
401 Client Error in loading Llama2-7b model
#3
wennycooper
closed
1 year ago
2
license
#2
lakshmanok
closed
1 year ago
1
requesting a requirements.txt
#1
isayahc
closed
1 year ago
1