search

amaiya / onprem

A tool for running on-premises large language models with non-public data
https://amaiya.github.io/onprem
Apache License 2.0
684 stars 32 forks source link

Core dumped / segmentation fault #41

Closed lysa324 closed 9 months ago

lysa324 commented 10 months ago

Hi, I use debian 11, python 3.10, anaconda3 onprem==0.0.28 langchain==0.0.240 RAM = 16 Go swap = 10 Go SSD = 60 GO I try to use the simplest program with onprem : 

from onprem import LLM
llm = LLM()

prompt = """Extract the names of people in the supplied sentences. Here is an example:
Sentence: James Gandolfini and Paul Newman were great actors.
People:
James Gandolfini, Paul Newman
Sentence:
I like Cillian Murphy's acting. Florence Pugh is great, too.
People:"""
saved_output = llm.prompt(prompt)

and i have "core dumped " error without other details, i tried a lot of things but nothig resolve my problem !

can you help me please thks

amaiya commented 10 months ago

i tried a lot of things

What precisely have you tried?

amaiya commented 9 months ago

It's difficult to pinpoint your issue without more information. I will close this issue for now, since it cannot be reproduced. Feel free to respond to this thread.