search

cocktailpeanut / dalai

The simplest way to run LLaMA on your local machine
https://cocktailpeanut.github.io/dalai
13.1k stars 1.42k forks source link

This application cant response to me? It is waiting for much time. It is not working. #445

Open Yaseminh opened 1 year ago

Yaseminh commented 1 year ago

Now, Button name is go but in demo button name is autocomplete. I cant find solution for problem. I dont understand. Button is always turning but no response.

Yaseminh commented 1 year ago

It didn't respond at all for me, but it did in a different project. How long did it take to respond? I hope we find a solution to the problem.

Practicing7 commented 1 year ago

Same issue! LLaAM 7B responses to me normally. But Alpaca didn't response to me.

Yaseminh commented 1 year ago

What is your ram size and specs of your machine? I say it's enough if one of them works, but I couldn't get a response :(

Practicing7 commented 1 year ago

My machine has a ram size of 128G, an A6000 GPU with 48G memory. OS: Ubuntu 22.04

geniusfoever commented 1 year ago

Same here, 32 G ram, Linux, alpaca 7B, no response at all. No error, seems stucked.

manel-moles commented 1 year ago

Same issue here.

vulpcod3z commented 1 year ago

Works from the demo web ui but utilizing the api call demos only sends and processes the request; there's no response sent back to the client.

UPDATE: Wanted to include that I installed via npx dalai alpaca install instead of cloning, which works via the web ui.

HidingCherry commented 1 year ago

Also installed via npx dalai alpaca install 7B - same issue, no CPU usage, no response. Running via docker (actually podman, but it doesn't make a difference). I'll try llama 7B later.

Edit: works with Llama 7B - but I had to do the download manually, since it kinda stopped halfway through the download. No download-progress, but the estimated time roze.

andreapago commented 1 year ago

same problem here alpaca 7B and 13B do not seem to provide any reply...anyone any idea? I'm on Ubuntu with 16GB RAM, no GPU. Thanks

vulpcod3z commented 1 year ago

same problem here alpaca 7B and 13B do not seem to provide any reply...anyone any idea? I'm on Ubuntu with 16GB RAM, no GPU. Thanks

Are you attempting to use the web interface or are you connecting via another application?

andreapago commented 1 year ago

Are you attempting to use the web interface or are you connecting via another application?

Just via the web interface. Thanks

vulpcod3z commented 1 year ago

I'd check your nodejs version first. Ubuntu 20.04 and earlier don't support >10.19 where dalai needs >=18.

After that, check that your */dalai/alpaca/models directory actually has the models.