ohmplatform / FreedomGPT

This codebase is for a React and Electron-based app that executes the FreedomGPT LLM locally (offline and private) on Mac and Windows using a chat-based interface
http://www.freedomgpt.com
GNU General Public License v3.0
2.6k stars 354 forks source link

Linux Version of the Application #100

Open Nktech-Official opened 1 year ago

Nktech-Official commented 1 year ago

I have suggestion to make an linux version of the app as it is based on electron so it should be eassy to provide an linux version .

eric-hansen commented 1 year ago

If you're on Linux why not just use the Docker version?

aktiwers commented 1 year ago

It is already working on Linux

w-sky commented 1 year ago

@eric-hansen @aktiwers How did you do it? I ran into the same problems as @Postconceptlab described in this issue https://github.com/ohmplatform/FreedomGPT/issues/89 except that I did not even come past the "loading model" page.

Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here before I could run docker properly.)

Anyway: The result when I try to start FreedomGPT:

$ docker run -d -p 8889:8889 freedomgpt/freedomgpt
WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested
03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971

Then it exits.

Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?

eric-hansen commented 1 year ago

--platform arg. Not at computer to give full syntax

On Sun, Jul 2, 2023, 6:14 PM w-sky @.***> wrote:

@eric-hansen https://github.com/eric-hansen @aktiwers https://github.com/aktiwers How did you do it? I ran into the same problems as @Postconceptlab https://github.com/Postconceptlab described in this issue #89 https://github.com/ohmplatform/FreedomGPT/issues/89 except that I did not even come past the "loading model" page.

Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here https://askubuntu.com/questions/941816/permission-denied-when-running-docker-after-installing-it-as-a-snap before I could run docker properly.)

Anyway: The result when I try to start FreedomGPT:

$ docker run -d -p 8889:8889 freedomgpt/freedomgpt WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested 03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971

Then it exits.

Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?

— Reply to this email directly, view it on GitHub https://github.com/ohmplatform/FreedomGPT/issues/100#issuecomment-1616861464, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB7DKZY2GQPPQ2NIMLVAB2TXOHXCTANCNFSM6AAAAAAZXAZYMA . You are receiving this because you were mentioned.Message ID: @.***>

nacho00112 commented 1 year ago

@eric-hansen @aktiwers How did you do it? I ran into the same problems as @Postconceptlab described in this issue #89 except that I did not even come past the "loading model" page.

Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here before I could run docker properly.)

Anyway: The result when I try to start FreedomGPT:

$ docker run -d -p 8889:8889 freedomgpt/freedomgpt
WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested
03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971

Then it exits.

Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?

A chroot or proot within the docker might be

scubbx commented 1 year ago

Rebuilding the docker image on my system and then explicitly specifying the platform when running the container worked for me:

git clone https://github.com/ohmplatform/FreedomGPT.git cd FreedomGPT/docker-app docker build -t freedomgpt/freedomgpt . docker run -p 8889:8889 --platform amd64 freedomgpt/freedomgpt

aktiwers commented 1 year ago

I'm not using the docker version - but I found the "Loading model" screen takes some time to load - but eventually it will load and work.

image

I Just followed the yarn install instructions in the README and re-build llama.cpp from source.

aktiwers commented 1 year ago

@w-sky I have uploaded llama.cpp build on Linux here: https://github.com/aktiwers/llama.cpp-linux-build

If you don't want to build it yourself.