Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Linux Version of the Application #100

Open
Nktech-Official opened this issue Jun 28, 2023 · 8 comments
Open

Linux Version of the Application #100

Nktech-Official opened this issue Jun 28, 2023 · 8 comments

Comments

@Nktech-Official
Copy link

I have suggestion to make an linux version of the app as it is based on electron so it should be eassy to provide an linux version .

@eric-hansen
Copy link

If you're on Linux why not just use the Docker version?

@aktiwers
Copy link

It is already working on Linux

@w-sky
Copy link

w-sky commented Jul 2, 2023

@eric-hansen @aktiwers How did you do it?
I ran into the same problems as @Postconceptlab described in this issue #89 except that I did not even come past the "loading model" page.

Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here before I could run docker properly.)

Anyway: The result when I try to start FreedomGPT:

$ docker run -d -p 8889:8889 freedomgpt/freedomgpt
WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested
03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971

Then it exits.

Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?

@eric-hansen
Copy link

eric-hansen commented Jul 2, 2023 via email

@nacho00112
Copy link

@eric-hansen @aktiwers How did you do it? I ran into the same problems as @Postconceptlab described in this issue #89 except that I did not even come past the "loading model" page.

Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here before I could run docker properly.)

Anyway: The result when I try to start FreedomGPT:

$ docker run -d -p 8889:8889 freedomgpt/freedomgpt
WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested
03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971

Then it exits.

Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?

A chroot or proot within the docker might be

@scubbx
Copy link

scubbx commented Jul 7, 2023

Rebuilding the docker image on my system and then explicitly specifying the platform when running the container worked for me:

git clone https://github.com/ohmplatform/FreedomGPT.git
cd FreedomGPT/docker-app
docker build -t freedomgpt/freedomgpt .
docker run -p 8889:8889 --platform amd64 freedomgpt/freedomgpt

@aktiwers
Copy link

aktiwers commented Jul 7, 2023

I'm not using the docker version - but I found the "Loading model" screen takes some time to load - but eventually it will load and work.

image

I Just followed the yarn install instructions in the README and re-build llama.cpp from source.

@aktiwers
Copy link

aktiwers commented Jul 7, 2023

@w-sky I have uploaded llama.cpp build on Linux here:
https://github.com/aktiwers/llama.cpp-linux-build

If you don't want to build it yourself.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants