App Submission: localai

[highghlow]

noGPUpasthu4u

App Submission

App name

LocalAI

256x256 SVG icon

(Submit an icon with no rounded corners as it will be dynamically rounded with CSS. GitHub doesn't allow uploading SVGs directly, so please upload your icon to an alternate service, like https://svgur.com, and paste the link below.)
We will help finalize this icon before the app goes live in the Umbrel App Store.

For some reason I was only able to find this as a jpeg

https://github.com/go-skynet/LocalAI/assets/2420543/0966aa2a-166e-4f99-a3e5-6c915fc997dd

Gallery images

(Upload 3 to 5 high-quality gallery images (1440x900px) of your app in PNG format, or just upload 3 to 5 screenshots of your app and we'll help you design the gallery images.)
We will help finalize these images before the app goes live in the Umbrel App Store.
...

I can't get more screenshots because running this without gpu passthrough is really, really slow.

I have tested my app on:

• umbrelOS on a Raspberry Pi
• umbrelOS on an Umbrel Home
• umbrelOS on Linux

[nmfretz]

Thanks for getting this together @highghlow. I've been playing around with it this morning to package it so that it installs on a users machine with no/minimal models downloaded initially. The image and the models are quite large, so install time is very long.

But I've just realized embarrassingly late in my testing that the localai images are not multi-architecture. They are only available for x86 right now. This means that the install would fail for arm users (e.g., RPi 5) and leave users in a broken state. Let's close this for now until an official arm image is available. I will open an Issue in their repo asking about official arm support.

[nmfretz]

Ohhhhh, hold up I see that arm support is on the horizon so let's keep this PR open!
mudler/LocalAI#1249 (comment)

Once they are available I'm hoping we can use their "standard container images" which don't include pre-installed models:
https://localai.io/basics/container/#standard-container-images

[nmfretz]

Looks like some images are now multi-arch. e.g.,:

I will trigger our new github actions linter to start the review process.

[github-actions]

❌   Linting failed with 2 errors   ❌

Thank you for your submission! This is an automated linter that checks for common issues in pull requests to the Umbrel App Store.

Please review the linting results below and make any necessary changes to your submission.

Linting Results

Severity	File	Description
ℹ️	localai/docker-compose.yml	Mounted file/directory "/localai/data/models" doesn't exist: The volume "${APP_DATA_DIR}/data/models:/build/models:cached" tries to mount the file/directory "/localai/data/models", but it is not present. This can lead to permission errors!
❌	localai/docker-compose.yml	Invalid image architectures for image "localai/localai:v2.14.0-aio-cpu@sha256:b0366517053d5aadd093f1afb3143484bf7e6eaec163de6d71f547dc234fe18d": The image "localai/localai:v2.14.0-aio-cpu@sha256:b0366517053d5aadd093f1afb3143484bf7e6eaec163de6d71f547dc234fe18d" does not support the architectures "arm64" and "amd64". Please make sure that the image supports both architectures.
ℹ️	localai/docker-compose.yml	Potentially using unsafe user in service "api": The default container user "root" can lead to security vulnerabilities. If you are using the root user, please try to specify a different user (e.g. "1000:1000") in the compose file or try to set the UID/PUID and GID/PGID environment variables to 1000.
❌	localai/umbrel-app.yml	releaseNotes: The "releaseNotes" key is required

Legend

Symbol	Description
❌	Error: This must be resolved before this PR can be merged.
⚠️	Warning: This is highly encouraged to be resolved, but is not strictly mandatory.
ℹ️	Info: This is just for your information.