Get Started: Support 🆘

[Jeffser]

The app doesn't work how it's supposed to 😠

Please report the problem at the issues page.

I want to suggest something! ✨

Open an issue or comment on this discussion

I need help with something 🙏🏻

Comment on this discussion

[BurningPho3nix]

How can I tell it to use my AMD GPU?

[olumolu]

The support for amd gpu is wip you can help if you have amd gpu you can compile and test your self if your gpu is used by default. If not let us know if yes let us know here and mention the gpu name

[maxkeller]

Just a heads up, this doesn't work for me, even though I installed the plugin it still says the extension is missing. I'm on Fedora 41.

[olumolu]

Wait for new release 3.0.0 that on going issue will be resolved...24th dec update happy holiday update

[Duckbuster]

Is there a way to confirm it is actually using the GPU? I see VRAM usage go up, but I also still see a lot of CPU load as well. Or is that normal?

[Jeffser]

@Duckbuster you are probably running a model that doesn't fit inside the vram, so Ollama fallbacked to using the CPU

[MedDevGeek88]

Wondering if there is a way to change the number of workers and threads, optimizations, etc.? Running on a 32-core hyperthreading system, and wondering if it can be manually optimized to maximize use of all CPU cores for all models.

[olumolu]

Underneath technology is ollama that this app use to give you a interactive chat interface you need to ask ollama for that.

[MedDevGeek88]

Ok thank you. Wasn’t sure if this app was somehow able to interact with Ollama to change settings like that. Will look in to the back end for those options. Thanks!

[kirijin]

Screenshot

In model download window there are no quantized variants to be seen anymore. But there used to be. A bug or a feature? As if the .gguf downloading support is gone...

[Jeffser]

GGUF compatibility is still available, the tag list comes from the ollama website, so if they aren't present in that website they won't be listed in Alpaca