The Roleplay Update 🎤 (3.2.0) #427

Jeffser · 2024-12-27T19:05:43Z

Jeffser
Dec 27, 2024
Maintainer

I've been transitioning Alpaca from using a JSON file and directories to save chats and attachments to a single instance of sqlite3 to do both.

It hasn't been easy but it's pretty much done, now that that's out of the way I made a new table to save...

MODEL PROFILE PICTURES!!!!

And yes, they are also represented in the chat itself.

Now the footer (should probably rename it at this point) is at the top of the messages, models with no pfp will make their messages fallback to the old button

And yes, the pfp acts as the options button now

Also the model creator is less scary when creating a model based on an existing model, this is not the full model creator I want to make in the future but it's good enough for now

Jeffser · 2024-12-27T19:30:58Z

Jeffser
Dec 27, 2024
Maintainer Author

ec8bf9c

0 replies

Ayanami-Rin · 2025-01-09T10:20:17Z

Ayanami-Rin
Jan 9, 2025

Will you add a way to import older chats that are now defunct and not listed in the client with this update?

9 replies

Ayanami-Rin Jan 10, 2025

ayanami@kaiju:~$ flatpak run com.jeffser.Alpaca 
INFO	[main.py | main] Alpaca version: 3.2.0
ERROR	[window.py | initial_convert_to_sql] UNIQUE constraint failed: message.id
INFO	[connection_handler.py | start] Starting Alpaca's Ollama instance...
INFO	[connection_handler.py | start] Started Alpaca's Ollama instance
Couldn't find '/home/ayanami/.ollama/id_ed25519'. Generating new private key.
Your new public key is: 

ssh-ed25519 AAAAC3***RszcrBxV

2025/01/10 21:27:59 routes.go:1259: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:true OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11435 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/ayanami/.var/app/com.jeffser.Alpaca/data/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
INFO	[connection_handler.py | start] client version is 0.5.4
time=2025-01-10T21:27:59.896+01:00 level=INFO source=images.go:757 msg="total blobs: 19"
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.
time=2025-01-10T21:27:59.897+01:00 level=INFO source=images.go:764 msg="total unused blobs removed: 0"

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
time=2025-01-10T21:27:59.897+01:00 level=INFO source=routes.go:1310 msg="Listening on 127.0.0.1:11435 (version 0.5.4)"
 - using env:	export GIN_MODE=release
 - using code:	gin.SetMode(gin.ReleaseMode)

[GIN-debug] POST   /api/pull                 --> github.com/ollama/ollama/server.(*Server).PullHandler-fm (5 handlers)
[GIN-debug] POST   /api/generate             --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers)
[GIN-debug] POST   /api/chat                 --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers)
[GIN-debug] POST   /api/embed                --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers)
[GIN-debug] POST   /api/embeddings           --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers)
[GIN-debug] POST   /api/create               --> github.com/ollama/ollama/server.(*Server).CreateHandler-fm (5 handlers)
[GIN-debug] POST   /api/push                 --> github.com/ollama/ollama/server.(*Server).PushHandler-fm (5 handlers)
[GIN-debug] POST   /api/copy                 --> github.com/ollama/ollama/server.(*Server).CopyHandler-fm (5 handlers)
[GIN-debug] DELETE /api/delete               --> github.com/ollama/ollama/server.(*Server).DeleteHandler-fm (5 handlers)
[GIN-debug] POST   /api/show                 --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (5 handlers)
[GIN-debug] POST   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers)
[GIN-debug] GET    /api/ps                   --> github.com/ollama/ollama/server.(*Server).PsHandler-fm (5 handlers)
[GIN-debug] POST   /v1/chat/completions      --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers)
[GIN-debug] POST   /v1/completions           --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers)
[GIN-debug] POST   /v1/embeddings            --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models                --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models/:model         --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (6 handlers)
[GIN-debug] GET    /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] GET    /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] GET    /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
[GIN-debug] HEAD   /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] HEAD   /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:80 msg="runners located" dir=/app/lib/ollama/runners
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/cpu_avx/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/cpu_avx2/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/cuda_v11_avx/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/cuda_v12_avx/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/rocm_avx/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=INFO source=routes.go:1339 msg="Dynamic LLM libraries" runners="[rocm_avx cpu cpu_avx cpu_avx2 cuda_v11_avx cuda_v12_avx]"
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=routes.go:1340 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY"
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=sched.go:105 msg="starting llm scheduler"
time=2025-01-10T21:27:59.897+01:00 level=INFO source=gpu.go:226 msg="looking for compatible GPUs"
time=2025-01-10T21:27:59.899+01:00 level=DEBUG source=gpu.go:99 msg="searching for GPU discovery libraries for NVIDIA"
time=2025-01-10T21:27:59.899+01:00 level=DEBUG source=gpu.go:517 msg="Searching for GPU library" name=libcuda.so*
time=2025-01-10T21:27:59.899+01:00 level=DEBUG source=gpu.go:543 msg="gpu library search" globs="[/app/lib/ollama/libcuda.so* /app/lib/ollama/libcuda.so* /app/lib/libcuda.so* /usr/lib/x86_64-linux-gnu/GL/default/lib/libcuda.so* /usr/lib/x86_64-linux-gnu/openh264/extra/libcuda.so* /usr/lib/x86_64-linux-gnu/openh264/extra/libcuda.so* /usr/lib/sdk/llvm15/lib/libcuda.so* /usr/lib/x86_64-linux-gnu/GL/default/lib/libcuda.so* /usr/lib/ollama/libcuda.so* /app/plugins/AMD/lib/ollama/libcuda.so* /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
time=2025-01-10T21:27:59.900+01:00 level=DEBUG source=gpu.go:577 msg="discovered GPU libraries" paths=[]
time=2025-01-10T21:27:59.900+01:00 level=DEBUG source=gpu.go:517 msg="Searching for GPU library" name=libcudart.so*
time=2025-01-10T21:27:59.900+01:00 level=DEBUG source=gpu.go:543 msg="gpu library search" globs="[/app/lib/ollama/libcudart.so* /app/lib/ollama/libcudart.so* /app/lib/libcudart.so* /usr/lib/x86_64-linux-gnu/GL/default/lib/libcudart.so* /usr/lib/x86_64-linux-gnu/openh264/extra/libcudart.so* /usr/lib/x86_64-linux-gnu/openh264/extra/libcudart.so* /usr/lib/sdk/llvm15/lib/libcudart.so* /usr/lib/x86_64-linux-gnu/GL/default/lib/libcudart.so* /usr/lib/ollama/libcudart.so* /app/plugins/AMD/lib/ollama/libcudart.so* /app/lib/ollama/libcudart.so* /app/lib/ollama/libcudart.so* /usr/local/cuda/lib64/libcudart.so* /usr/lib/x86_64-linux-gnu/nvidia/current/libcudart.so* /usr/lib/x86_64-linux-gnu/libcudart.so* /usr/lib/wsl/lib/libcudart.so* /usr/lib/wsl/drivers/*/libcudart.so* /opt/cuda/lib64/libcudart.so* /usr/local/cuda*/targets/aarch64-linux/lib/libcudart.so* /usr/lib/aarch64-linux-gnu/nvidia/current/libcudart.so* /usr/lib/aarch64-linux-gnu/libcudart.so* /usr/local/cuda/lib*/libcudart.so* /usr/lib*/libcudart.so* /usr/local/lib*/libcudart.so*]"
time=2025-01-10T21:27:59.901+01:00 level=DEBUG source=gpu.go:577 msg="discovered GPU libraries" paths="[/app/lib/ollama/libcudart.so.11.3.109 /app/lib/ollama/libcudart.so.12.4.127]"
CUDA driver version: 12-7
time=2025-01-10T21:28:00.055+01:00 level=DEBUG source=gpu.go:149 msg="detected GPUs" library=/app/lib/ollama/libcudart.so.11.3.109 count=1
[GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2] CUDA totalMem 23641784320
[GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2] CUDA freeMem 22253928448
[GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2] CUDA usedMem 0
[GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2] Compute Capability 8.9
time=2025-01-10T21:28:00.161+01:00 level=DEBUG source=amd_linux.go:421 msg="amdgpu driver not detected /sys/module/amdgpu"
releasing cudart library
time=2025-01-10T21:28:00.235+01:00 level=INFO source=types.go:131 msg="inference compute" id=GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2 library=cuda variant=v11 compute=8.9 driver=0.0 name="" total="22.0 GiB" available="20.7 GiB"
[GIN] 2025/01/10 - 21:28:00 | 200 |     648.132µs |       127.0.0.1 | GET      "/api/tags"
[GIN] 2025/01/10 - 21:28:00 | 200 |   14.863482ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2025/01/10 - 21:28:00 | 200 |   16.541291ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2025/01/10 - 21:28:00 | 200 |   30.329722ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2025/01/10 - 21:28:00 | 200 |   31.431101ms |       127.0.0.1 | POST     "/api/show"
INFO	[window.py | closing_app] Closing app...
INFO	[connection_handler.py | stop] Stopping Alpaca's Ollama instance
INFO	[connection_handler.py | stop] Stopped Alpaca's Ollama instance
ayanami@kaiju:~$

Jeffser Jan 10, 2025
Maintainer Author

This line seems to be the problem

ERROR [window.py | initial_convert_to_sql] UNIQUE constraint failed: message.id

I'll see what I can do

Jeffser Jan 10, 2025
Maintainer Author

Well there's an easier way of doing this actually.

Move ~/.var/app/com.jeffser.Alpaca/data/chats_test.db somewhere else
Make sure the directory is named chats and not chats_OLD
Run Alpaca, it will reset and force the importing of old chats
Press CTRL+i and select the file you moved before (chats_test.db)

Ayanami-Rin Jan 12, 2025

That did not fix the issue.

Ayanami-Rin Jan 16, 2025

Updated to 3.5.0
Now it just WIPES the old chats and does not convert them...

ayanami@kaiju:~/.var/app/com.jeffser.Alpaca/data$ ll
total 48
drwxr-xr-x. 1 ayanami ayanami   142 Jan 16 11:36 chats
-rw-r--r--. 1 ayanami ayanami 36864 Jan 16 11:36 chats_test.db
-rw-r--r--. 1 ayanami ayanami  9797 Jan 16 11:36 tmp.log
ayanami@kaiju:~/.var/app/com.jeffser.Alpaca/data$ flatpak run com.jeffser.Alpaca 
INFO	[main.py | main] Alpaca version: 3.5.0
ERROR	[window.py | initial_convert_to_sql] UNIQUE constraint failed: message.id
INFO	[connection_handler.py | start] Starting Alpaca's Ollama instance...
INFO	[connection_handler.py | start] Started Alpaca's Ollama instance
INFO	[connection_handler.py | start] client version is 0.5.4
INFO	[window.py | closing_app] Closing app...
INFO	[connection_handler.py | stop] Stopping Alpaca's Ollama instance
INFO	[connection_handler.py | stop] Stopped Alpaca's Ollama instance
ayanami@kaiju:~/.var/app/com.jeffser.Alpaca/data$ ll
total 60
-rw-r--r--. 1 ayanami ayanami 53248 Jan 16 11:37 alpaca.db
-rw-r--r--. 1 ayanami ayanami  5617 Jan 16 11:37 tmp.log
ayanami@kaiju:~/.var/app/com.jeffser.Alpaca/data$

Edit: Swapped terminal output to include messages from Alpaca.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

The Roleplay Update 🎤 (3.2.0) #427

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments 9 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

The Roleplay Update 🎤 (3.2.0) #427

Jeffser Dec 27, 2024 Maintainer

Replies: 2 comments · 9 replies

Jeffser Dec 27, 2024 Maintainer Author

Ayanami-Rin Jan 9, 2025

Ayanami-Rin Jan 10, 2025

Jeffser Jan 10, 2025 Maintainer Author

Jeffser Jan 10, 2025 Maintainer Author

Ayanami-Rin Jan 12, 2025

Ayanami-Rin Jan 16, 2025

Jeffser
Dec 27, 2024
Maintainer

Replies: 2 comments 9 replies

Jeffser
Dec 27, 2024
Maintainer Author

Ayanami-Rin
Jan 9, 2025

Jeffser Jan 10, 2025
Maintainer Author

Jeffser Jan 10, 2025
Maintainer Author