✨ New Model Manager ✨

[Jeffser]

Hi everyone, I've been working on re-coding the whole model manager, I just wanted to show a sneak peek of what's coming in the next version!

Progress

• Listing Available Models
• Available Model Sidebar
• Listing Local Models
• Local Model Sidebar
• Pull Models
• List Pulling Models (and their progress)
• Delete Model
• Cancel Download
• Visit Available Models' Websites
• Fetch Model Information
• Model Selector Integration*
• Model Search
• Import Models (GGUF, Name, Existing)
• Custom Model Creator
• Removal of Old Model Manager

• When you send a message it detects the model from the model selector and gets it's information from the model manager, that feature still uses the old model manager

[Jeffser]

Btw I've been thinking of renaming it to Model Dashboard just to have a fancy new name for it, what do you guys think?

[mags0ft]

I'm uncertain whether that accurately reflects the purpose - after all, a dashboard is a board to represent and visualize data (charts, statistics, grouping stuff, most important info first and all that), while this is more of a management interface. You can certainly do it, I just believe "Model manager" (or "Model management") would be a bit more fitting.

[Jeffser]

yeaah you're right, I should probably just leave it as Model Manager

[mags0ft]

This is absolutely beautiful, you did a really great job with that one! It would be an understatement to say that I'm stunned. Keep up the awesome work!

[Jeffser]

thanks!

[Jeffser]

Update 1:

Search has been implemented

Now both local models and available models get filtered with these values:

Local Models

• Model Title
• System Message

Pulling Models

• Model Title

Available Models

• Model Title
• Description
• Categories

[Jeffser]

Update 2

I added some cute messages in the model manager

No local models

No models found in search

[mags0ft]

Holy moly, those give it even more of that polished look. Like it!

[Jeffser]

Update 3

I changed the sidebars a bit, now the buttons are at the bottom and the available model page doesn't have a button to go to the model's website, instead it's just a link in the label

Local Model

Pulling Model

Available Model

[Jeffser]

Update 4

So I did a thing

[mags0ft]

says "I did a thing"

shows completely overhauled model creator UI from heaven

Keep it up, looking awesome!

[Jeffser]

Update 5

The model creator works!

Screencast.From.2025-01-17.14-51-17.webm

[Jeffser]

You can make hundreds of characters and they will all use the same model, so it doesn't take that much disk space, go wild with that information hahaha

[Jeffser]

Update 6

MM=model manager

MM 2.0 is not ready, error handling and notifications aren't completed

But I finished removing MM 1.0 from the codebase

Uploaded MM 2.0
7ed52dc

Integrated GGUF Importing
bd1980f

Deleted references to MM 1.0
33764f0

Removed MM 1.0 from codebase
4b84c61

---

Farewell to my beloved original model manager, it was one of the only parts of Alpaca that has been there since the first public version of Alpaca 🫡

First Version of Model Manager

Last Version of Model Manager 1.0

Rest in peace original model manager 🫡
May 2024 - January 2025

[Henkster72]

Great work! Looking forward on importing downloaded GGUF files (for instance the DeepSeek R1 versions)

[Jeffser]

Hi I'm glad you like my work.

Btw, DeepSeek R1 is going to be added to the library in the next version, I see there's a lot of hype around it and I want to test it for myself as well.