Custom Chat Ui help.

[Screenmax1234]

Hello, I want to use something like openwebui or lobe chat but i seem to not be able to choose between providers for a specific problem is there a way to fix that?

[hlohaus]

@Screenmax1234 The providers are now exposed as models in the models list of the API. You can use a provider name as the model name. Note that provider models are not selectable in other UIs.

[Screenmax1234]

@Screenmax1234 The providers are now exposed as models in the models list of the API. You can use a provider name as the model name. Note that provider models are not selectable in other UIs.

So no way to specifically pick for one in something like openwebui. Thanks anyway!

[hlohaus]

@Screenmax1234, are you able to configure multiple API URLs in OpenWebUI?

I was thinking that adding provider-specific API endpoints, such as:

• http://localhost:8080/HuggingChat/chat/completions
• http://localhost:8080/HuggingChat/models

might resolve the issue. Does this sound like a viable solution?

[Screenmax1234]

I think I am only able to configure as many as openai like API I want

[Screenmax1234]

So I don't that will solve it but I could try

[hlohaus]

Yes, try it. I have added it in my PR.

Simply use this as API Base Url:

http://localhost:8080/api/HuggingSpace

Instead of:

http://localhost:8080/v1

[Screenmax1234]

Will test now..

[Screenmax1234]

HuggingSpace

It doesn't work

[github-actions]

Bumping this issue because it has been open for 7 days with no activity. Closing automatically in 7 days unless it becomes active again.