[REQ] interactive chat interface

[sozercan]

What kind of request is this?

New feature

What is your request or suggestion?

support for interactive chat interface

https://github.com/charmbracelet/bubbletea/blob/master/examples/chat/main.go

mudler/LocalAI#1535

Are you willing to submit PRs to contribute to this feature request?

• Yes, I am willing to implement it.

[sozercan]

https://github.com/darrenburns/elia provides a nice tui

docker run -d --rm -p 8080:8080 ​ghcr.io/sozercan/llama3:8b
echo -e '[[models]]\nname = "openai/llama-3-8b-instruct"\napi_base = "http://localhost:8080"' >> ~/.config/elia/config.toml
elia -i "hello world" -m openai/llama-3-8b-instruct