Examples for LocalAI

Note: These examples are provided as starting points - they may be temporarily out of date. If that happens, send us a PR!

ChatGPT OSS alternative	Image generation

Telegram bot	Flowise

Here is a list of projects that can easily be integrated with the LocalAI backend.

Projects

AutoGPT

by @mudler

This example shows how to use AutoGPT with LocalAI.

Check it out here

Chatbot-UI

by @mkellerman

This integration shows how to use LocalAI with mckaywrigley/chatbot-ui.

Check it out here

There is also a separate example to show how to manually setup a model: example

K8sGPT

by @mudler

This example show how to use LocalAI inside Kubernetes with k8sgpt.

Fine-tuning a model and convert it to gguf to use it with LocalAI

by @mudler

This example is an e2e example on how to fine-tune a model with axolotl and convert it to gguf to use it with LocalAI.

Check it out here

Flowise

by @mudler

This example shows how to use FlowiseAI/Flowise with LocalAI.

Check it out here

Discord bot

by @mudler

Run a discord bot which lets you talk directly with a model

Check it out here, or for a live demo you can talk with our bot in #random-bot in our discord server.

Langchain

by @dave-gray101

A ready to use example to show e2e how to integrate LocalAI with langchain

Check it out here

Langchain Python

by @mudler

A ready to use example to show e2e how to integrate LocalAI with langchain

Check it out here

LocalAI functions

by @mudler

A ready to use example to show how to use OpenAI functions with LocalAI

Check it out here

LocalAI WebUI

by @dhruvgera

A light, community-maintained web interface for LocalAI

Check it out here

How to run rwkv models

by @mudler

A full example on how to run RWKV models with LocalAI

Check it out here

PrivateGPT

by @mudler

A full example on how to run PrivateGPT with LocalAI

Check it out here

Slack bot

by @mudler

Run a slack bot which lets you talk directly with a model

Check it out here

Slack bot (Question answering)

by @mudler

Run a slack bot, ideally for teams, which lets you ask questions on a documentation website, or a github repository.

Check it out here

Question answering on documents with llama-index

by @mudler

Shows how to integrate with Llama-Index to enable question answering on a set of documents.

Check it out here

Question answering on documents with langchain and chroma

by @mudler

Shows how to integrate with Langchain and Chroma to enable question answering on a set of documents.

Check it out here

Telegram bot

_by @mudler

Use LocalAI to power a Telegram bot assistant, with Image generation and audio support!

Check it out here

Template for Runpod.io

by @fHachenberg

Allows to run any LocalAI-compatible model as a backend on the servers of https://runpod.io

Check it out here

Continue

by @gruberdev

Demonstrates how to integrate an open-source copilot alternative that enhances code analysis, completion, and improvements. This approach seamlessly integrates with any LocalAI model, offering a more user-friendly experience.

Check it out here

Streamlit bot

by @majoshi1

A chat bot made using Streamlit & LocalAI.

Check it out here

Want to contribute?

Create an issue, and put Example: <description> in the title! We will post your examples here.