LocalAI
starsforks
How to install LocalAI?
mudler/localai
$git clone https://github.com/mudler/LocalAILocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
README.md
| 1 | <h1 align="center"> |
| 2 | <br> |
| 3 | <img width="300" src="./core/http/static/logo.png"> <br> |
| 4 | <br> |
| 5 | </h1> |
| 6 | |
| 7 | <p align="center"> |
| 8 | <a href="https://github.com/go-skynet/LocalAI/stargazers" target="blank"> |
| 9 | <img src="https://img.shields.io/github/stars/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI stars"/> |
| 10 | </a> |
| 11 | <a href='https://github.com/go-skynet/LocalAI/releases'> |
| 12 | <img src='https://img.shields.io/github/release/go-skynet/LocalAI?&label=Latest&style=for-the-badge'> |
| 13 | </a> |
| 14 | <a href="LICENSE" target="blank"> |
| 15 | <img src="https://img.shields.io/badge/License-MIT-yellow.svg?style=for-the-badge" alt="LocalAI License"/> |
| 16 | </a> |
| 17 | </p> |
| 18 | |
| 19 | <p align="center"> |
| 20 | <a href="https://twitter.com/LocalAI_API" target="blank"> |
| 21 | <img src="https://img.shields.io/badge/X-%23000000.svg?style=for-the-badge&logo=X&logoColor=white&label=LocalAI_API" alt="Follow LocalAI_API"/> |
| 22 | </a> |
| 23 | <a href="https://discord.gg/uJAeKSAGDy" target="blank"> |
| 24 | <img src="https://img.shields.io/badge/dynamic/json?color=blue&label=Discord&style=for-the-badge&query=approximate_member_count&url=https%3A%2F%2Fdiscordapp.com%2Fapi%2Finvites%2FuJAeKSAGDy%3Fwith_counts%3Dtrue&logo=discord" alt="Join LocalAI Discord Community"/> |
| 25 | </a> |
| 26 | </p> |
| 27 | |
| 28 | <p align="center"> |
| 29 | <a href="https://trendshift.io/repositories/5539" target="_blank"><img src="https://trendshift.io/api/badge/repositories/5539" alt="mudler%2FLocalAI | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a> |
| 30 | </p> |
| 31 | |
| 32 | <!-- Keep these links, translations synced daily. --> |
| 33 | <p align="center"> |
| 34 | <a href="https://zdoc.app/de/mudler/LocalAI">Deutsch</a> | |
| 35 | <a href="https://zdoc.app/es/mudler/LocalAI">Español</a> | |
| 36 | <a href="https://zdoc.app/fr/mudler/LocalAI">français</a> | |
| 37 | <a href="https://zdoc.app/ja/mudler/LocalAI">日本語</a> | |
| 38 | <a href="https://zdoc.app/ko/mudler/LocalAI">한국어</a> | |
| 39 | <a href="https://zdoc.app/pt/mudler/LocalAI">Português</a> | |
| 40 | <a href="https://zdoc.app/ru/mudler/LocalAI">Русский</a> | |
| 41 | <a href="https://zdoc.app/zh/mudler/LocalAI">中文</a> |
| 42 | </p> |
| 43 | |
| 44 | **LocalAI** is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. |
| 45 | |
| 46 | **A small core, not a bundle.** Each backend wraps a best-in-class engine (llama.cpp, vLLM, whisper.cpp, stable-diffusion, MLX...) in its own image, pulled only when a model needs it. You install nothing you don't use. |
| 47 | |
| 48 | - **Composable by design**: backends are separate and pulled on demand, so you install only what your model needs |
| 49 | - **Open and extensible**: load any model, or build your own backend in any language against an open interface |
| 50 | - **Drop-in API compatibility**: OpenAI, Anthropic, and ElevenLabs APIs across every backend |
| 51 | - **Any model, any modality**: LLMs, vision, voice, image, and video behind one API |
| 52 | - **Any hardware**: NVIDIA, AMD, Intel, Apple Silicon, Vulkan, or CPU-only |
| 53 | - **Multi-user ready**: API key auth, user quotas, role-based access |
| 54 | - **Built-in AI agents**: autonomous agents with tool use, RAG, MCP, and skills |
| 55 | - **Privacy-first**: your data never leaves your infrastructure |
| 56 | |
| 57 |  |
| 58 | |
| 59 | Created by [Ettore Di Giacinto](https://github.com/mudler) and maintained by the [LocalAI team](#team). |
| 60 | |
| 61 | > [:book: Documentation](https://localai.io/) | [:speech_balloon: Discord](https://discord.gg/uJAeKSAGDy) | [💻 Quickstart](https://localai.io/basics/getting_started/) | [🖼️ Models](https://models.localai.io/) | [❓FAQ](https://localai.io/faq/) |
| 62 | |
| 63 | ## Guided tour |
| 64 | |
| 65 | https://github.com/user-attachments/assets/08cbb692-57da-48f7-963d-2e7b43883c18 |
| 66 | |
| 67 | <details> |
| 68 | |
| 69 | <summary> |
| 70 | Click to see more! |
| 71 | </summary> |
| 72 | |
| 73 | #### User and auth |
| 74 | |
| 75 | https://github.com/user-attachments/assets/228fa9ad-81a3-4d43-bfb9-31557e14a36c |
| 76 | |
| 77 | #### Agents |
| 78 | |
| 79 | https://github.com/user-attachments/assets/6270b331-e21d-4087-a540-6290006b381a |
| 80 | |
| 81 | #### Usage metrics per user |
| 82 | |
| 83 | https://github.com/user-attachments/assets/cbb03379-23b4-4e3 |
People who liked this also viewed
6 picksType
- mcp-proxy-for-awsAWS MCP Proxy ServerMCP ServersJul 2026
- pydantic-ai-backendFile Storage & Sandbox Backends for Pydantic AI: console tools for file operations, Docker-isolated sandboxes for safe execution, and permission system with presets for access control. Enables secure multi-user handling and testing in agents via in-memory, local, or containerized storage.MCP ServersJul 2026
- mcp-for-argocdAn implementation of Model Context Protocol (MCP) server for Argo CD.MCP ServersJul 2026
- heroku-mcp-serverHeroku Platform MCP Server using the Heroku CLIMCP ServersJul 2026
- ghost-mcpA Model Context Protocol (MCP) server for interacting with Ghost CMS through LLM interfaces like Claude. Allow you to control your Ghost blog by simply asking Claude etc.MCP ServersApr 2026
- Google DriveUpload, organize, and share files in the cloud. Manage folders, set permissions, and search across stored documents.MCP Serversrecently
