gateway
installs/mo · npmstarsforks
How to install gateway?
portkey-ai/gateway
$git clone https://github.com/Portkey-AI/gateway> [!IMPORTANT] > :rocket: Gateway 2.0 (Pre-Release) Portkey's core enterprise gateway is merging into open-source with our 2.0 release. You can try the pre-release branch here. > Read more about what's next for Portkey in our [*
README.md
| 1 | <p align="right"> |
| 2 | <strong>English</strong> | <a href="./.github/README.cn.md">中文</a> | <a href="./.github/README.jp.md">日本語</a> |
| 3 | </p> |
| 4 | |
| 5 | > [!IMPORTANT] |
| 6 | > :rocket: Gateway 2.0 (Pre-Release) Portkey's core enterprise gateway is merging into open-source with our 2.0 release. You can try the pre-release branch [here](https://github.com/portkey-ai/gateway/tree/2.0.0). |
| 7 | > Read more about what's next for Portkey in our [**Series A announcement**](https://portkey.wiki/rohit-a). |
| 8 | |
| 9 | |
| 10 | <div align="center"> |
| 11 | |
| 12 | 🆕 **[Portkey Models](https://github.com/Portkey-AI/models)** - Open-source LLM pricing for 2,300+ models across 40+ providers. [Explore →](https://portkey.ai/models) |
| 13 | |
| 14 | |
| 15 | # AI Gateway |
| 16 | #### Route to 250+ LLMs with 1 fast & friendly API |
| 17 | |
| 18 | <img src="https://cfassets.portkey.ai/sdk.gif" width="550px" alt="Portkey AI Gateway Demo showing LLM routing capabilities" style="margin-left:-35px"> |
| 19 | |
| 20 | [Docs](https://portkey.wiki/gh-1) | [Enterprise](https://portkey.wiki/gh-2) | [Hosted Gateway](https://portkey.wiki/gh-3) | [Changelog](https://portkey.wiki/gh-4) | [API Reference](https://portkey.wiki/gh-5) |
| 21 | |
| 22 | |
| 23 | [](./LICENSE) |
| 24 | [](https://portkey.wiki/gh-6) |
| 25 | [](https://portkey.wiki/gh-7) |
| 26 | [](https://portkey.wiki/gh-8) |
| 27 | [](https://portkey.wiki/gh-9) |
| 28 | |
| 29 | <a href="https://us-east-1.console.aws.amazon.com/cloudformation/home?region=us-east-1#/stacks/quickcreate?stackName=portkey-gateway&templateURL=https://portkey-gateway-ec2-quicklaunch.s3.us-east-1.amazonaws.com/portkey-gateway-ec2-quicklaunch.template.yaml"><img src="https://img.shields.io/badge/Deploy_to_EC2-232F3E?style=for-the-badge&logo=amazonwebservices&logoColor=white" alt="Deploy to AWS EC2" width="105"/></a> [](https://deepwiki.com/Portkey-AI/gateway) |
| 30 | </div> |
| 31 | |
| 32 | <br/> |
| 33 | |
| 34 | The [**AI Gateway**](https://portkey.wiki/gh-10) is designed for fast, reliable & secure routing to 1600+ language, vision, audio, and image models. It is a lightweight, open-source, and enterprise-ready solution that allows you to integrate with any language model in under 2 minutes. |
| 35 | |
| 36 | - [x] **Blazing fast** (<1ms latency) with a tiny footprint (122kb) |
| 37 | - [x] **Battle tested**, with over 10B tokens processed everyday |
| 38 | - [x] **Enterprise-ready** with enhanced security, scale, and custom deployments |
| 39 | |
| 40 | <br> |
| 41 | |
| 42 | #### What can you do with the AI Gateway? |
| 43 | - Integrate with any LLM in under 2 minutes - [Quickstart](#quickstart-2-mins) |
| 44 | - Prevent downtimes through **[automatic retries](https://portkey.wiki/gh-11)** and **[fallbacks](https://portkey.wiki/gh-12)** |
| 45 | - Scale AI apps with **[load balancing](https://portkey.wiki/gh-13)** and **[conditional routing](https://portkey.wiki/gh-14)** |
| 46 | - Protect your AI deployments with **[guardrails](https://portkey.wiki/gh-15)** |
| 47 | - Go beyond text with **[multi-modal capabilities](https://portkey.wiki/gh-16)** |
| 48 | - Explore **[agentic workflow](https://portkey.wiki/gh-17)** integrations |
| 49 | - Manage MCP servers with enterprise auth & observability using **[MCP Gateway](https://portkey.ai/docs/product/mcp-gateway)** |
| 50 | |
| 51 | <br><br> |
| 52 | |
| 53 | > [!TIP] |
| 54 | > Starring this repo helps more developers discover the AI Gateway 🙏🏻 |
| 55 | > |
| 56 | >  |
| 57 | > |
| 58 | <br> |
| 59 | |
| 60 | |
| 61 | <br> |
| 62 | |
| 63 | ## Quickstart (2 mins) |
| 64 | |
| 65 | ### 1. Setup your AI Gateway |
| 66 | |
| 67 | ```bash |
| 68 | # Run the gateway locally (needs Node.js and npm) |
| 69 | npx @portkey-ai/gateway |
| 70 | ``` |
| 71 | > The Gateway is running on `http://localhost:8787/v1` |
| 72 | > |
| 73 | > The Gateway Console is running on `http://localhost:8787/public/` |
| 74 | |
| 75 | <sup> |
| 76 | Deployment guides: |
| 77 | <a href="https://portkey.wiki/gh-18"><img height="12" width="12" src="https://cfasset |
People who liked this also viewed
6 picksType
- fastmcp🚀 The fast, Pythonic way to build MCP servers and clients.MCP ServersJul 2026
- playwright-mcpPlaywright MCP serverMCP ServersJul 2026
- ext-appsOfficial repo for spec & SDK of MCP Apps protocol - standard for UIs embedded AI chatbots, served by MCP serversMCP ServersJul 2026
- langchain-mcp-adaptersLangChain 🔌 MCPMCP ServersJul 2026
- mcporterCall MCPs via TypeScript, masquerading as simple TypeScript API. Or package them as cli.MCP ServersJul 2026
- mcp-proxyA bridge between Streamable HTTP and stdio MCP transportsMCP ServersJul 2026
