GoModel is the fastest and the most resource-efficient AI Gateway (the self-reproducible benchmarks). It's an alternative to LiteLLM (which was hacked recently) and Portkey (which is no longer maintained on GitHub).
(click on the animation ↑ to see the live demo)
GoModel saves you money and nerves.
Money - because you can remember the responses on this layer (caching), track your spending and do tricks like prompt compression and intelligent routing.
Nerves - because we strive to achieve good quality and reliability. Our ambition is to be the last AI gateway you will need - the most reliable, resource-optimal, feature-rich and fast.
## Quick Start **Step 1:** Install and start GoModel **macOS / Linux** ```bash curl -fsSL https://gomodel.enterpilot.io/install.sh | sh # OPENAI_API_KEY="your-openai-key" # (optional) gomodel ``` **Windows (PowerShell)** ```powershell irm https://gomodel.enterpilot.io/install.ps1 | iex # $env:OPENAI_API_KEY = "your-openai-key" # (optional) gomodel ``` **Docker** ```bash docker run --rm -p 8080:8080 \ -e OPENAI_API_KEY="your-openai-key" \ enterpilot/gomodel ``` ℹ️ You can configure GoModel with `.env` variables, a `config.yaml` file, OR directly in the dashboard. ℹ️ Full list of environment variables (including all available providers): [`.env.template`](./.env.template) ℹ️ The most secure way in production is to use `.env` to load API keys. **Step 2:** Open the dashboard ``` http://localhost:8080/admin/dashboard ``` **Step 3:** Make your first API call ```bash curl http://localhost:8080/v1/responses \ -H "Content-Type: application/json" \ -d '{ "model": "gpt-5-chat-latest", "input": "Hello!" }' ``` ## Using GoModel with official SDKs GoModel exposes an OpenAI-compatible API at `/v1` and an Anthropic-compatible API at `/v1/messages`, so the official SDKs work unchanged - just point the base URL at your GoModel server and use your GoModel key (set up with the `GOMODEL_MASTER_KEY` env variable or one generated in the dashboard). ### OpenAI SDK **Python** ```python from openai import OpenAI client = OpenAI( base_url="http://localhost:8080/v1", # your GoModel server api_key="your-gomodel-key", ) ``` **TypeScript / JavaScript** ```typescript import OpenAI from "openai"; const client = new OpenAI({ baseURL: "http://localhost:8080/v1", // your GoModel server apiKey: "your-gomodel-key", }); ``` ### Anthropic SDK The Anthropic SDK authenticates with `x-api-key`, which GoModel accepts alongside `Authorization: Bearer`. **Python** ```python from anthropic import Anthropic client = Anthropic( base_url="http://localhost:8080", # your GoModel server (no /v1 suffix) api_key="your-gomodel-key", ) ``` **TypeScript / JavaScript** ```typescript import Anthropic from "@anthropic-ai/sdk"; const client = new Anthropic({ baseURL: "http://localhost:8080", // your GoModel server (no /v1 suffix) apiKey: "your-gomodel-key", }); ``` ## Supported LLM Providers GoModel supports OpenAI, Anthropic, Cohere, Google Gemini, Vertex AI, DeepSeek, Groq, Fireworks AI, Meta (Muse Spark), OpenRouter, Z.ai, xAI (Grok), Alibaba Cloud Model Studio (Bailian), Kilo AI, MiniMax, Xiaomi MiMo, OpenCode Go, Azure OpenAI, Oracle, Ollama, SGLang, vLLM, llm-d, Amazon Bedrock Runtime, Amazon Bedrock Mantle, and all OpenAI-compatible providers. Voice: ElevenLabs (text-to-speech and speech-to-text). See the [Providers Overview](https://gomodel.enterpilot.io/docs/providers/overview?utm_source=readme) for the full per-provider feature matrix (chat, `/responses`, embeddings, files, batches, passthrough), credentials, and configuration notes. --- ## Docker Compose **Infrastructure only** (Redis, PostgreSQL, MongoDB, Adminer - no image build): ```bash cp .env.template .env # Add your API keys to .env docker compose up -d # or: make infra ``` **Full stack** (adds GoModel + Prometheus; builds the app image): ```bash docker compose --profile app up -d # or: make image ``` | Service | URL | | --------------- | --------------------- | | GoModel API | http://localhost:8080 | | Adminer (DB UI) | http://localhost:8081 | | Prometheus | http://localhost:9090 | ### Building the Docker Image Locally ```bash docker build -t gomodel . docker run --rm -p 8080:8080 --env-file .env gomodel ``` --- ## API Endpoints GoModel exposes OpenAI-compatible and Anthropic-compatible APIs, provider-native passthrough, and operations routes. See the [API Endpoints reference](https://gomodel.enterpilot.io/docs/advanced/api-endpoints?utm_source=readme) for the full endpoint tables, and [Admin Endpoints](https://gomodel.enterpilot.io/docs/advanced/admin-endpoints?utm_source=readme) for the admin REST API and dashboard. --- ## Gateway Configuration GoModel is configured through environment variables and an optional `config.yaml`. Environment variables override YAML values. See the [Configuration reference](https://gomodel.enterpilot.io/docs/advanced/configuration?utm_source=readme) for the full list of settings organized by category, along with [`.env.template`](./.env.template) and [`config/config.example.yaml`](./config/config.example.yaml). --- ## Features - [Caching](https://gomodel.enterpilot.io/docs/features/cache?utm_source=readme) - exact and semantic response caching, so repeated prompts cost nothing - [Cost tracking](https://gomodel.enterpilot.io/docs/features/cost-tracking?utm_source=readme) - per-request cost estimates, usage analytics, and spending breakdowns in the dashboard - [Budgets](https://gomodel.enterpilot.io/docs/features/budgets?utm_source=readme) - hard spend limits per user, team, or key - [Rate limits](https://gomodel.enterpilot.io/docs/features/rate-limits?utm_source=readme) - requests, tokens, and concurrency caps per user path, provider, or model - [Virtual models](https://gomodel.enterpilot.io/docs/features/virtual-models?utm_source=readme) - aliases and load balancing (round-robin or cost-based) behind stable model names - [Failover](https://gomodel.enterpilot.io/docs/features/failover?utm_source=readme) - automatic rerouting to backup providers, with [retries and circuit breakers](https://gomodel.enterpilot.io/docs/advanced/resilience?utm_source=readme) - [Labelling](https://gomodel.enterpilot.io/docs/features/labelling?utm_source=readme) - tag requests from HTTP headers or API keys and break down usage by label - [User paths](https://gomodel.enterpilot.io/docs/features/user-path?utm_source=readme) - hierarchical scoping of keys, model access, budgets, usage, and audit logs - [MCP gateway](https://gomodel.enterpilot.io/docs/features/mcp-gateway?utm_source=readme) - aggregate your MCP servers behind one authenticated endpoint - [Passthrough API](https://gomodel.enterpilot.io/docs/features/passthrough-api?utm_source=readme) - provider-native APIs under `/p/{provider}/...`, with GoModel auth and tracking - [Guardrails](https://gomodel.enterpilot.io/docs/advanced/guardrails?utm_source=readme) - request and response policies enforced at the gateway - [Provider key rotation](https://gomodel.enterpilot.io/docs/providers/key-rotation?utm_source=readme) - round-robin over multiple API keys to lift per-key rate limits - [Observability](https://gomodel.enterpilot.io/docs/guides/prometheus-metrics?utm_source=readme) - Prometheus metrics, audit logs, and live request streaming in the dashboard ## Roadmap See the [Roadmap](https://gomodel.enterpilot.io/docs/about/roadmap?utm_source=readme) for commercial features and the public 0.2.0 milestone. ## Sponsors
## Community
Join our [Discord](https://discord.gg/gaEB9BQSPH) to connect with other GoModel users.