Agent runtime with typed memory, knowledge and code graphs, plus file and web tools
Copy the AI prompt to install this server into Claude Code, Cursor, or another agent β or use 1-click editor setup below.
π‘ Paste into ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows)
3 lines of code. Any backend. Local or cloud. Zero lock-in.
Aither ADK is a Python SDK + CLI for building AI agents that run on your hardware β a single helpful agent or a coordinated fleet that delegates work to each other. Agents get tools, persistent knowledge-graph memory, safety filtering, and effort-based model routing out of the box. Swap the LLM backend at runtime β your GPU, Ollama, llama.cpp, or any cloud API β same code, same agents.
| You have⦠| Run this | You get |
|---|---|---|
| Nothing β not even Python | one-line installer (below) | isolated env + first-run wizard |
| No GPU, no API key | adk setup --tier bonsai | Bonsai running free, offline, on CPU β even a phone or Pi |
| A GPU (6 GB+) | adk quickstart | auto-detected vLLM/Ollama, models pulled, ready to chat |
| Just an API key | adk quickstart --cloud | cloud inference (Anthropic / OpenAI / DeepSeek) |
| A whole LAN of machines | adk deploy grid | multi-machine effort-routed inference |
The no-Python one-liner β sets up an isolated environment (via uv) and launches the wizard:
Then, whichever path you took:
Using an AI coding agent (Claude Code, Cursor, Copilot)? Paste the Agent Setup Prompt into your session β it walks the agent through install, auth, inference, and the path from zero to fleet. There's also
llms.txt/llms-full.txtfor tools that ingest those.
Everything in the ADK hangs off five ideas:
AitherAgent("aither"). One object: await agent.chat("...") is the whole API. It has a persona, tools, and memory.ask_agent tool. One YAML file, one adk-serve command, and you have an orchestrator delegating to specialists.If you only remember one thing: agent.chat() is the agent. Everything else is configuration.
| I want to⦠| Read this |
|---|---|
| Build a real agent or publish a pack | docs/AGENT_DEV_GUIDE.md β the golden path + gotcha checklist |
| Self-host the full managed-agent experience | QUICKSTART_SELF_HOSTED.md β adk onboard --quick |
| Operate a self-hosted node long-term | docs/SELF_HOSTING_RUNBOOK.md |
| Run inference across several machines | GRID_SETUP.md |
| Wire up a specific LLM provider | docs/providers/ β DeepSeek, Kimi, OpenAI-compatible, local AitherOS |
| Give my agent a persistent identity/persona | docs/PERSONA.md Β· `adk soul import |
| Understand the world-model layer | docs/WORLD_MODEL.md |
| Connect agents across machines (relay) | docs/AITHERRELAY_GUIDE.md |
| Run a private, local-only companion | PRIVATE_COMPANION.md |
| See working code | examples/ β five runnable scripts |
| See what changed | CHANGELOG.md |
| Browse rendered docs | aitherium.github.io/aither-adk |
adk quickstart detects your hardware, pulls the right models, configures backends, and gets you chatting:
Either way you get the full harness: tools, skills, memory, and multi-agent coordination.
Want the full self-hosted, managed-agent experience (local LLM β customize a pack β enroll your machine β manage it from the portal)? See QUICKSTART_SELF_HOSTED.md β
adk onboard --quickdoes it in one command.
The package ships one ready agent β aither, the orchestrator. Add specialists by
installing a ready-made pack, or by defining your own. Any agent can then call any other
through the built-in ask_agent tool.
| Locked appliances | Aither ADK |
|---|---|
| Their hardware, their cloud | Your hardware, your rules |
| 1 AI assistant | Build a fleet β start with aither, add ready-made packs or your own; they delegate to each other |
| Their model picks | Any model β route by effort level automatically |
| Data on their servers | Data stays on your machine |
| Closed system, monthly fee | Open-core (BSL-1.1) β free, runs entirely on your box |
| Locked to one provider | Runtime backend switching β swap LLM mid-session |
| Cloud-only reasoning | Hybrid reasoning β local orchestration + cloud deep thinking |
No GPU. No API key. No account. Nothing leaves your machine.
Bonsai is Aitherium's family of ultra-compact models built to make agents sovereign by default β they run on hardware everyone already owns. The 1-bit Bonsai-27B runs on a plain CPU with 4 GB of RAM; Bonsai-4B runs in 2 GB (Android via Termux, Raspberry Pi Zero). Agents on Bonsai get the full harness β tool calling, memory, safety, fleets β not a demo mode.
Why this matters, concretely:
@tool functions, ask_agent delegation, and pack skills as the big models.When you outgrow it, effort routing lets you keep Bonsai for the cheap calls and send only the hard ones somewhere bigger β see hybrid profiles.
The backbone of the ADK: it runs your agents on whatever you have, and routes each call to the right model. Per-provider setup guides live in docs/providers/.
adk quickstart (or auto_setup() in code) detects your hardware and configures the optimal backend:
Aither picks the model by task complexity, so cheap calls stay cheap and hard calls get the big model:
| Effort | vLLM (primary) | Ollama (fallback) | OpenAI | Anthropic | Use case |
|---|---|---|---|---|---|
| 1β3 (small) | Llama-3.2-3B | llama3.2:3b | gpt-4o-mini | claude-haiku | Quick lookups, simple Q&A |
| 4β6 (medium) | Nemotron-Orchestrator-8B | nemotron-orchestrator-8b | gpt-4o | claude-sonnet | Most tasks, orchestration |
| 7β10 (large) | deepseek-r1:14b | deepseek-r1:14b | o1 | claude-opus | Complex reasoning, code review |
TQ4 (TurboQuant 4-bit) runs on GPUs as small as 6 GB. Bonsai 1-bit runs on anything β including phones.
| Profile | GPU VRAM | Orchestrator | Reasoning | Extras |
|---|---|---|---|---|
bonsai | none | Bonsai-27B Q1_0 (llama.cpp) | β | runs on CPU, phones, Pi, 4GB RAM |
bonsai-4b | none | Bonsai-4B Q4 (llama.cpp) | β | 2GB RAM minimum (Android, Pi Zero) |
nano | 6β8 GB | Nemotron-8B TQ4 | β | fits 6 GB |
lite | 10β16 GB | Nemotron-8B (8-bit) | β | single model |
standard-tq4 | 12β16 GB | Nemotron-8B TQ4 | DeepSeek-R1 14B TQ4 | both, 4-bit |
standard | 20β24 GB | Nemotron-8B | DeepSeek-R1 14B | both, full quality |
full | 24 GB+ | Nemotron-8B | DeepSeek-R1 14B | + Nomic embeddings |
hybrid | 10β16 GB + cloud | Nemotron-8B | Cloud (Anthropic/OpenAI) | local + cloud reasoning |
apple_silicon | M1βM4 | Ollama nemotron-8b | Ollama deepseek-r1:8b | β |
cpu_only | none | Cloud gateway | Cloud | cloud only |
grid_distributed | 6 GB+ NVIDIA + Mac + mini PCs | Nemotron-8B TQ4 (vLLM) | DeepSeek-R1 (Mac llama.cpp) | + Qwen2.5-32B (CPU cluster) |
Run a 3-tier effort-routed cluster β GPU desktop + Mac + CPU mini-PCs β with automatic fallback. Full guide: GRID_SETUP.md.
Omit --mac-host to auto-scan the LAN. For advanced multi-node sizing, start with
adk deploy grid --help.
The full golden path β pack authoring, never-forget RAG memory, BYO-key, the gotcha checklist β is docs/AGENT_DEV_GUIDE.md. This section is the tour.
Every agent ships with a local knowledge graph β SQLite-backed, embedding-aware, zero external deps. Ollama embeddings when available, feature-hashing fallback offline.
get_related("entity", depth=2) for multi-hop explorationNeurons auto-fire before LLM calls to gather relevant context β web, memory, graph β based on the query:
Built-in: WebSearchNeuron (DuckDuckGo, no key), MemoryNeuron (history search), GraphNeuron (semantic graph search).
Zero-dependency character-level transformer (pure-Python autograd, no PyTorch). Good for topic classification, anomaly detection, and per-document LoRA memory.
The differentiator: any agent can call any other agent. Create a fleet and every agent automatically gets ask_agent and list_agents.
Install ready-made packs, then serve them alongside the shipped aither orchestrator:
Mix the shipped orchestrator, installed packs, and your own inline agents:
Agents delegate through the built-in ask_agent tool, or you dispatch explicitly through the Forge:
| Endpoint | Method | Description |
|---|---|---|
/agents | GET | List all agents in the fleet |
/agents/{name}/chat | POST | Chat with a specific agent |
/forge/dispatch | POST | Dispatch via auto-routing |
/chat | POST | Chat with the orchestrator |
/v1/chat/completions | POST | OpenAI-compatible (routes to orchestrator) |
Protect the API with a bearer token:
The package ships one identity β aither, the orchestrator β ready to run. You grow from there three ways:
1. Install a ready-made pack (bundled, one command each):
| Pack | Role | Install |
|---|---|---|
openclaw | Web-research agent | adk install pack:openclaw |
hermes | Architecture & reasoning agent | adk install pack:hermes |
claude-code | Software-development agent | adk install pack:claude-code |
2. Bring your own β give any agent a system_prompt in fleet.yaml (no install needed), or drop a persona YAML in ~/.aither/agents/. To give an agent a durable identity across machines, see docs/PERSONA.md and adk soul export.
3. Author & publish a pack for others β the complete guide is docs/AGENT_DEV_GUIDE.md.
The broader specialist roster (atlas, demiurge, lyra, athena, hydra, prometheus, β¦) lives in the Aitherium platform and marketplace β it is not bundled in the free SDK.
The SDK is free, open-core, and complete on its own. Around it sits an optional platform you can grow into β every piece works Γ la carte, and none is required to build or run agents:
adk login) and your agents can burst to bigger models while local tools, memory, and identity stay on your machine.MCPBridge).adk install pack:β¦); publish your own (adk publish).adk onboard --quick) and manage its agents from the portal: QUICKSTART_SELF_HOSTED.md, long-term ops in docs/SELF_HOSTING_RUNBOOK.md.Auth is optional β needed only for cloud inference, cross-machine fleet sync, the marketplace, or cloud MCP tools. Credentials live in ~/.aither/config.json (written by adk login; never set AITHER_API_KEY by hand). Plans + pricing at aitherium.com.
| Variable | Default | Description |
|---|---|---|
AITHER_LLM_BACKEND | auto | ollama, openai, anthropic, auto |
AITHER_MODEL | (auto) | Default model name |
AITHER_PREFER_LOCAL | false | Try Ollama before the cloud gateway |
OLLAMA_HOST | http://localhost:11434 | Ollama server URL |
OPENAI_API_KEY / ANTHROPIC_API_KEY | Provider keys | |
AITHER_API_KEY | Aitherium cloud key (prefer adk login) | |
AITHER_PORT / AITHER_HOST | 8080 / 0.0.0.0 | Server bind |
AITHER_DATA_DIR | ~/.aither | Memory / conversations |
See examples/:
hello_agent.py β minimal 20-line agentcustom_tools.py β agent with @tool functionsopenai_agent.py β different LLM backendsmulti_agent.py β two agents collaboratingopenclaw_agent.py β web-research agentFirst stop, always:
Then:
Business Source License 1.1 β free for individuals, internal use, building your own products, research, and education. A commercial license is required only to offer a competing hosted AI-agent platform. Converts to AGPL-3.0 on 2030-03-13. See LICENSE; commercial licensing: hello@aitherium.com.
Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.
[](https://allmcps.com/mcp/aitheros-adk)<a href="https://allmcps.com/mcp/aitheros-adk"><img src="https://allmcps.com/api/badge/aitheros-adk?style=directory" alt="AitherOS ADK on AllMCPs" /></a>