Preflight

Observability for AI Coding Assistants

Docs • What's New • Examples • Community • Contributing

Why Your AI Tool Needs Observability

Your AI coding assistant makes hundreds of decisions every session — what to read, what to edit, when to run commands. But you can't see any of it. You know it was fast, but was it efficient? You got a PR merged, but how much did it cost? You fixed a bug, but did it get stuck in a loop first?

Preflight is observability for agentic coding — the actions, cost, and efficiency of your AI coding assistant as it works. See exactly what's happening, how much it costs, and where your AI is wasting time.

Local-first by design. Preflight runs entirely on your machine and sends your data nowhere by default. A live dashboard at localhost:7777 shows your sessions in real time, fully offline. Connect a New Relic account only when you want more — team rollups, alerting, and cross-session history. You choose: local-only, New Relic, or both.

Demo

See cost breakdown, efficiency scoring, anti-patterns, and live session tracking in action.

What You Get

Visibility

• Every action captured — file reads, edits, commands, searches
• Live session dashboard — see what's happening right now
• Historical trends — analyze patterns over weeks and months

Cost Control

• USD spend tracking — per session, day, and week
• Per-model and cache breakdown — know which models cost most and how efficiently context is reused
• Budget alerts — get notified before you overspend
• Forecasting — project monthly burn rate

Efficiency Insights

• Efficiency score — 0–100 score per task, based on how directly the AI worked
• Anti-pattern detection — catches re-reads, blind edits, stuck loops
• Personalized recommendations — optimize your AI workflow
• Weekly coaching reports — narrative analysis vs. your historical baseline

Dashboards

• Local dashboard — live session view at localhost:7777, no account required
• 8 pre-built New Relic dashboards — deploy in seconds (New Relic mode):
  • Overview — session stats, cost summary, top tools
  • Personal — 30-day self-reflection scoped to you
  • Session Detail — deep-dive into a single session's tool calls
  • Team View — aggregated cost and efficiency across developers
  • Manager View — high-level team metrics, no tool-call content
  • Adoption & Cost — adoption momentum, spend, MCP usage, and per-developer outcomes for engineering managers
  • Platform Comparison — Claude Code vs. Cursor vs. Windsurf, etc.
  • Security Audit — audit trail of sensitive file access

Quick Start

1. Install

npm install -g @newrelic/preflight

Using Smithery? Installing Preflight from the Smithery MCP registry wires up the MCP server for you, but Smithery has no mechanism to write Claude Code hooks. After install, ask Claude Code to call the nr_observe_install_hooks MCP tool (it will offer to do this automatically once nr_observe_health reports setup_required: true), then restart Claude Code to activate monitoring.

2. Run setup

preflight setup

The wizard defaults to local mode — press Enter through the prompts and you're set. It wires Preflight into your AI tool (hooks + MCP server) and writes config to ~/.newrelic-preflight/. Takes under a minute, no account required.

Using GitHub Copilot? The wizard also asks to install Copilot hooks — saying yes configures both the Copilot CLI and VS Code Copilot Chat automatically (hooks, MCP registration, and the fix for VS Code's hook double-capture), so Copilot gets the same tool-call and cost metrics Claude Code does. Run it standalone anytime with preflight install --copilot. See docs/ADAPTERS.md for details.

When prompted, pick a mode:

3. Start coding

Restart your AI tool — hooks and the MCP server load at session start. Every tool call is captured automatically. Open http://localhost:7777 to watch your session live.

Using Kiro? Add Preflight as a Kiro Power for the nr_observe_* query tools — see the doc for install steps and how to add automatic tool-call capture on top.

Using Claude Code? You can skip the npm install above and add Preflight as a Claude Code plugin instead:

Code

Copy

/plugin marketplace add newrelic-experimental/preflight
/plugin install newrelic-preflight@newrelic-preflight-marketplace

Other ways to install

Cursor — Add to Cursor installs the MCP server via a one-click deeplink; run preflight setup afterwards for hook capture.

Works With

Claude Code • Cursor • Windsurf • GitHub Copilot • Zed • Continue.dev • Amazon Q Developer • Amazon Kiro

Coverage isn't uniform — some platforms capture every built-in tool call, others (Zed, Continue.dev) only see calls routed to Preflight's own MCP tools. See ADAPTERS.md for what each platform can and can't observe, and per-platform setup steps.

Connect New Relic (optional)

Local mode is fully featured on its own. Connect a New Relic account to unlock:

• Team & manager dashboards across multiple developers
• Alerting on cost spikes, low efficiency, and stuck loops
• Cross-session history, trends, and weekly coaching reports

Re-run preflight setup and choose cloud or both, or configure it non-interactively:

preflight install \
  --mode cloud \
  --license-key YOUR_LICENSE_KEY \
  --account-id YOUR_ACCOUNT_ID

EU accounts add --eu. FedRAMP accounts add --fedramp. Japan accounts add --jp.

Then deploy the prebuilt dashboards:

NEW_RELIC_API_KEY=NRAK-... NEW_RELIC_ACCOUNT_ID=12345 \
  preflight deploy-dashboards --all

You'll need a license key (telemetry ingest) and your account ID, plus a user API key (NRAK-…) to deploy dashboards and alerts. See ADVANCED.md for alerts, OTLP export to other backends, and Terraform.

No dashboard until you run deploy-dashboards. Cloud mode ships telemetry to New Relic as soon as it's configured, but nothing creates a dashboard automatically — that's the separate step above, and it needs a different credential (a user API key, not your license key). Until you run it, there's no UI to look at. In the meantime, query the raw events directly in New Relic's Query Builder, e.g.:

Dockerfile

Copy

SELECT * FROM AiToolCall SINCE 1 hour ago

Once deploy-dashboards succeeds, find the dashboards under your New Relic account's Dashboards section.

Data ingest note: Telemetry sent to New Relic counts against your account's data ingest. On paid plans, standard ingest rates apply. Monitor your usage under NR One → Data Management → Data Ingestion.

Requirements

Required

• Node.js v22 or higher (get it or use nvm)
• An AI coding tool (Claude Code recommended for deepest integration)

Optional

• New Relic account — only for cloud/both mode. Skip it to run local-only (the default).
• User API key (NRAK-…) — only needed to deploy dashboards and alerts

Other Commands

preflight doctor               # Run 10 diagnostic checks and print actionable fix commands
preflight validate             # Check config for syntax errors and unknown keys
preflight update               # Pull latest version, rebuild, and offer to restart a running dashboard (source installs only — npm installs: npm install -g @newrelic/preflight@latest)
preflight local                # List running --local dashboard processes and live --stdio MCP processes
preflight local --clean        # Kill orphaned --local processes and --stdio processes with a missing binary (prompts for confirmation)
preflight uninstall            # Remove hooks and MCP config (prompts with a summary first)
preflight uninstall --yes      # Skip the confirmation prompt (for scripts and CI)
preflight uninstall --daemon   # Remove only the background dashboard daemon

Add --project to install/uninstall to scope changes to the current directory only.

WSL users: preflight setup will ask which Claude Code you're running. You can also set it explicitly:

• --windows-cc — Windows Claude Code (the desktop app); uses wsl.exe hooks and Windows paths
• --linux-cc — Linux Claude Code installed via npm inside WSL

Documentation

• ADVANCED.md — Configuration, dashboards, alerts, Terraform
• SCORECARDS.md — New Relic Scorecard rules for team attribution
• ARCHITECTURE.md — Data flow, component reference, and operating modes
• ADAPTERS.md — Per-platform integration mechanism, setup steps, and known gaps
• TROUBLESHOOTING.md — Common setup and connection problems, and how to fix them
• CONTRIBUTING.md — Development, testing, submitting PRs
• SECURITY.md — Security guidelines and best practices
• PRIVACY.md — Data collection inventory and pre-cloud checklist

From Source

Develop, test, or run the latest unreleased version:

git clone https://github.com/newrelic-experimental/preflight
cd preflight
nvm use              # Switch to Node v24
npm install          # Install dependencies
npm run build        # Compile TypeScript
npm link             # Register preflight on PATH

Then run preflight setup as usual.

License

Preflight is open source under the Apache License 2.0.

Contributing

We welcome contributions! See CONTRIBUTING.md for how to get started. Join the New Relic Community to share ideas, ask questions, or discuss features.