Zero Markup. Higher Availability. Better Prices.

One Gateway. Every Model. Route Smarter. Ship Safer. Spend Less.

OrcaRouter grades every prompt and routes it intelligently. Frontier-quality AI at up to 40% lower cost. Adaptive routing, load balancing, guardrails, agent firewall, observability, and governance — all through a single OpenAI-compatible endpoint.

No credit card · live in 60 secs

Beats GPT-5 & Azure on RouterArenaBacked by published research
- client = OpenAI(api_key="sk-...")
+ client = OpenAI(
+ base_url="https://api.orcarouter.ai/v1",
+ api_key="sk-orca-..."
+ )
 
# Everything else stays the same.
response = client.chat.completions.create(
model="orcarouter/auto", # router picks the best model per request
messages=[{"role": "user", "content": "..."}]
)
# → orcarouter/auto grades the prompt → frontier or open-source, zero token markup ✓

One line. We grade each prompt, route to frontier or OSS, and add $0.

200+
models, one endpoint
0%
token markup, ever
75.5%
routing accuracy
<50ms
mid-stream failover
Integrations

Works with the tools you already use

Drop-in OpenAI-compatible, or connect agents over the OrcaRouter MCP server — keep your SDK, framework and editor.

OrcaRouter MCP serverOpenAI SDKGoogle GenAI SDKAnthropic SDKLangChainLlamaIndexVercel AI SDKCamelAIDifyCursorOpenCodePromptfooOpenClawOpenHumanGitHubcURLand more
Building on this? Talk to us.XDiscordGitHub
AI gateway for production

Smart routing and automatic failover on every request.

Routing that's measurably more accurate.

Every prompt is embedded and routed by a model that keeps learning online from real traffic. On the public RouterArena leaderboard (Jun 2026) it leads on accuracy — ahead of GPT-5, Azure, Martian and NotDiamond — at 75.5%.

contextual embeddingsonline learning<1ms overheadRouterArena
* Based on RouterArena leaderboard data, June 2026.

A provider goes down. No one notices.

When a provider rate-limits or 5xxs, OrcaRouter retries the request against a healthy model across 200+ options before the response starts — so transient upstream outages don't surface to your users.

200+ modelsauto-failoverno 429

Route on your terms.

orcarouter/auto is a smart default, not a black box. Point each workspace at the objective you want — the cheapest model that clears your quality bar, the highest quality, or a balance of both — or let it learn the trade-off from your own traffic. You're never locked into one behavior.

per-workspaceno markup either way<1ms overhead

Need more than a mode? Write the rule.

When the default isn't enough, express routing as code — version-controlled, reviewable, and live in seconds. No redeploy, no client change.

YAML + CELversion-controlledlive in seconds
routing.yaml
version: 1
rules:
- id: hard_agent_task
when: task_class == "agent" && difficulty >= 0.6
use:
model: "claude-opus-4-7"
reasoning_effort: high # spend where it matters
- id: short_prompts
when: request.input_tokens < 500
use: { delegate: cheapest }
default:
delegate: balanced # fall back to the chosen mode

See and prove every call — cost, model, latency, and why.

See everything. Prove anything.

See exactly what every request cost, which model served it, how long it took, and why it failed — full structured logs you can filter, replay, and copy as a runnable cURL. A route is never a black box.

Per-request logsgrade · model · costcopy-as-cURL

Zero markup. Zero black boxes.

You pay each provider their exact price — we add $0 per token, ever. Every request shows the grade, chosen model, provider, latency, and price, so cost is glass-box, not an opaque blended rate.

$0 / tokenprovider costglass-box receipt

Versioned prompts and caching — without a redeploy.

Change prompts. Not code.

Version prompts behind named labels with A/B splits and one-click rollback. Move a label and every request picks it up instantly — no redeploy, no code change, no client update.

VersionedA/BInstant rollbackNo deploy

Pay once. Reuse for free.

Repeated and cached prompt tokens bill at the provider's cache rate — often a fraction of the input price — across 5-minute and 1-hour ephemeral windows. Same answers, less spend, with cached_tokens on every receipt.

cache_controlcached_tokens5m / 1h windows

Guardrails, budgets, and an agent firewall that enforces.

Guardrails that stop things.

PII Shield and content policies run before the upstream call is billed. A blocked request returns a clean 400 and is never charged — guardrails enforced inline, not logged after the fact.

PII Shieldenforced pre-billingclean 400

Safe for your team. And your agents.

Budgets and roles for people; a risk-scored firewall for agents. Every tool and MCP call is graded ALLOW, REVIEW, or BLOCK before it runs, and anomaly detection flags rate and cost spikes against learned hour-of-week baselines.

ALLOW · REVIEW · BLOCKMCP gatinganomaly detection
Built for the agent era. Before you needed it.

Setup

Live in 60 seconds.

One URL change. Your existing SDK, model names, and streaming all work exactly as before.

Step 1

Point your SDK at us

Set base_url to api.orcarouter.ai/v1 and swap your API key. No other code changes needed.

Step 2

We route, guard & observe

Every call is routed to the best model, checked against your guardrails, and metered — graded in under 1ms, with failover, caching and full logs built in.

Step 3

You ship, on one endpoint

Traffic goes direct to each provider's first-party API at their published rate — we add $0 per token. One OpenAI-compatible endpoint for routing, observability and governance.


Every model. One price list.

200+ models with live, side-by-side pricing — what you'd pay the provider directly. We add $0 on top.

View all 200+ models →
ModelRouted toInput /MOutput /MContextQuality
kimi/kimi-k3NEWMoonshot$3.00$15.001M9.0
openai/gpt-5.6-lunaNEWOpenAI Direct$1.00$6.001M7.0
openai/gpt-5.6-terraNEWOpenAI Direct$2.50$15.001M8.0
openai/gpt-5.6-solNEWOpenAI Direct$5.00$30.001M9.0
grok/grok-4.5NEW$2.00$6.00500K9.0
tencent/hy3NEW$0.180$0.590262K8.0
anthropic/claude-sonnet-5NEWAnthropic Direct$2.00$10.001M9.0
kling/kling-3-turbo$0.112 /call
+ 194 more models · Prices update every 60 seconds

Pricing

Routing is free.
Pay for features.

We never take a cut of your token spend. Our revenue comes from optional team features.

Zero markup guarantee
You pay providers directly at their published rates. We add nothing on top of token costs. Routing is free; the optional Team plan funds the platform.
$0.00routing fee

Hacker

Free
Forever. Zero markup on all tokens.
✓ Route — 200+ models, auto-failover
✓ Observe — basic dashboard
✓ Manage — prompt versioning
✓ 3 API keys · 0% token markup
Start free

Enterprise

Custom
SLA commitments + private deployment.
✓ Everything in Team
✓ Private / on-prem deployment
✓ 99.99% uptime SLA
✓ Dedicated infrastructure
✓ Dedicated support & custom pricing
Trust & Compliance
Independently audited, continuously compliant — reports available under NDA.

From the blog

Fresh from the engine room.

What we're building and why — the five latest posts.

All posts →

FAQ

AI routers, LLM gateways, adaptive routing — answered.

Short, factual answers — the same set search engines see in this page's structured data.

What is an AI router?

An AI router sits between your app and many models and picks the best model for each request. OrcaRouter grades every prompt in under 1 ms and routes it — frontier for hard reasoning, open-source for routine — across 200+ models at zero token markup.

What is an LLM router and how does it work?

An LLM router classifies each prompt and matches it to the model most likely to answer well at the lowest cost. OrcaRouter routes on contextual embeddings with online learning from live traffic — 75.5% accuracy on the public RouterArena leaderboard.

Is OrcaRouter an AI gateway?

Yes. OrcaRouter is a production AI gateway: one OpenAI-compatible endpoint with adaptive routing, load balancing, automatic failover, guardrails, an agent firewall, prompt caching and per-request observability.

What is an AI CDN?

Like a CDN serves content from the best edge, an AI CDN serves inference from the best provider: healthy, fast, cheap capacity, cached repeated prompts, failover on outages. OrcaRouter plays this role across 200+ models.

What is adaptive routing?

Adaptive routing learns the quality/cost trade-off from your own traffic. Point each workspace at cheapest-that-clears-the-bar, highest quality, or balanced — or let orcarouter/auto keep tuning the choice per request.

Do I need both an AI gateway and an LLM router?

They solve different problems — governance vs model choice — but you don't need two systems: OrcaRouter routes per request and enforces budgets, guardrails and observability on the same hop.

Does routing add latency?

Prompt grading takes under 1 ms and total added latency stays under 50 ms — usually won back many times over by faster providers and cached prompt tokens.

Does OrcaRouter mark up token prices?

No. You pay each provider's published rate; OrcaRouter adds $0 per token and monetizes optional Team and Enterprise features.

Can I keep my existing OpenAI SDK code?

Yes — switch base_url to https://api.orcarouter.ai/v1 and your OpenAI, Anthropic or Google SDK code keeps working: Chat Completions, Responses, Embeddings, Images, Audio and streaming.

What happens when a provider goes down?

OrcaRouter retries against healthy fallback capacity for the same or an equivalent model before the response starts, so upstream outages don't surface to your users.

Smarter, safer, cost-efficient.

Swap one line. That's the migration.

Sign up with GitHub — no credit card required. You're live in under a minute.

© 2026 OrcaRouter

For Providers

Run an inference platform? Get your models on OrcaRouter.

Contact us

Join our community

DiscordEmailXGitHubYouTube