Skip to content

Every request gets the best-fit model

MixRoute Smart Routing reads every request in real time with our in-house AI model, judging complexity and task type, then assigns the best-fit model from the pool you authorize. Across tens of thousands of real-world runs, it saves an average of 20–40% on API costs.

10,000+ real-world runs Avg. savings 20–40% Free for a limited time Zero data retention
How do I return this?
Summarize this meeting
When do you close?
Refactor this module

Smart Routing

real-time triage

SIMPLE

gemini-3.5-flash

COMPLEX

claude-sonnet-5

ULTRA

gpt-5.6-sol

Routing decision, illustrated

You're paying flagship prices for questions that don't need one

  • Overkill by default

    Eight in ten support questions are as simple as "How do I return this?" Yet every single one is billed at flagship-model rates.

  • Set once, never touched

    Engineers pick one model per feature at launch, and nobody ever revisits the choice. Tasks keep changing. The model never does.

  • Updates you can't chase

    The model market shifts every month. Last month's best price-performance pick may already be beaten. No human keeps up.

The problem isn't the models. It's how they're assigned.

HOW IT WORKS

Three steps, fully automatic

1

Step 1

Call as usual

Zero code changes. Create a Smart Routing API key in the console, swap out your current key, and keep sending requests in the same format.

python swap one key
client = OpenAI(
  api_key="sk-your-current-key",
  api_key="sk-smart-routing-key",
  base_url="https://api.mixroute.ai/v1"
)
# request format unchanged
2

Step 2

Real-time triage

Our in-house routing model reads each request on the fly and judges its complexity and task type. It supports a 1M-token context window, so even the longest requests are fully assessed. Read-only, never stored: content is processed in memory and cleared the moment triage ends, fully in line with MixRoute's zero data retention policy.

What it reads Complexity × task type
Context window 1M tokens
Where it runs In-memory only
After triage Cleared instantly
Data retained Zero
3

Step 3

Best-fit assignment

From the pool you authorize, the router picks the model best suited to the request. Your full context passes through untouched: no rewriting, no compression, no truncation. The answer still comes from the real model.

gemini-3.5-flash standby
claude-sonnet-5 best fit
deepseek-v3.2 standby
gpt-5.6-sol standby

Full context passes through untouched. Answers come from the real model.

CONTROL

AI runs the routing. You set the boundaries.

Fully automatic black-box routers take the model decision out of your hands. MixRoute works the other way around: Smart Routing only ever operates inside boundaries you define.

Your model pool, your call

Give every key its own model pool in the console. Which model endpoints can be assigned is entirely up to you: only the ones you trust, that fit your compliance rules and your budget.

Limits you set

Set usage limits on every key; anything beyond them is blocked. No runaway requests, no runaway bills.

Savings you can see

A built-in savings dashboard shows exactly how much Smart Routing has saved you. Not our claim. Your numbers.

Model pool sk-…prod-router
  • claude-sonnet-5
  • gpt-5.6-sol
  • gpt-5-mini
  • gemini-3.5-flash
  • deepseek-v3.2
  • grok-4
Savings dashboard This month

Smart Routing has saved you

US$1,284

31.4% saved
Spent
Saved

Illustrative screens

MEASURED RESULTS

Results from 10,000+ real-world runs

We tested Smart Routing's assignment decisions across tens of thousands of real tasks: the average saving came out at 20–40% of API cost. The exact figure depends on the vendor mix in your model pool, which is why we quote a measured range instead of a marketing number.

See what you'd save

Monthly API spend
US$500 US$50,000

Estimated monthly savings

Estimated from the average range measured across 10,000+ runs. Actual savings vary with your model pool.

USE CASES

Where teams feel it most

  • Scenario 01

    High-volume support bots

    Masses of repetitive, simple questions are Smart Routing's biggest source of savings. Easy ones go to light models, hard ones auto-upgrade. Customers never notice. Your bill does.

    Biggest savings
  • Scenario 02

    Internal knowledge assistants

    Policy lookups, document search, meeting summaries: most requests don't need a flagship model, but the occasional deep dive does. The router tells them apart, so you don't have to.

    Depth, auto-detected
  • Scenario 03

    AI products with mixed workloads

    You can't predict what users will ask, and simple and complex arrive interleaved. Instead of betting everything on one model, give each request exactly the model it needs.

    Right-sized requests
  • Scenario 04

    Coding assistants

    Completions and small functions run fast and cheap on light models; cross-file refactors and gnarly debugging auto-upgrade to a flagship. Engineers write code. The router picks models.

    Auto gear-shift

PRICING

Try first. Decide later.

US$0

Free for a limited time

Activate now and Smart Routing costs nothing during the launch window. Validate the savings on your real traffic; the dashboard numbers will give you the answer.

5%

Then 5% per routed request

After the free period, we charge a 5% service fee only on requests that actually go through Smart Routing. Requests on regular keys are never charged.

THE ONE-LINE MATH

Pay 5%. Save an average of 20–40%.

You save far more than you pay. That's the entire reason this exists.

FAQ

Frequently asked questions

Yes. Triage adds one extra step, and the time varies with request length. It’s a trade: a little time for 20–40% off your costs. For latency-critical endpoints, use a regular key to call a specific model directly and skip the router.

It reads, it never stores. Request content is classified in memory in real time, cleared immediately afterward, and passed through to the target model untouched. Nothing is written to persistent storage, consistent with MixRoute’s zero data retention policy.

Your model pool is the insurance: the router only ever chooses among models you’ve authorized and never assigns anything outside the pool. If some traffic must always hit one specific model, create a separate regular key for it and call that model directly.

One word: control. Most auto-routers are a total black box where the platform decides everything. MixRoute’s Smart Routing runs inside a model pool you define, with zero data retention and a savings dashboard. You always know where the money is saved and where your data goes.

No. Create a Smart Routing API key in the console and swap it in for your current key. The API call format stays exactly the same.

Free for a limited time. Once the free period ends, only requests that go through Smart Routing are charged a 5% service fee on that request’s cost. It’s deducted from your credit balance, with a transparent, itemized bill.