ROUTEDESK

LLM gateways, observability and what they really cost, with the source and author of every number

Lead · where the sources disagree

2 places where the sources disagree on price or availability

Helicone: Prefactor (2026-10) says new cloud sign-ups have been disabled since March 2026, after the Mintlify acquisition. All 2 →

Routing bill breakdown

10 priced. Lowest: Vercel AI Gateway at $0. 1 not modelled.

token markupfunding feelogs and platformseats

Click a bar for every number, its source URL, date and author. Assumptions: list-price token spend is the same everywhere; one request equals one log, trace, span or unit (real products often emit several per request); monthly billing; no tax. What the layers mean.

NOTICE

Who wrote this?

We sell no gateway, proxy or model. Three of the articles we read were written by gateway vendors, so every number is tagged:

OFFICIAL VENDOR-WRITTEN OUR CHECK

The rules →

GATEWAY

OpenRouter

5.5% fee on credits

OFFICIAL checked 2026-11-10

GATEWAY

Vercel AI Gateway

free tier / open source

OFFICIAL checked 2026-11-10

GATEWAY

Cloudflare AI Gateway

5% fee on credits

OFFICIAL checked 2026-11-10

The register

GATEWAY

OpenRouter

Funding: 5.5% Standard, 8% Business on credit purchases

Free: 25+ free models; 50 requests a day on free models (Flatkey)

OFFICIAL 2026-11-10 · commercial (hosted)

GATEWAY

Vercel AI Gateway

Funding: None

Free: $5 a month credit, subset of models

OFFICIAL 2026-11-10 · commercial (hosted)

GATEWAY

Cloudflare AI Gateway

Funding: 5% on Unified Billing credits ($100 credit costs $105)

Free: Core features free (analytics, caching, rate limiting)

OFFICIAL 2026-11-10 · commercial (hosted)

GATEWAY

Portkey

Funding: None

Free: Developer: 10k recorded logs a month

OFFICIAL 2026-11-10 · MIT gateway

GATEWAY

Helicone

Funding: None

Free: Hobby: 10,000 requests, 1 GB, 7-day retention

OFFICIAL 2026-11-10 · open source (self-host)

GATEWAY

LiteLLM

Funding: None

Free: Open source

OFFICIAL 2026-11-10 · MIT core

GATEWAY

Kong AI Gateway (Konnect)

Funding: None

OFFICIAL 2026-11-10 · Apache 2.0 (open-source plugins)

GATEWAY

Bifrost (Maxim)

Funding: None

Free: Open source; Enterprise 14-day trial

OFFICIAL 2026-11-10 · Apache 2.0

GATEWAY

Flatkey

Funding: None

Free: n/a

OFFICIAL 2026-11-10 · commercial (hosted)

GATEWAY

TrueFoundry AI Gateway

Funding: None

Free: Developer: free for up to 3 users, 10K requests and tool calls per user a month

OFFICIAL 2026-11-10 · commercial

GATEWAY

Continuum

Funding: None

Free: Free app; BYOK free

OFFICIAL 2026-11-10 · commercial (free app)

Fees definedOpenRouter alternativesBest LLM gatewayLLM observabilityOpenRouter vs Portkey