ROUTEDESK

LLM gateways, observability and what they really cost, with the source and author of every number

LLM gateways (11)

Gateways sit between your app and model providers. The money is in four layers: token markup, funding fees, logs and seats. Click a name for the layers.

ProductLicenceSelf-hostEntryFree tierMain source
OpenRoutercommercial (hosted)no5.5% fee on credits25+ free models; 50 requests a day on free models (Flatkey)OFFICIAL
Vercel AI Gatewaycommercial (hosted)nofree tier / open source$5 a month credit, subset of modelsOFFICIAL
Cloudflare AI Gatewaycommercial (hosted)no5% fee on creditsCore features free (analytics, caching, rate limiting)OFFICIAL
PortkeyMIT gateway; hosted platform commercialyes (MIT gateway)from $49/moDeveloper: 10k recorded logs a monthOFFICIAL
Heliconeopen source (self-host)yesfrom $79/moHobby: 10,000 requests, 1 GB, 7-day retentionOFFICIAL
LiteLLMMIT core; enterprise directory under a commercial licenceyesfree tier / open sourceOpen sourceOFFICIAL
Kong AI Gateway (Konnect)Apache 2.0 (open-source plugins); Konnect commercialyes (Apache 2.0)from $25/mo + usage—OFFICIAL
Bifrost (Maxim)Apache 2.0yes (Apache 2.0)free tier / open sourceOpen source; Enterprise 14-day trialOFFICIAL
Flatkeycommercial (hosted)nofree tier / open sourcen/aOFFICIAL
TrueFoundry AI Gatewaycommercialnofrom $25 per seat/moDeveloper: free for up to 3 users, 10K requests and tool calls per user a monthOFFICIAL
Continuumcommercial (free app)nofree tier / open sourceFree app; BYOK freeOFFICIAL