Smart Routing
Automatic failover, load balancing, and usage-based routing across every model in the catalog.
- Zero-config failover
- Weighted load balancing
- Model aliases
$pip install nemoroutersdkRoutes today + on the roadmap
Architecture
Every request flows through Nemo before it reaches a provider. That is what makes routing, guardrails, and cost control possible — not an SDK wrapper, an actual gateway your traffic passes through.
OpenAI SDK · agents · RAG pipelines
We hold the provider keys. You hold one NemoRouter key and a credit balance. 18 models are live today on Google Vertex AI. Anthropic, OpenAI, and AWS Bedrock are shipping next.
18 models live today (20+ shipping soon) from Google (Gemini, Imagen, Veo) — Anthropic, OpenAI, and AWS Bedrock shipping next. Transparent per-token pricing, instant access, no provider keys to manage.
Nemo Router provides nine essential modules for enterprise LLM operations — including smart routing, AI guardrails, real-time cost tracking, and precise budget controls. Every feature is available on every plan with 0% platform fee and zero infrastructure to manage.
Automatic failover, load balancing, and usage-based routing across every model in the catalog.
Use one module, or all nine. Each is independently adoptable, but built to compose.
Nemo Router is the managed LLM gateway for multi-model AI. It provides all enterprise features—such as Guardrails and Cost Tracking—natively on every tier with a 0% platform fee, eliminating the gateway-stitching and plugin-licensing overhead of API-gateway alternatives.
| Feature | Nemo Router0% platform fee | OpenRouter | Kong AI Gateway | Portkey | Helicone |
|---|---|---|---|---|---|
| Pricing Model | Credits — 0–4% platform fee | 5–15% markup | Enterprise license | Tiered SaaS | Tiered SaaS |
| Managed Infrastructure | Included | Included | Self-host or Konnect SaaS | Included | Included |
| All Features Unlocked | Every tier | Limited | Enterprise tier only | Paid tier only | Paid tier only |
| Team & Org Management | Included | — | Workspaces (paid) | Paid tier only | Paid tier only |
| Guardrails & Safety | Built-in | — | AI plugins (basic) | Paid tier only | — |
| Budget Controls | Per key / team / org | Basic | Rate limit only | Paid tier only | Basic |
| Audit Logging | Included | — | Enterprise only | Paid tier only | — |
| OpenAI-Compatible API | Yes | Yes | Via plugin | Yes | Yes |
| Setup Time | Sign up & call | Sign up & call | Provision gateway & plugins | Sign up & call | Sign up & call |
Last updated May 2026.All Nemo Router features are unlocked on every tier — you only choose how low your platform fee goes.
Built on
Fully managed cloud, Postgres, and CDN — plus billing, email, error monitoring, and CI/CD. See the full posture on the security page.
Read the security architecture →Start building today
4% pay-as-you-go, 2% on Tier 2 monthly, 0% on Tier 3 annual. All enterprise features included on every tier.
No credit card required · OpenAI-compatible API
AI Models
from leading providers
Providers
Google Vertex AI
Platform Fee
on Tier 3 annual plans
Uptime SLA
enterprise-grade reliability