How information is collected
Sources, terminology, and provider capabilities are documented so readers can see how each reference was assembled.
Read the methodology →The reference for model routing
Technical guides, provider reviews, and practical research for people designing, evaluating, and operating multi-model AI systems.
/
Explore by topic
01
Routing strategies
02
Architecture
03
Evaluation
04
Operations
Start here
Recently updated guides
GuideTopicUpdated
Security and privacy considerations for model routersHow to evaluate the intermediary handling prompts, responses, tool calls, credentials, and routing metadata between an application and model providers.SecurityOperating model routers in productionA practical operating model for routing telemetry, request budgets, retries, failover, alerting, and incident response.OperationsThe Complete Guide to Routing StrategiesA practical map of model-selection and delivery strategies, the company objectives each one serves, and the tradeoffs to measure before rollout.StrategyWhat is the OpenAI Flex Program?How lower-priority inference cuts token costs, where it differs from Batch, and how to use Flex as a model-routing decision.OptimizationWhat is model routing? How to introduce a centralized control plane for routing and monitoring prompt trafficFoundationsHow Pareto routing worksNew routing strategies emerge that seek a balance around quality, cost, and latency.AlgorithmsProvider directory
Profiles of model routers and AI gateways
ProviderTypeDeploymentOpen sourceLast verified
LiteLLMOpen-source gatewaySelf-hosted and managedYesPortkeyAI gatewayManaged, VPC, private cloud, hybrid, regional, and self-hostedGateway components availableOpenRouterModel routerManaged serviceNoMerge GatewayAI gatewayManaged and embeddedNoTrustedRouterOpen-source gatewayManaged and self-hostedYesOur Personal Perspective
Reviews and guides reflect our personal observations and opinions based on the information available at the time of publication. Your workload, constraints, and priorities may lead to a different conclusion.
How to use this research →