A Kubernetes-Native Alternative to LiteLLM
Run agentgateway as the Kubernetes-native, Rust-based data plane for LLM, MCP, and agent-to-agent traffic, with zero-trust security, audit logs, and the policy controls a compliance-ready agent platform needs, built on an open, self-hosted foundation you control.
Why Teams Choose agentgateway Over LiteLLM
Kubernetes-native architecture built for production agent traffic
“LiteLLM works great for routing LLM calls, but it's not built to run as part of our Kubernetes platform.”
agentgateway is a Kubernetes-native data plane written in Rust, deployed and managed the same way as the rest of your gateway infrastructure, instead of a separate Python service to operate and scale on its own.
“We need one policy layer for agent-to-agent, MCP, and LLM traffic, not a separate proxy for each.”
agentgateway secures LLM access, MCP tool calls, and A2A traffic behind the same zero-trust policies and audit logs as the rest of your API traffic, all from a single gateway layer.
“LiteLLM's proxy is a piece of our stack, but we still need enterprise support and compliance tooling around it.”
agentgateway is backed by Solo's enterprise support, hardened builds, and compliance tooling, so security and platform teams get one accountable vendor instead of stitching that layer together themselves.
Why Teams Choose Us
“We can’t tell whether our agents are calling approved tools or leaking data to the wrong LLM.”
agentgateway sits in front of every agent-to-agent and agent-to-tool call, so you can see, control, and audit LLM and RAG traffic instead of trusting it blindly.
“Every cloud vendor has their own AI gateway, and none of them work outside that one cloud.”
agentgateway is open source and self-hosted, so it runs anywhere Kubernetes does, not just inside one vendor’s walled garden.
“Security and finance won’t sign off on agentic AI without audit logs and cost controls.”
agentgateway gives you audit logs, cost controls, and zero-trust security by default, so compliance is built in rather than bolted on after the fact.
Trust & Compliance
SOC 2
Certification supports security and procurement review for regulated Kubernetes environments
OSS Roots
Build on Envoy, Istio, Cilium, and Gateway API foundations for open source, cloud native adoption.
CNCF Maintainer Status
keeps Solo.io engineers close to the projects shaping cloud native standards.
FIPS Builds
provide FIPS 140-2 validated options for regulated cloud native environments.
Published SLAs
Define support expectations for enterprise cloud native operations.
Customer References
include production outcomes from teams running large-scale Kubernetes networking.
Frequently Asked Questions
What is agentgateway?
What is agentgateway?
agentgateway is Solo's open source, AI-native gateway purpose-built to secure and govern traffic to LLMs, RAG pipelines, and MCP tools, along with agent-to-agent (A2A) communication.
Is agentgateway also an LLM gateway?
Is agentgateway also an LLM gateway?
Yes. agentgateway handles LLM traffic natively, including access control, cost visibility, and audit logging for calls to your LLM providers, alongside its support for MCP and A2A protocols.
Does agentgateway work as an MCP gateway?
Does agentgateway work as an MCP gateway?
Yes. agentgateway secures and observes MCP tool calls, so you know which agents are calling which tools and can enforce policy on that traffic the same way you would for any other API call.
How is agentgateway different from LiteLLM?
How is agentgateway different from LiteLLM?
LiteLLM is a Python SDK and proxy for routing calls across LLM providers, and it's a solid choice for lightweight LLM routing and cost tracking. agentgateway is a Kubernetes-native data plane written in Rust, built to sit alongside your other gateway infrastructure and secure LLM, MCP, and agent-to-agent traffic under one policy layer instead of a separate service to run and scale.
Do I need an enterprise contract to use an open source ai gateway like agentgateway?
Do I need an enterprise contract to use an open source ai gateway like agentgateway?
Most production deployments choose Solo's enterprise support for the SLAs, audit tooling, and production hardening a compliance-ready platform needs. The underlying project is open source and donated to a vendor-neutral foundation under the Linux Foundation, so it also remains free to run on your own if you'd rather self-support.
See How agentgateway Compares to LiteLLM
Request a demo to see how agentgateway secures LLM, RAG, MCP, and agent-to-agent traffic in your environment, or compare your options in the Buyer's Guide first.
