The only gateway for your entire AI strategy
Secure, connect, and observe your entire AI ecosystem, from LLMs to agents, through a single point of control: agentgateway.
.avif)
Invested in open source
We are deeply committed to the open-source community, creating and leading foundational projects that define the future of AI and cloud-native connectivity.
“We are excited to welcome the agentgateway project to the Linux Foundation, ensuring that best practices for agentic workflows remain free and open to all. Agentgateway complements emerging specifications like A2A and MCP, and offers scalable, specification-aligned infrastructure for agent communication thereby empowering customers and developers to build robust agentic workflows across platforms.”
“I'm excited to see Solo.io donate the agentgateway project to the Linux Foundation. Open sourcing an AI-native connectivity solution that understands MCP and A2A is a big win for the community. It helps us scale AI responsibly, with the security, flexibility, and governance we need in the real world.”
"The future won’t be built by standalone agents, MCP servers or LLMs — it’s shaped by their interconnection and ability to work together seamlessly. To unlock their full potential, we must apply policies, ensure control and maintain clear visibility into their interactions.
This is where agentgateway plays a pivotal role — bridging not only agent-to-agent (A2A) communication but also agent-to-MCP servers, filling a critical gap in the ecosystem. I look forward to seeing the project’s continued momentum within the Linux Foundation.”
“AI agents are rapidly transforming how enterprises work and innovate. To adopt them responsibly at scale, organizations need open and interoperable gateways that provide governance, visibility, and security.
Agentgateway delivers the foundation enterprises need. I’m excited to see the community come together to accelerate the open foundation our customers need to scale AI on cloud platforms like CoreWeave.”
“Building reliable AI agents is a challenge, especially when every step involves non-deterministic calls to LLMs, tools, and autonomous agents. Agentgateway’s integration with OpenTelemetry provides a robust foundation for observability, allowing us to treat each request-response pair as an evaluable unit. This capability is crucial for ensuring system-level accuracy and trustworthiness, paving the way for a true ‘AI mesh' that empowers teams to scale, secure and optimize their AI workflows.”
"Agentic AI demands purpose-built infrastructure, not just another software layer. This requires rethinking compute, storage, and data movement from the ground up, so retrofitting legacy systems doesn't work.
The agentgateway project is a solid step toward that future. We're happy to see it hosted by the Linux Foundation, where open source and community can drive the adoption and longevity that AI infrastructure requires."
“The rapid evolution of the AI landscape demands robust, vendor-neutral infrastructure for how agents communicate with each other and with external tools. Without it, we risk stifling innovation and adoption.
The agentgateway project, hosted by the Linux Foundation, is a crucial step in creating that common ground. We are excited to partner with Solo.io and support a community-driven foundation for the future of interoperable AI."
“One of the biggest open security problems today is how to do MCP security effectively. While there are a lot of problems in this space that the community doesn't know how to address, the agentgateway project provides a first step toward addressing some of the important issues with basic role-based access control and visibility of actions to MCP servers.
I look forward to seeing how this project adapts and evolves to handle the complex, evolving threats in this space under open source governance.”
Your infrastructure will crumble under AI workloads
Built from the ground up to meet the unique requirements of AI and agentic protocols, agentgateway supports the evolving protocols that legacy gateways can't, giving you a future-proof foundation for agentic connectivity.
Engineered for AI connectivity
AI Gateway
LLM provider keys are high-value targets - sharing them across teams increases the blast radius from compromise and creates unnecessary risk. Solo.io's enterprise version of agentgateway secures keys in centralized storage, integrates with enterprise IAM, and supports multiple auth protocols (API Key, JWT, OAuth/OIDC) to secure access and implement fine-grained authorization.
Without guardrails, LLMs can be manipulated into harmful or unsafe behavior. Our enterprise offering for agentgateway enforces inline protections on prompts and responses, integrates with provider moderation endpoints, and allows custom semantic guardrails via extensions.
Treating LLMs as just another API call limits your ability to monitor critical context-specific telemetry on LLM performance, activity, and cost reporting. Our enterprise dsitribution of agentgateway provides real-time logging, detailed consumption metrics, and end-to-end tracing with OpenTelemetry, enabling precise visibility into model behavior and cost.
LLM workloads can spiral quickly, leading to unexpected costs or LLM provider throttling, potentially leading to intermittent outages and availability issues. The enterprise version of agentgateway applies request and token-based rate limits to apply backpressure on clients to prevent hitting provider rate limits or overrun budget allocations — ensuring predictable, sustainable consumption.
Changing your model or provider should not require expensive and time consuming changes to application logic. Our enterprise dsitribution of agentgateway standardizes LLM access with a uniform API, allowing for seamless transition between models and providers to optimize for performance, availability, and pricing.
Inference Gateway
Existing gateway solutions lack context awareness for routing requests to specific models. Solo.io's enterprise version of agentgateway delivers context-aware model routing that understands request metadata and dynamically directs traffic to the right model, including fine-tuned model instances.
Fine-tuned models amplify business value, but they often break traditional routing patterns. Solo Enterprise for agenteway supports intelligent routing to fine-tuned models, ensuring that specific users and use cases are routed to the optimal model to satisfy their request.
Accelerated infrastructure is expensive and can be underutilized when routing with traditional ingress gateways. The enterprise version of agentgateway allows you to route to defined inference pools that map to underlying infrastructure. Integration with llm-d allows for smart routing across prefill and decode stages — isolating compute and memory-bound operations to extract maximum efficiency from GPUs.
Long response times and token delays frustrate users and waste resources. Our enterprise distribution of agentgateway uses real-time inference metrics to route requests to models with available capacity, reducing latency and time-to-first-token while improving overall responsiveness.
When model capacity is maxed out, standard ingress treats all requests equally — putting critical LLM integrations at risk. Our enterprise version of agentgateway supports priority scheduling, enabling organizations to set policies by use case and model so mission-critical requests are always served first.
Agent Gateway
The landscape of MCP tool server security is mixed at best, creating an environment ripe for exploit and attack when integrating with community tool servers. Our enterprise version of agentgateway mitigates these risks by sandboxing tool servers, enforcing strong authentication, authorization, and policy, and integrating with enterprise IAM.
With tens of thousands of community MCP tool servers available, coming to terms with which tools you have available can be an integration nightmare. The enterprise offering for agentgateway federates all tool servers into a central tools registry that appears as a single, virtualized MCP tool server to clients.
When presented with too many tools, the quality of agent performance degrades substantially. Following a principle of least privilege, agents and MCP clients should only see the tools they need to perform their job . Our enterprise version of agentgateway selectively exposes tools based on policy, dynamically adjusting discovery and access so agents only see the tools they’re authorized to use. This minimizes confusion while isolating tool servers for security and stability.
Debugging agent-to-agent or agent-to-tool behavior in a world of tool sprawl is time consuming and error prone. Our enterprise distribution of agentgateway centralizes telemetry collection and reporting to deliver deep metrics, logging, and tracing for every interaction - eliminating the need to dig into individual tool server implementations for answers.
Most enterprises already have valuable APIs, but custom development is costly to integrate them into MCP. The enterprise version of agentgateway automatically imports and exposes REST APIs as tools using their OpenAPI definition, giving agents secure, observable, and governed access instantly without additional coding.
Powering the future of connectivity at
Organizations doing cloud connectivity right with Solo.io
Future-proof your AI gateway
