Security & access control
Secure storage and management of LLM provider credentials with the ability to perform fine-grained authentication and authorization of client requests, using your existing identity provider and security infrastructure.
Your gateway to AI innovation
Secure, observe, and control your AI applications with Gloo AI Gateway, the leading cloud-native gateway built on Envoy.
Unleash developer productivity.
Accelerate AI innovation.
Fast track development
Eliminate development friction, boilerplate code, and avoidable errors in applications consuming LLM APIs across multiple providers and use cases.
Secure & control
Protect applications, models, and data from inappropriate access. Ensure safe use of AI with governance controls, auditability, and visibility into consumption.
Expand & scale
Leverage advanced AI integration patterns for data augmentation and integration with cloud-native gateway capabilities to support high-volume, zero-downtime AI connectivity.
Get started
Get started with Gloo AI Gateway
Start the lab
Prompt management & guardrails
Protect against LLM attacks, abuse, and data exfiltration using guardrails for prompt requests and responses. Leverage prompt augmentation and management to customize client interactions consistently and uniformly.
Consumption control & visibility
Get detailed insights into LLM consumption by client and application with real-time analytics. Prevent overconsumption and denial of service with token-weighted rate limiting of LLM requests.
Model performance
Improve response quality with Retrieval-Augmented Generation (RAG) support directly in the gateway to reduce the probability of hallucinations and secure access to context repositories. Dramatically reduce latency from upstream LLM calls with semantic caching of prompt responses.
Inside Gloo AI Gateway
Supercharge cloud-native AI applications with Gloo AI Gateway
Open-source leadership
Gloo AI Gateway is built on Envoy Proxy and Kubernetes Gateway API, the leading open-source network proxy and open standard API in the cloud-native ecosystem.
Cloud-native design
Cloud-native design scales to any environment with support for automation, configuration as code, and self-service with guardrails across private and public cloud environments.
Omni-directional security, control,& observability
Secure, connect, observe, and control APIs in any direction to support model consumption, inferencing, and training use cases.
AI self-service with guardrails
Developers integrating LLMs with their applications will require self-service and AI-enabled platforms. Gloo Gateway integrates with leading technologies like Backstage and Kubernetes Gateway API to provide modern platform engineering tools and solutions to deliver AI-enabled applications to production.
"We landed on Solo.io as a technology partner because Gloo Gateway is really good in terms of its operability, scalability and performance."
Cloud connectivity done right
