Kaeso

What It Does

Kaeso is an open-source AI gateway that sits between your applications and AI providers like OpenAI, Anthropic, and others. It provides centralized management, security, and observability for all your AI API requests through a single self-hosted infrastructure.

Who It's For & Problems It Solves

Designed for engineering teams and organizations that need enterprise-grade control over their AI infrastructure without vendor lock-in. Kaeso solves the challenges of managing multiple AI providers, controlling costs, securing API keys, and maintaining visibility into AI usage across teams and applications.

Key Features & Capabilities

• Single Sign-On & Security: Built-in SSO support with OpenID Connect, email domain verification, and 2FA requirements — all in the MIT-licensed code with no enterprise edition upsell • Provider Key Management: Encrypt and store provider keys (OpenAI, Anthropic, etc.) with AES-256-GCM; apps only see their Kaeso keys, never the underlying provider credentials • Format Translation: Use any SDK with any model — call Claude with the OpenAI SDK or GPT with the Anthropic SDK through automatic request translation via Kaeso's canonical format (KPP) • Comprehensive Limits & Budgets: Set spend budgets (daily/monthly/total), token budgets, and rate limits per project, member, or key with hard enforcement • Request Logging & Analytics: Track every request with status, tokens, cost, timing, and optionally content; filter, inspect, and export as CSV or JSON Lines • High-Performance Rust Gateway: Compiled binary with no interpreter overhead, pooled connections, HTTP/2 support

Typical Workflows

Teams install Kaeso via Docker Compose on their own servers, connect their identity provider for SSO, add provider API keys, and create projects. Developers update their apps' base URLs to point to the Kaeso gateway while keeping their existing OpenAI/Anthropic SDKs unchanged. The console provides real-time dashboards showing requests, token usage, costs, and errors across all projects and models.

Integrations & Compatibility

Kaeso supports the official OpenAI and Anthropic SDKs, Claude Code, Codex, and raw REST API calls. It translates between OpenAI Chat Completions, OpenAI Responses, and Anthropic Messages formats automatically. Built-in support for providers including OpenAI, Anthropic, and Cerebras. Runs on Docker Compose with PostgreSQL, Valkey, ClickHouse, and Caddy for TLS.

What Differentiates It

Unlike hosted AI gateway services, Kaeso is fully self-hosted and open-source (MIT license) with no feature limitations or enterprise upsells. The Rust-based architecture delivers production-grade performance with minimal overhead. Provider keys stay encrypted within your infrastructure and never reach application code, providing security-conscious teams complete control over their AI infrastructure.