Governed inference

AI Gateway

Route approved AI models and tools through one policy and usage boundary.

This capability is in development. This page describes the current product direction, not general availability.

The gateway foundation normalizes providers, streaming, models, and usage. The broader product direction adds versioned routing policy, private capacity, gateway-owned tools, budgets, and content-minimized evidence.

Provider connections

Keep provider credentials inside trusted broker boundaries and expose approved model capabilities.

Model catalog

Compare normalized capabilities, context limits, availability, and governed pricing metadata.

Usage attribution

Attribute metered model use to the customer organization and Product that caused it.

Policy routing

Develop stable model roles and governed routing across hosted and self-hosted capacity.