AI Gateway
An AI Gateway is a single entry point that sits between your applications and the AI models they call. Every request passes through it, so it can check who is calling, apply rate limits and budgets, and send the request to the right model or provider. It also records usage (for example, tokens spent per team), which makes cost and errors easy to trace.

See also API Gateway, Istio, Kubernetes ClusterIP, Kubernetes Endpoints, Kubernetes Gateway API, Kubernetes Headless Service.