You are browsing unreleased documentation.
Changelog
Kong Gateway 3.8.x
- Introduced the AI Proxy Advanced plugin, which mediates request and response formats, as well as authentication between users and multiple AI providers. This plugin supports load balancing, semantic routing, and multi-provider transformations and provides enhanced request mediation, usage tracking, and self-hosted model support over the regular AI Proxy plugin
Previous
Set up AI Proxy with OpenAI