AI RAG Injector

Blocked plugins to execute retry logic. Also improve testing functions

Fixed an issue where ‘tools’ and ‘RAG’ decoration did not work for Ollama (llama2) provider.

Fixed an issue where some of ai metrics was missed in analytics

If any AI Gateway plugin has been enabled in a self-managed Kong Gateway deployment for more than a week, upgrades from 3.10 versions to 3.11.0.0 will fail due to a license migration issue. This does not affect Konnect deployments.

A fix will be provided in 3.11.0.1.

See breaking changes in 3.11 for a temporary workaround.

Added a new plugin which allows automatically injecting documents to simplify building RAG pipelines.

Added the huggingface, azure, vertex, and bedrock providers to embeddings. They can be used by the ai-proxy-advanced, ai-semantic-cache, ai-semantic-prompt-guard, and ai-rag-injector plugins.

Allow authentication to Bedrock services with assume roles in AWS.

Fixed an issue where AI upstream URL trailing would be empty.