Skip to content
|
Plugin Hub
github-edit-pageEdit this page
report-issueReport an issue
header icon

AI Semantic Prompt Guard

By Kong Inc.
You are browsing documentation for an outdated plugin version.

Looking for the plugin's configuration parameters? You can find them in the AI Semantic Prompt Guard configuration reference doc.

The AI Semantic Prompt Guard plugin enhances the AI Prompt Guard plugin by allowing you to permit or block prompts based on a list of similar prompts, helping to prevent misuse of llm/v1/chat or llm/v1/completions requests.

You can use a combination of allow and deny rules to maintain integrity and compliance when serving an LLM service using Kong Gateway.

How it works

The plugin matches lists of prompts to requests through AI Proxy.

The matching behavior is as follows:

  • If any deny prompts are set, and the request matches prompt in the deny list, the caller receives a 400 response.
  • If any allow prompts are set, but the request matches none of the allowed prompts, the caller also receives a 400 response.
  • If any allow prompts are set, and the request matches one of the allow prompts, the request passes through to the LLM.
  • If there are both deny and allow prompts set, the deny condition takes precedence over allow. Any request that matches a prompt in the deny list will return a 400 response, even if it also matches a prompt in the allow list. If the request does not match a prompt in the deny list, then it must match a prompt in the allow list to be passed through to the LLM

Get started with the AI Prompt Guard plugin

All AI Gateway plugins