Skip to content
|
Plugin Hub
github-edit-pageEdit this page
report-issueReport an issue
header icon

AI Prompt Template

By Kong Inc.
Available in the Kong Konnect app
Available with Kong Gateway Enterprise subscription - Contact Sales
Free open-source plugin

Looking for the plugin's configuration parameters? You can find them in the AI Prompt Template configuration reference doc.

The AI Prompt Template plugin lets you provide tuned AI prompts to users. Users only need to fill in the blanks with variable placeholders in the following format: {{variable}}.

This lets admins set up templates, which can then be used by anyone in the organization. It also allows admins to present an LLM as an API in its own right - for example, a bot that can provide software class examples and/or suggestions.

This plugin also sanitizes string inputs to ensure that JSON control characters are escaped, preventing arbitrary prompt injection.

This plugin extends the functionality of the AI Proxy plugin, and requires AI Proxy to be configured first. Check out the AI Gateway quickstart to get an AI proxy up and running within minutes!

How it works

When calling a template, simply replace the messages (llm/v1/chat) or prompt (llm/v1/completions) with a template reference, in the following format: {template://TEMPLATE_NAME}

When activated the template restricts an LLM usage to just those pre-defined templates, which are called in the following example format:

{
  "prompt": "{template://sample-template}",
  "properties": {
    "thing": "gravity"
  }
}

Get started with the AI Prompt Template plugin

All AI Gateway plugins