Skip to content
Kong Logo | Kong Docs Logo
search
  • We're Hiring!
  • Docs
    • Kong Gateway
    • Kong Konnect
    • Kong Mesh
    • Plugin Hub
    • decK
    • Kubernetes Ingress Controller
    • Insomnia
    • Kuma

    • Docs contribution guidelines
  • Plugin Hub
  • Support
  • Community
  • Kong Academy
Get a Demo Start Free Trial
  • Kong Gateway
  • Kong Konnect
  • Kong Mesh
  • Plugin Hub
  • decK
  • Kubernetes Ingress Controller
  • Insomnia
  • Kuma

  • Docs contribution guidelines
  • 3.2.x (latest)
  • 3.1.x
  • 3.0.x
  • 2.8.x
  • 2.7.x
  • 2.6.x
  • Older Enterprise versions (2.1-2.5)
  • Older OSS versions (2.1-2.5)
  • Archive (pre-2.1)
    • Overview of Kong Gateway
      • Version Support Policy
      • Supported Installation Options
      • Supported Linux Distributions
    • Stability
    • Release Notes
      • Services
        • Overview
        • Configure Routes with Expressions
      • Upstreams
      • Plugins
      • Routing Traffic
      • Load Balancing
      • Health Checks and Circuit Breakers
      • Kong Performance Testing
    • Glossary
    • Get Kong
    • Services and Routes
    • Rate Limiting
    • Proxy Caching
    • Key Authentication
    • Load-Balancing
      • Overview
        • Overview
        • Deploy Kong Gateway in Hybrid mode
      • DB-less Deployment
      • Traditional
      • Overview
        • Helm
        • OpenShift with Helm
        • kubectl apply
        • Kubernetes Deployment Options
        • Using docker run
        • Build your own Docker images
        • Amazon Linux
        • Debian
        • Red Hat
        • Ubuntu
      • Running Kong as a non-root user
      • Securing the Admin API
      • Using systemd
      • Start Kong Gateway Securely
      • Programatically Creating Admins
      • Enabling RBAC
      • Overview
      • Download your License
      • Deploy Enterprise License
      • Using the License API
      • Monitor Licenses Usage
      • Default Ports
      • DNS Considerations
      • Network and Firewall
      • CP/DP Communication through a Forward Proxy
    • Kong Configuration File
    • Environment Variables
    • Serving a Website and APIs from Kong
      • Overview
      • Prometheus
      • StatsD
      • Datadog
      • Overview
      • Writing a Custom Trace Exporter
      • Tracing API Reference
    • Resource Sizing Guidelines
    • Security Update Process
    • Blue-Green Deployments
    • Canary Deployments
    • Clustering Reference
      • Log Reference
      • Dynamic log level updates
      • Customize Gateway Logs
      • Upgrade Kong Gateway 3.1.x
      • Migrate from OSS to Enterprise
    • Overview
      • Overview
      • Metrics
      • Analytics with InfluxDB
      • Analytics with Prometheus
      • Estimate Analytics Storage in PostgreSQL
      • Overview
      • Getting Started
      • Advanced Usage
        • Overview
        • Environment Variables
        • AWS Secrets Manager
        • Google Secrets Manager
        • Hashicorp Vault
        • Securing the Database with AWS Secrets Manager
      • Reference Format
      • Overview
      • Get Started with Dynamic Plugin Ordering
      • Overview
      • Enable the Dev Portal
      • Publish an OpenAPI Spec
      • Structure and File Types
      • Themes Files
      • Working with Templates
      • Using the Editor
        • Basic Auth
        • Key Auth
        • OIDC
        • Sessions
        • Adding Custom Registration Fields
        • Manage Developers
        • Developer Roles and Content Permissions
        • Authorization Provider Strategy
        • Enable Application Registration
        • Enable Key Authentication for Application Registration
          • External OAuth2 Support
          • Set up Okta and Kong for External Oauth
          • Set up Azure AD and Kong for External Authentication
        • Manage Applications
        • Theme Editing
        • Migrating Templates Between Workspaces
        • Markdown Rendering Module
        • Customizing Portal Emails
        • Adding and Using JavaScript Assets
        • Single Page App in Dev Portal
        • Alternate OpenAPI Renderer
      • SMTP
      • Workspaces
      • Helpers CLI
      • Portal API Documentation
    • Audit Logging
    • Keyring and Data Encryption
    • Workspaces
    • Consumer Groups
    • Event Hooks
    • FIPS 140-2
    • Overview
    • Enable Kong Manager
      • Services and Routes
      • Rate Limiting
      • Proxy Caching
      • Authentication with Consumers
      • Load Balancing
      • Overview
      • Create a Super Admin
      • Workspaces and Teams
      • Reset Passwords and RBAC Tokens
      • Basic Auth
        • Configure LDAP
        • LDAP Service Directory Mapping
        • Configure OIDC
        • OIDC Authenticated Group Mapping
      • Sessions
        • Overview
        • Enable RBAC
        • Add a Role and Permissions
        • Create a User
        • Create an Admin
    • Networking Configuration
    • Workspaces
    • Create Consumer Groups
    • Sending Email
    • Overview
    • File Structure
    • Implementing Custom Logic
    • Plugin Configuration
    • Accessing the Data Store
    • Storing Custom Entities
    • Caching Custom Entities
    • Extending the Admin API
    • Writing Tests
    • (un)Installing your Plugin
      • Overview
      • kong.client
      • kong.client.tls
      • kong.cluster
      • kong.ctx
      • kong.ip
      • kong.jwe
      • kong.log
      • kong.nginx
      • kong.node
      • kong.request
      • kong.response
      • kong.router
      • kong.service
      • kong.service.request
      • kong.service.response
      • kong.table
      • kong.tracing
      • kong.vault
      • kong.websocket.client
      • kong.websocket.upstream
      • Go
      • Javascript
      • Python
      • Running Plugins in Containers
      • External Plugin Performance
    • Overview
        • Overview
        • OpenID Connect with Curity
        • OpenID Connect with Azure AD
        • OpenID Connect with Google
        • OpenID Connect with Okta
        • OpenID Connect with Auth0
        • OpenID Connect with Cognito
      • Authentication Reference
      • Allow Multiple Authentication Plugins
    • Rate Limiting Plugin
      • Add a Body Value
    • GraphQL
      • gRPC Plugins
      • Configure a gRPC service
    • Overview
    • Information Routes
    • Health Routes
    • Tags
    • Debug Routes
    • Services
    • Routes
    • Consumers
    • Plugins
    • Certificates
    • CA Certificates
    • SNIs
    • Upstreams
    • Targets
    • Vaults
    • Keys
    • Licenses
    • Workspaces
    • RBAC
    • Admins
    • Developers
    • Consumer Groups
    • Event Hooks
    • Keyring and Data Encryption
    • Audit Logs
    • kong.conf
    • Injecting Nginx Directives
    • CLI
    • File Permissions Reference
    • Key Management
    • Performance Testing Framework
    • Router Expressions Language
    • FAQ

github-edit-pageEdit this page

report-issueReport an issue

enterprise-switcher-iconSwitch to OSS

On this page
  • Migrating to 2.1.x and up
  • Feature availability
  • Plugin compatibility
  • Manual configuration
Kong Gateway
3.1.x
  • Home
  • Kong Gateway
  • Install
  • Kubernetes
  • Kubernetes Deployment Options
You are browsing documentation for an outdated version. See the latest documentation here.

Kubernetes Deployment Options

The Kubernetes Ingress Controller translates Kubernetes resources into Kong Gateway configuration. Kong Gateway uses that configuration to route and control traffic.

The kong-gateway proxy image supports DB-less operation and is recommended for all deployments.

  • DB-less installation with the Kong Ingress Controller
  • Database-backed installation with or without the Kong Ingress Controller

Migrating to 2.1.x and up

Existing users of the kong-enterprise-k8s image who want to use 2.1.x or later should switch to the kong-gateway image.

If you encounter issues after switching images, please contact Enterprise Support.

DB-less versus database-backed deployments

When using Kong Gateway with Kubernetes Ingress Controller, the source of truth for Kong’s configuration is the Kubernetes configuration in etcd: Kong’s custom Kubernetes resources, ingresses, and services provide the information necessary for the ingress controller to configure Kong. This differs from Kong deployments that do not use an ingress controller, where configuration in the database or DB-less config file is the source of truth.

In traditional deployments, Kong’s database provides a persistent store of configuration available to all Kong nodes to ensure consistent proxy behavior across the cluster that is not affected by node restarts. Because etcd provides this functionality in Kong for Kubernetes deployments, it is not necessary to run an additional database, reducing maintenance and infrastructure requirements.

While running Kong Gateway with Kubernetes Ingress Controller does not require a database, it is fully compatible with PostgreSQL and requires it for some features. etcd still remains the source of truth in database-backed deployments: the controller translates Kubernetes resources from etcd into Kong configuration and inserts them into the database via the Admin API.

Choosing between DB-less or database-backed deployments

In general, DB-less deployments are simpler to maintain and require less resources to run. These deployments must set KONG_DATABASE=off in their environment variables.

Database-backed deployments offer a wider range of features. Review the sections below to determine if your use case requires a feature that is not available in DB-less deployments.

Feature availability

Some Enterprise features are not available in DB-less deployments. Use a database-backed deployment if you want to use:

  • Dev Portal
  • Teams (RBAC)
  • Workspaces

The following features have support in DB-less mode, but work differently than in DB-backed modes:

  • Kong Manager (read-only)
  • Vitals (using Prometheus or InfluxDB strategies)

When Kong Gateway is configured by the ingress controller, some functionality in these features is different from traditional deployments:

  • Instead of using Kong Manager, proxy configuration is managed by the controller, and you provide configuration via Kubernetes resources.
  • Because the controller creates proxy configuration on behalf of users, you do not need to interact with the Admin API directly. Kong’s own RBAC implementation isn’t required for typical Kong for Kubernetes deployments, as they do not expose the Admin API; only the controller can access it. Kubernetes-level RBAC rules and namespaces should be used to restrict what configuration administrators can create.
  • Ingress controller instances create configuration in a single workspace only (default by default). To use multiple workspaces, deploy multiple controller instances, setting the CONTROLLER_KONG_WORKSPACE environment variable to the workspace that instance should use. These instances should set CONTROLLER_INGRESS_CLASS to unique values for each instance to avoid creating duplicate configuration in workspaces. Note that if controller instances are deployed outside the Kong pod the Admin API must be exposed, and users should enable RBAC with workspace admin users for the controllers. Set CONTROLLER_KONG_ADMIN_TOKEN to the RBAC user’s token.
  • The controller cannot manage configuration for features that require a database: it cannot create workspaces, Dev Portal content, admins, etc. These features must be configured manually through the Admin API or Kong Manager.

Plugin compatibility

Not all plugins are compatible with DB-less operation. Review the list of supported plugins to see if you require a plugin that needs a database.

Third-party plugins are generally compatible with DB-less as long as they do not create custom entities (i.e. they do not add new entities that users can create and modify through the Admin API).

Manual configuration

DB-less configuration must be supplied as a complete unit: it is not possible to add or modify entities individually through the Admin API, or provide partial configuration that is added to existing configuration. As such, all configuration must be sourced from Kubernetes resources so that the ingress controller can render it into a complete configuration.

On database-backed deployments, users can create or modify configuration through the Admin API. The ingress controller uses a tag (set by the CONTROLLER_KONG_ADMIN_FILTER_TAG environment variable) to identify configuration that it manages. While the controller will revert changes to configuration with its tag, other configuration is left as-is.

Although database-backed deployments can use controller-generated and manually-added configuration simultaneously, Kong’s recommended best practice is to manage as much configuration through Kubernetes resources as possible. Using both controller-managed and manual configuration can result in conflicts between the two, and conflicts will prevent the controller from applying its configuration. To minimize this risk:

  • Use the admission webhook to reject Kubernetes resources that conflict with other configuration, or are otherwise invalid.
  • Manually create configuration in a workspace that is not managed by the controller. This avoids most conflicts, but not all: routes may still conflict depending on your route validation setting.

Large numbers of consumers (and associated credentials) are the exception to this rule: if your consumer count is in the tens of thousands, we recommend that you create them and their credentials through the Admin API to reduce etcd load.

Migrating between deployment types

Because etcd is the source of truth for Kong’s configuration, the ingress controller can re-create Kong’s proxy configuration even if the underlying datastore changes.

While most Kubernetes resources can be left unchanged when migrating between deployment types, users must remove any KongPlugin resources that use unavailable plugins when migrating from a database-backed deployment to a DB-less deployment. No changes to Kubernetes resources are required if migrating in the opposite direction.

Thank you for your feedback.
Was this page useful?
  • Kong
    THE CLOUD CONNECTIVITY COMPANY

    Kong powers reliable digital connections across APIs, hybrid and multi-cloud environments.

    • Company
    • Customers
    • Events
    • Investors
    • Careers Hiring!
    • Partners
    • Press
    • Contact
  • Products
    • Kong Konnect
    • Kong Gateway
    • Kong Mesh
    • Get Started
    • Pricing
  • Resources
    • eBooks
    • Webinars
    • Briefs
    • Blog
    • API Gateway
    • Microservices
  • Open Source
    • Install Kong Gateway
    • Kong Community
    • Kubernetes Ingress
    • Kuma
    • Insomnia
  • Solutions
    • Decentralize
    • Secure & Govern
    • Create a Dev Platform
    • API Gateway
    • Kubernetes
    • Service Mesh
Star
  • Terms•Privacy
© Kong Inc. 2023