Kafka Upstream

Added support for sending messages with dynamic keys to determine partitions.

Added support for sending messages to multiple topics with topics_query_arg, and enabled topic allowlisting with allowed_topics.

Added support for message manipulation with the new configuration field message_by_lua_functions.

Fixed an issue where the plugin could lose connection to a broker when the broker leadership changed.

Added support for the SCRAM-SHA-512 authentication mechanism.

Fixed the Bad Gateway error that would occur when using the Kafka Upstream plugin with the configuration producer_async=false.

Added support for the SCRAM-SHA-512 authentication mechanism.

Added the ability to identify a Kafka cluster using the cluster_name configuration parameter. By default, this field generates a random string. You can also set your own custom cluster identifier.

Beta feature: The authentication.user and authentication.password configuration fields are now marked as referenceable, which means they can be securely stored assecretsin a vault. References must follow a specific format.