v4.71.0

For installation instructions check out the getting started guide.

Added

• Introduce a new redpanda tracing component that sends spans directly to a Redpanda Broker topic (@rockwotj)
• sql_select, sql_raw, sql_insert: Support databricks driver for all SQL components (@rohan-darji)
• postgres_cdc: Added support for IAM authenticated users (@josephwoodward)
• redpanda_migrator: Added max_in_flight config parameter (@mmatczuk)

Fixed

• redpanda_migrator: Exact migration of empty consumer groups (@mmatczuk)
• redpanda_migrator: Fix record reading in consumer group migraton for some multi-node setups (@mmatczuk)
• protobuf_processor: Fix decode Hyperpb fallback (@Jeffail)

The full change log can be found here.

v4.70.0

For installation instructions check out the getting started guide.

Added

• (PostgreSQL CDC) Support inlining SSL certificates in config (@alextreichler)
• (AMQP Output) Added support for additional fields (@timo102)

The full change log can be found here.

v4.69.0

For installation instructions check out the getting started guide.

Added

• (Benthos) New string.repeat(int) method to repeat a string or byte array N times. (@rockwotj)
• (Benthos) New bytes method to create a 0 initialized byte array. (@rockwotj)
• Added regexp_topics_include and regexp_topics_exclude fields to redpanda, redpanda_migrator, ockam inputs. (@mmatczuk)
• New ffi processor in CGO builds. (@rockwotj)
• Add tcp connection options to redpanda, redpanda_migrator inputs and outputs as well as all AWS components. (@mmatczuk, @alextreichler)

Deprecated

• The regexp_topics boolean field is now deprecated in favor of regexp_topics_include. (@mmatczuk)

Changed

• redpanda_migrator output now supports two-way syncing using provenance headers (@mmatczuk)
• schema_registry_encode gains a new protobuf.serialize_to_json option that is by default true. If disabled, then messages are decoded into a structured format which preserves types better and is faster. (@rockwotj)
• Add decode option to field operator in protobuf processor that decodes messages into a structured format (as opposed to serializing to JSON) that perserves types better and is faster. (@rockwotj)
• redpanda_migrator output schema_registry.interval default value changed to 5m enabling continuous schema migration by default. (@mmatczuk)
• The redpanda and redpanda_migrator input and output metadata_max_age default value changed to 1m. (@mmatczuk)

The full change log can be found here.

v4.69.0-rc1

For installation instructions check out the getting started guide.

NOTE: This is a release candidate, you can download a binary from this page.

Added

• (Benthos) New string.repeat(int) method to repeat a string or byte array N times. (@rockwotj)
• (Benthos) New bytes method to create a 0 initialized byte array. (@rockwotj)

Changed

• redpanda_migrator output now supports two-way syncing using provenance headers (@mmatczuk)
• New ffi processor. (@rockwotj)
• schema_registry_encode gains a new protobuf.serialize_to_json option that is by default true. If disabled, then messages are decoded into a structured format which preserves types better and is faster. (@rockwotj)
• Add decode option to field operator in protobuf processor that decodes messages into a structured format (as opposed to serializing to JSON) that perserves types better and is faster. (@rockwotj)

The full change log can be found here.

v4.68.0

For installation instructions check out the getting started guide.

Added

• New a2a_message processor. (@birdayz)
• New jira processor. (@zoltancsontosness, @atudose-ness)
• (Benthos) Exporting a schema with the format jsonschema now includes is_advanced, is_deprecated, is_optional, is_secret extra fields. (@tomasz-sadura)

Changed

• The kafka, kafka_franz and redpanda_common inputs and outputs are now deprecated as their respective functionality has been rolled into the redpanda input and output. (@Jeffail)

The full change log can be found here.

v4.68.0-rc5

For installation instructions check out the getting started guide.

Added

• New a2a_message processor. (@birdayz)
• New jira processor. (@zoltancsontosness, @atudose-ness)
• (Benthos) Exporting a schema with the format jsonschema now includes is_advanced, is_deprecated, is_optional, is_secret extra fields. (@tomasz-sadura)

Changed

• The kafka, kafka_franz and redpanda_common inputs and outputs are now deprecated as their respective functionality has been rolled into the redpanda input and output. (@Jeffail)

The full change log can be found here.

v4.68.0-rc4

For installation instructions check out the getting started guide.

NOTE: This is a release candidate, you can download a binary from this page.

Added

• New a2a_message processor. (@birdayz)

The full change log can be found here.

v4.68.0-rc3

For installation instructions check out the getting started guide.

NOTE: This is a release candidate, you can download a binary from this page.

Added

• New a2a_message processor. (@birdayz)

The full change log can be found here.

v4.68.0-rc2

For installation instructions check out the getting started guide.

NOTE: This is a release candidate, you can download a binary from this page.

Added

• New a2a_message processor. (@birdayz)

The full change log can be found here.

v4.67.5

For installation instructions check out the getting started guide.

Changed

• Unified migrator: Introduced a single redpanda_migrator input/output pair replacing legacy redpanda_migrator_bundle, redpanda_migrator_offsets, and the standalone schema_registry output; pair components by matching label; all migration logic is centralised in the output. (@mmatczuk)
• (MS SQL Server CDC): Updated to use data source SQL Server as default checkpoint cache if none is configured. (@josephwoodward)

Fixed

• (MongoDB CDC) Fixed an issue with connecting to sharded databases. (@rockwotj)

The full change log can be found here.