Skip to content

kafka: deprecate kafka and kafka_franz outputs - #4908

Open
Jeffail wants to merge 2 commits into
mainfrom
deprecate-kafka-outputs
Open

Jeffail wants to merge 2 commits into
mainfrom
deprecate-kafka-outputs

Conversation

@Jeffail

@Jeffail Jeffail commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

#3677 announced the kafka and kafka_franz inputs and outputs as deprecated in favour of redpanda, but only the inputs were flipped. This marks the outputs Deprecated() too and syncs info.csv.

Deprecation only affects lint --deprecated and component listings; existing configs keep running.

The two config examples that used the kafka output now use redpanda. Worth knowing for anyone making the same move, since the defaults differ:

  1. metadata isn't forwarded as headers unless metadata.include_patterns is set (joining_streams needs it for its retry delay, so it's set there)
  2. the partitioner is murmur2 rather than fnv1a, so the same key can land on a different partition
  3. idempotent writes are on with acks=all, which needs the idempotent write ACL on the cluster

🤖 Generated with Claude Code

The kafka components consolidation (#3677) announced the kafka and
kafka_franz inputs and outputs as deprecated in favour of redpanda, but
only flipped the inputs. Mark the outputs Deprecated() to match, and sync
info.csv.
Both examples used the kafka output, which fails `lint --deprecated` now
that it's deprecated. joining_streams also sets metadata.include_patterns,
since the redpanda output doesn't forward metadata as headers by default
and the retry input reads last_attempted from them.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant