Skip to content

fix(kafka): create and converge topics a broker refuses compression.type on - #928

Merged
catinspace-au merged 1 commit into
mainfrom
fix/kafka-optional-topic-config
Oct 19, 2026
Merged

catinspace-au merged 1 commit into
mainfrom
fix/kafka-optional-topic-config

Conversation

@catinspace-au

Copy link
Copy Markdown
Contributor

Redpanda Cloud answers INVALID_CONFIG to a topic-level compression.type, so a source deploy there failed with topics_not_created and its source never deployed.

  • compression.type is a preference DFE asks for, so on INVALID_CONFIG the engine creates the topic, or converges the rest of its configs, without it and the broker keeps its own value. One warning names the dropped key.
  • A refused required config such as max.message.bytes still fails the topic, as before.
  • Four unit tests in tests/unit/test_kafka/test_topics.py. Three fail on main, and the fourth pins the required-config refusal that main already gets right.

Done when the Redpanda Cloud source suite deploys its source.

…ype on

A topic-level compression.type is a preference, so a broker that answers INVALID_CONFIG to it (Redpanda Cloud does) now gets the topic, or the rest of the converge, without that key and keeps its own value. A refused required config such as max.message.bytes still fails the topic.
@catinspace-au
catinspace-au merged commit ecc6efa into main Oct 19, 2026
20 checks passed
@catinspace-au
catinspace-au deleted the fix/kafka-optional-topic-config branch October 19, 2026 10:35
@github-actions

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant