Skip to content

Releases: confluentinc/parallel-consumer

0.5.3.3

28 Aug 16:40

Choose a tag to compare

What's Changed

New Contributors

Full Changelog: 0.5.3.2...0.5.3.3

0.5.3.2

21 Oct 13:01

Choose a tag to compare

Fixes

  • fix: include inflight message count in polling backpressure logic (#836)
  • fix: message loss on closing or partitions revoked (#827) fixes (#826)
  • fix: unbounded retry queue growth preventing polling from being throttled and leading to OOM (#834) fixes (#832, #817)

Note

#836 introduces a change in how buffer size is calculated as now inflight messages are counted as part of buffer size - so behaviour of existing applications may change and pausing of consumer happen sooner.

GH Generated

What's Changed

Full Changelog: 0.5.3.1...0.5.3.2

0.5.3.1

03 Sep 10:33

Choose a tag to compare

Fixes

  • fix: ConcurrentModificationException Happened while high load and draining (#822) fixes (#821)
  • fix: safely completing doClose() (#818) partially fixes (#809)
  • Improved offset commit retry. Add support for SaslAuthenticationException retry timeout (#819), partially fixes (#809) in Commit_Sync mode

GH Generated

What's Changed

New Contributors

Full Changelog: 0.5.3.0...0.5.3.1

0.5.3.0

14 Jun 08:54

Choose a tag to compare

Fixes

  • fix: ReactorProcessor - run used-defined function in provided scheduler rather than in pc-pool thread (#798 / #794), fixes (#793)
  • fix: fix issue for cannot close and exit properly when re-balancing storm (#787)
  • fix: Support for PCRetriableException in ReactorProcessor (#733)
  • fix: NullPointerException on partitions revoked (#757)
  • fix: remove lingeringOnCommitWouldBeBeneficial and unused imports (#732)
  • fix: Fix failing auto-commit check for kafka-clients >= v3.7.0 (#721)
  • fix: Fix redundant rebalance callback in LongPollingMockConsumer for Kafka >= 3.6 (#765)

Improvements

  • improvement: stale containers exclusion and handling improvement (#779)
  • improvement: add multiple caches for accelerating available container count calculation (#667
  • improvement: RecordContext now exposes lastFailureReason (#725)

Notable dependency upgrades

  • build(deps): Bump Kafka to 3.7.0

GH Generated

What's Changed

New Contributors

Full Changelog: 0.5.2.8...0.5.3.0

0.5.2.8

25 Jan 17:36

Choose a tag to compare

Fixes

  • fix: Fix equality and hash code for ShardKey with array key (#638), resolves (#579)
  • fix: Fix target loading computation for inflight records (#662)
  • fix: Fix synchronisation logic for transactional producer commit affecting non-transactional usage (#665), resolves (#637)
  • fix: Fix for race condition in partition state clean/dirty tracking (#666), resolves (#664)

Improvements

  • feature: Make PC message buffer size configurable - two new configuration options for controlling buffer size added (#682)

GH generated

Dependency updates omitted for readability

New Contributors

Full Changelog: 0.5.2.7...0.5.2.8

0.5.2.7

01 Sep 16:47

Choose a tag to compare

Fixes

  • fix: Return cached pausedPartitionSet (#620), resolves (#618)
  • fix: Parallel consumer stops processing data sometimes (#623), fixes (#606)
  • fix: Add synchronization to ensure proper intializaiton and closing of PCMetrics singleton (#627), fixes (#617)
  • fix: Readme - metrics example correction (#614)
  • fix: Remove micrometer-atlas dependency (#628), fixes (#625)

Improvements

  • Refactored metrics implementation to not use singleton - improves meter separation, allows correct metrics subsystem operation when multiple parallel consumer instances are running in same java process (#630), fixes (#617) improves on (#627)

GH generated

New Contributors

Full Changelog: 0.5.2.6...0.5.2.7

0.5.2.6

03 Aug 16:12

Choose a tag to compare

Improvements

  • feature: Micrometer metrics (#594)

Fixes

  • fix: Don’t drain mode shutdown kills inflight threads (#559)
  • fix: Drain mode shutdown doesn’t pause consumption correctly (#552)
  • fix: RunLength offset decoding returns 0 base offset after no-progress commit - related to (#546)
  • fix: Transactional PConsumer stuck while rebalancing - related to (#541)

GH generated:

What's Changed

New Contributors

Full Changelog: 0.5.2.5...0.5.2.6

0.5.2.5

22 Feb 18:26

Choose a tag to compare

Improvements

  • perf: Adds a caching layer to work management to alleviate O(n) counting (#530)

Fixes

  • fixes: #195 NoSuchFieldException when using consumer inherited from KafkaConsumer (#469)
  • fix: After new performance fix PR#530 merges - corner case could cause out of order processing (#534)
  • fix: Cleanup WorkManager's count of in-progress work, when work is stale after partition revocation (#547)

GH generated:

What's Changed

New Contributors

Full Changelog: 0.5.2.4...0.5.2.5

0.5.2.4

03 Nov 11:41

Choose a tag to compare

Improvements

  • feature: Simple PCRetriableException to remove error spam from logs (#444)

Fixes

  • fixes #409: Adds support for compacted topics and commit offset resetting (#425)
    • Truncate the offset state when bootstrap polled offset higher or lower than committed
    • Prune missing records from the tracked incomplete offset state, when they're missing from polled batches
  • fix: Improvements to encoding ranges (int vs long) #439
    • Replace integer offset references with long - use Long everywhere we deal with offsets, and where we truncate down, do it exactly, detect and handle truncation issues.

GH Generated:

What's Changed

New Contributors

Full Changelog: 0.5.2.3...0.5.2.4

0.5.2.3

30 Sep 16:49

Choose a tag to compare

Improvements

  • Transactional commit mode system improvements and docs (#355)

    • Clarifies transaction system with much better documentation.
    • Fixes a potential race condition which could cause offset leaks between transactions boundaries.
    • Introduces lock acquisition timeouts.
    • Fixes a potential issue with removing records from the retry queue incorrectly, by having an inconsistency between compareTo and equals in the retry TreeMap.
  • Adds a very simple Dependency Injection system modeled on Dagger (#398)

  • Various refactorings e.g. new ProducerWrap

  • Dependencies

    • build(deps): prod: zstd, reactor, dev: podam, progressbar, postgresql maven-plugins: versions, help (#420)
    • build(deps-dev): bump postgresql from 42.4.1 to 42.5.0
    • bump podam, progressbar, zstd, reactor
    • build(deps): bump versions-maven-plugin from 2.11.0 to 2.12.0
    • build(deps): bump maven-help-plugin from 3.2.0 to 3.3.0
    • build(deps-dev): bump Confluent Platform Kafka Broker to 7.2.2 (#421)
    • build(deps): Upgrade to AK 3.3.0 (#309)

Fixes

  • fixes #419: NoSuchElementException during race condition in PartitionState (#422)
  • Fixes #412: ClassCastException with retryDelayProvider (#417)
  • fixes ShardManager retryQueue ordering and set issues due to poor Comparator implementation (#423)

GH generated:

What's Changed

Full Changelog: 0.5.2.2...0.5.2.3