Home / Kafka

Apache Kafka errors and exceptions

Common Apache Kafka errors and exceptions with their exact messages, causes, ways to confirm them and fixes.

Producer

Kafka producer: TimeoutException: Expiring N record(s) for topic-partitionRecords waited in the producer longer than delivery.timeout.ms (120 seconds by default) without being acknowledged, so the producer failed them. The producer…
Kafka producer: RecordTooLargeException: The message is N bytes when serialized which is larger than max.request.sizeThe producer refused to send a record that is larger than its own max.request.size (1 MiB by default). Raising only the producer limit is not enough: the…

Kafka consumer: CommitFailedException: Commit cannot be completed since the group has already rebalancedThe consumer took longer than max.poll.interval.ms (5 minutes by default) between two poll() calls, so the group coordinator considered it dead and gave its…

Kafka: NotLeaderOrFollowerException: the broker is not the current leaderA client sent a request to a broker that is no longer the leader of the partition, usually during a leader election or broker restart. Clients refresh…