March 8, 2019 By Mickael Maison 2 min read

What happened in the Kafka community in February 2019?

Releases:

– 2.2.0: On February 23, 2019, Matthias J. Sax cut the first Release Candidate but the community found a blocker JIRA that required a new RC. RC1 was cut on March 1, and the voting process is currently opened. As a result, this new minor release should be available early March.

– 2.1.1: On February 9, 2019, Colin McCabe released this bugfix version. It contains dozens of fixes including a 4 blocker JIRAs.

KIPs:

Last month, the community submitted 13 KIPs (KIP-425 to KIP-437), and these are the ones that caught my eye:

KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers
Sending application logs to Kafka is a very common use case, and, in fact, Kafka includes a Log4J appender. However, currently, it does not support producing to brokers that use SASL, so this KIP proposes adding a couple of new properties to enable users to configure the appender to use SASL.

KIP-429: Smooth Auto-Scaling for Kafka Streams
In the past few months, the community started looking at ways to improve the rebalance mechanism used by clients to distribute work. One potential option is to use incremental cooperative rebalances. This KIP aims at bringing such a mechanism to Kafka Streams in order to support easy scaling without downtime.

KIP-430: Return Authorized Operations in Describe Responses
At the moment, users have no way to determine which operations they can do on each Kafka resource. Basically, the only way to figure it out is to try the operation and see that it succeeds or if the response contains an authorization error. The goal of this KIP is to include authorization details in the Metadata and DescribeGroups responses so allowed operations are retrievable through the API.

KIP-435: Incremental Partition Reassignment
Currently, when a replicated partition is reassigned, all new replicas will have to be in-sync before any of the old replicas are deleted. As a result, this can cause significant load when reassigning a partition with three replicas to three different brokers as, at worst, Kafka will have to maintain six replicas. This KIP aims at optimizing the reassignment logic to decrease the impact of large reassignments and to delete replicas incrementally as new replicas come online.

Blogs:

IBM Event Streams for Cloud is Apache Kafka-as-a-service for IBM Cloud.

Get started with IBM Event Streams

More from Announcements

IBM offerings close 2023 strong in G2 Winter Reports

2 min read - IBM offerings were featured in more than 1,400 unique G2 reports, earning over 300 leader badges across various categories. G2 was visited 90 million times in 2023 and hosts over one million user reviews, solidifying the crucial role peer reviews play in the software buying process. IBM is thankful to its clients for the continued trust, feedback and partnership. All of which help IBM to enable global enterprises with innovative, intelligent, and effective business solutions. Highlights of IBM’s leadership: Ranked #1 in 152…

Tune in to the second episode of the Inspiring Voices podcast, featuring Dr. Nicola Hodson

< 1 min read - The Inspiring Voices podcast, brought to you by the Executive Search and Integration team at IBM, aims to inspire you in your life and career choices by showcasing great leaders and their personal stories about life, career, and how to make an impact. In this second episode, our host, Christian Zani, brings you the story of Dr. Nicola Hodson, Country General Manager UK & Ireland. Nicola reflects on IBMs culture and provides valuable insights into her experience as a new…

More accessible than ever: IBM Envizi ESG Suite now available in seven languages

2 min read - The capture, management, and reporting of environmental, social and governance (ESG) data is a topic of global relevance. IBM Envizi is making this process more accessible with this latest release of Envizi in seven languages. Customers can now view the IBM Envizi ESG Suite interface in English, French, German, Italian, Spanish, Brazilian-Portuguese, and Japanese.  Translated functionality includes key areas of the IBM Envizi user interface including home pages, summary pages, popular dashboards and PowerReports, menus, buttons, browse grids, search and…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters