October 22, 2018 By Mickael Maison 2 min read

Important happenings in the Kafka community in September 2018

 

Kafka Summit SF 2018

The next Kafka Summit will happen on October 16 and 17 in San Francisco. The full schedule for all the sessions is already available on the Summit website, and there are still tickets available at the time I’m writing this article.

It will be my third time attending a Kafka Summit—come say Hi if you see me there!

Kafka releases:

On September 10, Dong Lin started the release process for 2.1.0. KIP freeze happened on October 24. The next step—code freeze—should happen mid-October, and, hopefully, there will be a release by the end of October or early November.

As always, the full release plan can be found on the Apache wiki.

KIPs:

In contrast to previous months, the community only submitted 8 KIPs in September (KIP-370 to KIP-378). These are the ones that caught my eye:

KIP-370: Remove Orphan Partitions
Reassigning partitions is a fairly common administrative operation on Kafka clusters. When a broker is down, an administrator can migrate partitions off this broker to ensure availability. In this case, upon restarting, the broker will not delete logs for partitions it’s not a replica for anymore. As a result, this can lead to wasted disk space and it is hard for administrators to track which brokers have “orphaned” logs. Therefore, the goal of this KIP is to enable brokers to automatically detect and delete such logs upon restarting.

KIP-372: Naming Repartition Topics for Joins and Grouping
Currently, Kafka Streams generates names of repartition topics. While this ensures names are unique, it also means that if the topology is updated, topic names can change. This prevents users from simply doing rolling restarts and can also make it hard to map topics to operator when debugging Streams applications. The goal of this KIP is to allow users to name operators (and by extension repartition topics) to allow rolling restart even in some case when the topology changed.

KIP-377: TopicCommand to use AdminClient
This KIP proposes updating the “kafka-topics” tool in order to allow it to use the AdminClient API. While the functionality will remain the same, it will enable users to run this tool in environments where zookeeper is not directly available (it is often the case in Cloud environments).

Blogs:

IBM Event Streams for Cloud is Apache Kafka-as-a-service for IBM Cloud.

Get started with IBM Event Streams

More from Announcements

Success and recognition of IBM offerings in G2 Summer Reports  

2 min read - IBM offerings were featured in over 1,365 unique G2 reports, earning over 230 Leader badges across various categories.   This recognition is important to showcase our leading products and also to provide the unbiased validation our buyers seek. According to the 2024 G2 Software Buyer Behavior Report, “When researching software, buyers are most likely to trust information from people with similar roles and challenges, and they value transparency above other factors.”  With over 90 million visitors each year and hosting more than 2.6…

IBM named a Leader in Gartner Magic Quadrant for SIEM, for the 14th consecutive time

3 min read - Security operations is getting more complex and inefficient with too many tools, too much data and simply too much to do. According to a study done by IBM, SOC team members are only able to handle half of the alerts that they should be reviewing in a typical workday. This potentially leads to missing the important alerts that are critical to an organization's security. Thus, choosing the right SIEM solution can be transformative for security teams, helping them manage alerts…

Reflecting on IBM’s legacy of environmental innovation and leadership

4 min read - Upholding a legacy of more than 50 years of environmental responsibility through our company’s actions and commitments, IBM continues to be a leader in driving sustainability for our business, our communities and our clients—including a 34-year history of annual, public environmental reporting, which we continue today. As a hybrid cloud and artificial intelligence (AI) company, we believe that leveraging technology is key to unlocking impact, and it will play a substantial role in how society addresses, adapts to, and overcomes…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters