Apache Kafka 1.1.0 发布,改进 Kafka controller - 开源中国社区
Float_left Icon_close
Apache Kafka 1.1.0 发布,改进 Kafka controller
淡漠悠然 2018年03月29日

Apache Kafka 1.1.0 发布,改进 Kafka controller

淡漠悠然 淡漠悠然 发布于2018年03月29日 收藏 4

Apache Kafka 1.1.0 已发布,带来了大量改进和修复。主要亮点包括:

  • Kafka 1.1.0 includes significant improvements to the Kafka Controller that speed up controlled shutdown. ZooKeeper session expiration edge cases have also been fixed as part of this effort.

  • Controller improvements also enable more partitions to be supported on a single cluster. KIP-227 introduced incremental fetch requests, providing more efficient replication when the number of partitions is large.

  • KIP-113 added support for replica movement between log directories to enable data balancing with JBOD.

  • Some of the broker configuration options like SSL keystores can now be updated dynamically without restarting the broker. See KIP-226 for details and the full list of dynamic configs.

  • Delegation token based authentication (KIP-48) has been added to Kafka brokers to support large number of clients without overloading Kerberos KDCs or other authentication servers.

  • Several new features have been added to Kafka Connect, including header support (KIP-145), SSL and Kafka cluster identifiers in the Connect REST interface (KIP-208 and KIP-238), validation of connector names (KIP-212) and support for topic regex in sink connectors (KIP-215). Additionally, the default maximum heap size for Connect workers was increased to 2GB.

  • Several improvements have been added to the Kafka Streams API, including reducing repartition topic partitions footprint, customizable error handling for produce failures and enhanced resilience to broker unavailability. See KIPs 205, 210, 220, 224 and 239 for details.

完整更新内容请查阅:

下载地址:

本站文章除注明转载外,均为本站原创或编译。欢迎任何形式的转载,但请务必注明出处,尊重他人劳动共创开源社区。
转载请注明:文章转载自 开源中国社区 [http://www.oschina.net]
本文标题:Apache Kafka 1.1.0 发布,改进 Kafka controller
分享
评论(2)
最新评论
0

引用来自“eechen”的评论

Kafka怎么保证"消息只读取一次"?
Kafka把消息刷写到磁盘是实时fsync的么?
Kafka的leader和replica之间是完全同步复制么?

Redis作者antirez(意大利人)计划在Redis的4.2版本内置消息队列Disque.
1. 你读取多少次,是通过 offset 来保证的,当然,offset 可以由你自己维护,也可以由kafka 自己维护;
2. 不是 实时 fsync ,异步;
3. leader和replica之间是完全同步复制,这个主要跟你配置有关系,主要参数为 ack.
0
Kafka怎么保证"消息只读取一次"?
Kafka把消息刷写到磁盘是实时fsync的么?
Kafka的leader和replica之间是完全同步复制么?

Redis作者antirez(意大利人)计划在Redis的4.2版本内置消息队列Disque.
顶部