Onyx 0.9.7-beta1 发布,分布式计算系统 - 开源中国社区
Onyx 0.9.7-beta1 发布,分布式计算系统
oschina 2016年07月04日

Onyx 0.9.7-beta1 发布,分布式计算系统

oschina oschina 发布于2016年07月04日 收藏 10 评论 0

免费体验IBM Cloud,构建Iot应用 >>>  

Onyx 0.9.7-beta1 发布了。

Onyx 是一个无中心、支持云、容错的分布式计算系统,使用 Clojure 编写,支持批处理和流处理混合,提供信息模型用于描述和构建分布式工作流。

主要用途:

  • 实时的事件流处理

  • 连续计算

  • ETL

  • 在 MapReduce 进行数据转换

  • 数据清理

  • 数据摄入和存储媒介传输

该版本只是一个测试版本,暂无相关更新记录,预计正式版有如下更新:

  • Bug fix: Fixed suppressed exceptions on with-test-env start up sequence.

  • Bug fix: Fixed schema merging for task bundles.

  • Bug fix: Suppress Aeron MediaDriver NoSuchFileException when Aeron cleans up the directory before we do.

  • Bug fix: Fixed ZooKeeper thread leak bug. #600

  • Bug fix: Fixed logging statement echoing the number of processed segments.

  • Bug fix: Only allow peer to write one exhausted input log entry per task. #493

  • Bug fix: Fixed bug in percentage scheduler that failed to use all available peers due to a rounding error.

  • Documentation fix: Fixed lifecycles exception description.

  • Documentation fix: Fixed trigger predicate signature description. #586

  • Documentation: Added more content to the FAQ section.

  • Dependency change: Upgraded org.btrplace/scheduler-api to 0.46.

  • Dependency change: Upgraded org.btrplace/scheduler-choco to 0.46.

  • Dependency change: Excluded ClojureScript from clj-fuzzy dependencies.

  • Design change: Implemented peer-group ZooKeeper connection sharing. This reduces the number of ZooKeeper connections required per machine, and improves scheduler performance.

  • Enhancement: Tasks now time out when being stopped, allowing a peer to be rescheduled in cases where the task is stuck. This is configured via the peer-config :onyx.peer/stop-task-timeout-ms.

  • Enhancement: A message is now emitted to the logs when a job is submitted, but does not start because of the scheduler gave it no peers.

更多详情,可以在这里查看。

下载地址:

本站文章除注明转载外,均为本站原创或编译。欢迎任何形式的转载,但请务必注明出处,尊重他人劳动共创开源社区。
转载请注明:文章转载自 开源中国社区 [http://www.oschina.net]
本文标题:Onyx 0.9.7-beta1 发布,分布式计算系统
分享
评论(0)
最新评论
顶部