你好,游客 登录 注册 搜索
背景:
阅读新闻

Gearpump:基于 Akka 的大数据实时处理引擎

[日期:2016-01-20] 来源:极客头条  作者: [字体: ]

  Gearpump is a real-time big data streaming engine.

  It is inspired by recent advances in the Akka framework and a desire to improve on existing streaming frameworks.

  Gearpump is event/message based and featured as low latency handling, high performance, exactly once semantics,

  dynamic topology update, Apache Storm compatibility, etc.

  The name Gearpump is a reference to the engineering term “gear pump,” which is a super simplepump that consists of only two gears, but is very powerful at streaming water.

  Gearpump Technical Highlights

  Gearpump is a modern big data real-time streaming engine which has many unique features:

  Extremely high performance

  Low latency

  Configurable message delivery guarantee (at least once, exactly once).

  Highly extensible

  Dynamic DAG

  Storm compatibility

  Samoa compatibility

  widely IoT connectivity

  Both high level and low level API

  Gearpump Performance

  Per initial benchmarks we are able to process 18 million messages/second (100 bytes per message) with a 8ms latency on a 4-node cluster.

  Gearpump and Akka

  Gearpump is a 100% Akka based platform. We model big data streaming within the Akka actor hierarchy.

 

  Gearpump





收藏 推荐 打印 | 录入:elainebo | 阅读:
相关新闻       大数据实时处理引擎 
本文评论   查看全部评论 (0)
表情: 表情 姓名: 字数
点评:
       
评论声明
  • 尊重网上道德,遵守中华人民共和国的各项有关法律法规
  • 承担一切因您的行为而直接或间接导致的民事或刑事法律责任
  • 本站管理人员有权保留或删除其管辖留言中的任意内容
  • 本站有权在网站内转载或引用您的评论
  • 参与本评论即表明您已经阅读并接受上述条款