samoa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paris Carbone <par...@kth.se>
Subject Lifting Stream Abstractions
Date Fri, 05 Feb 2016 17:15:17 GMT
Hello Samoans,

It seems that system semantics in stream processing are converging lately. Apache Storm has
now explicit state and windows [1], almost identical to Flink and Beam. Samza is also moving
in a similar direction.

This is really exciting and it feels natural to start moving the Samoa programming model a
level up on top these establishing concepts. For example, there is no more need for custom
buffering to implement windowing and ML models etc. can be re-defined and engineered as operator
state to be durable. There are quite many cool things to be done and I believe there can be
a very attractive roadmap for Samoa in that direction. What do you think?

[1] https://community.hortonworks.com/articles/14171/windowing-and-state-checkpointing-in-apache-storm.html

Paris

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message