beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amit Sela (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-84) Add support for Session Windows - Beam Sessions
Date Tue, 01 Mar 2016 11:46:18 GMT
Amit Sela created BEAM-84:
-----------------------------

             Summary: Add support for Session Windows - Beam Sessions
                 Key: BEAM-84
                 URL: https://issues.apache.org/jira/browse/BEAM-84
             Project: Beam
          Issue Type: New Feature
            Reporter: Amit Sela


Implement Beam Sessions, or Session Windows, by maintaining the session state. Spark 1.6 presents
mapWithState as an improvement to updateStateByKey so It'd be better to use it.

See "Session Windows" in Dataflow documentation here: https://cloud.google.com/dataflow/model/windowing#Functions

Also, this blog post from Databricks would be a good place to start: https://databricks.com/blog/2016/02/01/faster-stateful-stream-processing-in-spark-streaming.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message