beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amit Sela (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (BEAM-84) Add support for Session Windows - Beam Sessions
Date Tue, 01 Mar 2016 11:47:18 GMT

     [ https://issues.apache.org/jira/browse/BEAM-84?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amit Sela updated BEAM-84:
--------------------------
    Component/s: runner-spark

> Add support for Session Windows - Beam Sessions
> -----------------------------------------------
>
>                 Key: BEAM-84
>                 URL: https://issues.apache.org/jira/browse/BEAM-84
>             Project: Beam
>          Issue Type: New Feature
>          Components: runner-spark
>            Reporter: Amit Sela
>
> Implement Beam Sessions, or Session Windows, by maintaining the session state. Spark
1.6 presents mapWithState as an improvement to updateStateByKey so It'd be better to use it.
> See "Session Windows" in Dataflow documentation here: https://cloud.google.com/dataflow/model/windowing#Functions
> Also, this blog post from Databricks would be a good place to start: https://databricks.com/blog/2016/02/01/faster-stateful-stream-processing-in-spark-streaming.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message