beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amit Sela (JIRA)" <>
Subject [jira] [Created] (BEAM-851) Identify streaming pipelines implicitly.
Date Thu, 27 Oct 2016 19:49:58 GMT
Amit Sela created BEAM-851:

             Summary: Identify streaming pipelines implicitly.
                 Key: BEAM-851
             Project: Beam
          Issue Type: Improvement
          Components: runner-spark
            Reporter: Amit Sela
            Assignee: Amit Sela

Instead of asking the user to explicilty set {{StreamingOptions.setStreaming(true)}} ,the
SparkRunner could first traverse the Pipeline (or even better, just it's sources) to identify
if at least one of the sources is an {{UnboundedSource}} (or equivalently if the root transformations
are {{Read.Unbounded}}).

This message was sent by Atlassian JIRA

View raw message