| Package | +Description | +
|---|---|
| org.apache.beam.runners.dataflow | ++ |
| org.apache.beam.runners.dataflow.options | ++ |
| org.apache.beam.runners.dataflow.testing | ++ |
| org.apache.beam.runners.dataflow.util | ++ |
| Class and Description | +
|---|
| BlockingDataflowPipelineOptions
+ Options that are used to configure the
+BlockingDataflowPipelineRunner. |
+
| DataflowPipelineOptions
+ Options that can be used to configure the
+DataflowPipelineRunner. |
+
| Class and Description | +
|---|
| CloudDebuggerOptions
+ Options for controlling Cloud Debugger.
+ |
+
| DataflowPipelineDebugOptions
+ Internal.
+ |
+
| DataflowPipelineOptions
+ Options that can be used to configure the
+DataflowPipelineRunner. |
+
| DataflowPipelineWorkerPoolOptions
+ Options that are used to configure the Dataflow pipeline worker pool.
+ |
+
| DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType
+ Type of autoscaling algorithm to use.
+ |
+
| DataflowPipelineWorkerPoolOptions.TeardownPolicy
+ The policy for tearing down the workers spun up by the service.
+ |
+
| DataflowProfilingOptions
+ Options for controlling profiling of pipeline execution.
+ |
+
| DataflowProfilingOptions.DataflowProfilingAgentConfiguration
+ Configuration the for profiling agent.
+ |
+
| DataflowWorkerLoggingOptions
+ Options that are used to control logging configuration on the Dataflow worker.
+ |
+
| DataflowWorkerLoggingOptions.Level
+ The set of log levels that can be used on the Dataflow worker.
+ |
+
| DataflowWorkerLoggingOptions.WorkerLogLevelOverrides
+ Defines a log level override for a specific class, package, or name.
+ |
+
| Class and Description | +
|---|
| BlockingDataflowPipelineOptions
+ Options that are used to configure the
+BlockingDataflowPipelineRunner. |
+
| CloudDebuggerOptions
+ Options for controlling Cloud Debugger.
+ |
+
| DataflowPipelineDebugOptions
+ Internal.
+ |
+
| DataflowPipelineOptions
+ Options that can be used to configure the
+DataflowPipelineRunner. |
+
| DataflowPipelineWorkerPoolOptions
+ Options that are used to configure the Dataflow pipeline worker pool.
+ |
+
| DataflowProfilingOptions
+ Options for controlling profiling of pipeline execution.
+ |
+
| DataflowWorkerLoggingOptions
+ Options that are used to control logging configuration on the Dataflow worker.
+ |
+
| Class and Description | +
|---|
| DataflowPipelineOptions
+ Options that can be used to configure the
+DataflowPipelineRunner. |
+
Copyright © 2016 The Apache Software Foundation. All rights reserved.
+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/61ba656f/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-frame.html ---------------------------------------------------------------------- diff --git a/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-frame.html b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-frame.html new file mode 100644 index 0000000..f3e66dc --- /dev/null +++ b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-frame.html @@ -0,0 +1,44 @@ + + + + + + +| Interface | +Description | +
|---|---|
| DataflowPipelineTranslator.TransformTranslator<TransformT extends PTransform> | +
+ A
+DataflowPipelineTranslator.TransformTranslator knows how to translate
+ a particular subclass of PTransform for the
+ Cloud Dataflow service. |
+
| DataflowPipelineTranslator.TranslationContext | +
+ The interface provided to registered callbacks for interacting
+ with the
+DataflowPipelineRunner, including reading and writing the
+ values of PCollections and side inputs (PCollectionViews). |
+
| Class | +Description | +
|---|---|
| BlockingDataflowPipelineRunner | +
+ A
+PipelineRunner that's like DataflowPipelineRunner
+ but that waits for the launched job to finish. |
+
| DataflowPipelineJob | +
+ A DataflowPipelineJob represents a job submitted to Dataflow using
+
+DataflowPipelineRunner. |
+
| DataflowPipelineRegistrar | ++ + | +
| DataflowPipelineRegistrar.Options | +
+ Register the
+DataflowPipelineOptions and BlockingDataflowPipelineOptions. |
+
| DataflowPipelineRegistrar.Runner | +
+ Register the
+DataflowPipelineRunner and BlockingDataflowPipelineRunner. |
+
| DataflowPipelineRunner | +
+ A
+PipelineRunner that executes the operations in the
+ pipeline by first translating them to the Dataflow representation
+ using the DataflowPipelineTranslator and then submitting
+ them to a Dataflow service for execution. |
+
| DataflowPipelineRunnerHooks | +
+ An instance of this class can be passed to the
+
+DataflowPipelineRunner to add user defined hooks to be
+ invoked at various times during pipeline execution. |
+
| DataflowPipelineTranslator | +
+DataflowPipelineTranslator knows how to translate Pipeline objects
+ into Cloud Dataflow Service API Jobs. |
+
| DataflowPipelineTranslator.JobSpecification | +
+ The result of a job translation.
+ |
+
| Exception | +Description | +
|---|---|
| DataflowJobAlreadyExistsException | +
+ An exception that is thrown if the unique job name constraint of the Dataflow
+ service is broken because an existing job with the same job name is currently active.
+ |
+
| DataflowJobAlreadyUpdatedException | +
+ An exception that is thrown if the existing job has already been updated within the Dataflow
+ service and is no longer able to be updated.
+ |
+
| DataflowJobCancelledException | +
+ Signals that a job run by a
+BlockingDataflowPipelineRunner was updated during execution. |
+
| DataflowJobException | +
+ A
+RuntimeException that contains information about a DataflowPipelineJob. |
+
| DataflowJobExecutionException | +
+ Signals that a job run by a
+BlockingDataflowPipelineRunner fails during execution, and
+ provides access to the failed job. |
+
| DataflowJobUpdatedException | +
+ Signals that a job run by a
+BlockingDataflowPipelineRunner was updated during execution. |
+
| DataflowServiceException | +
+ Signals there was an error retrieving information about a job from the Cloud Dataflow Service.
+ |
+
Copyright © 2016 The Apache Software Foundation. All rights reserved.
+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/61ba656f/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-tree.html ---------------------------------------------------------------------- diff --git a/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-tree.html b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-tree.html new file mode 100644 index 0000000..33fbd73 --- /dev/null +++ b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-tree.html @@ -0,0 +1,178 @@ + + + + + + +Copyright © 2016 The Apache Software Foundation. All rights reserved.
+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/61ba656f/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-use.html ---------------------------------------------------------------------- diff --git a/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-use.html b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-use.html new file mode 100644 index 0000000..2f8c5ce --- /dev/null +++ b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/package-use.html @@ -0,0 +1,235 @@ + + + + + + +| Package | +Description | +
|---|---|
| org.apache.beam.runners.dataflow | ++ |
| org.apache.beam.runners.dataflow.testing | ++ |
| Class and Description | +
|---|
| BlockingDataflowPipelineRunner
+ A
+PipelineRunner that's like DataflowPipelineRunner
+ but that waits for the launched job to finish. |
+
| DataflowJobException
+ A
+RuntimeException that contains information about a DataflowPipelineJob. |
+
| DataflowPipelineJob
+ A DataflowPipelineJob represents a job submitted to Dataflow using
+
+DataflowPipelineRunner. |
+
| DataflowPipelineRunner
+ A
+PipelineRunner that executes the operations in the
+ pipeline by first translating them to the Dataflow representation
+ using the DataflowPipelineTranslator and then submitting
+ them to a Dataflow service for execution. |
+
| DataflowPipelineRunnerHooks
+ An instance of this class can be passed to the
+
+DataflowPipelineRunner to add user defined hooks to be
+ invoked at various times during pipeline execution. |
+
DataflowPipelineTranslator
+DataflowPipelineTranslator knows how to translate Pipeline objects
+ into Cloud Dataflow Service API Jobs. |
+
| DataflowPipelineTranslator.JobSpecification
+ The result of a job translation.
+ |
+
| DataflowPipelineTranslator.TransformTranslator
+ A
+DataflowPipelineTranslator.TransformTranslator knows how to translate
+ a particular subclass of PTransform for the
+ Cloud Dataflow service. |
+
| DataflowPipelineTranslator.TranslationContext
+ The interface provided to registered callbacks for interacting
+ with the
+DataflowPipelineRunner, including reading and writing the
+ values of PCollections and side inputs (PCollectionViews). |
+
| Class and Description | +
|---|
| DataflowPipelineJob
+ A DataflowPipelineJob represents a job submitted to Dataflow using
+
+DataflowPipelineRunner. |
+
Copyright © 2016 The Apache Software Foundation. All rights reserved.
+ +