Package org.apache.beam.sdk

Provides a simple, powerful model for building both batch and streaming parallel data processing Pipelines.

See: Description

Interface Summary

Interface	Description
Pipeline.PipelineVisitor	A Pipeline.PipelineVisitor can be passed into Pipeline.traverseTopologically(org.apache.beam.sdk.Pipeline.PipelineVisitor) to be called for each of the transforms and values in the Pipeline.
PipelineResult	Result of Pipeline.run().

Class Summary

Class	Description
Pipeline	A Pipeline manages a directed acyclic graph of PTransforms, and the PCollections that the PTransforms consume and produce.
Pipeline.PipelineVisitor.Defaults	Default no-op Pipeline.PipelineVisitor that enters all composite transforms.

Enum Summary

Enum	Description
Pipeline.PipelineVisitor.CompositeBehavior	Control enum for indicating whether or not a traversal should process the contents of a composite transform or not.
PipelineResult.State	Named constants for common values for the job state.

Exception Summary

Exception	Description
Pipeline.PipelineExecutionException	Thrown during execution of a Pipeline, whenever user code within that Pipeline throws an exception.

Package org.apache.beam.sdk Description

Provides a simple, powerful model for building both batch and streaming parallel data processing Pipelines.

To use the Google Cloud Dataflow SDK, you build a Pipeline, which manages a graph of PTransforms and the PCollections that the PTransforms consume and produce.

Each Pipeline has a PipelineRunner to specify where and how it should run after pipeline construction is complete.