- AccumulatingCombineFn() - Constructor for class org.apache.beam.sdk.transforms.Combine.AccumulatingCombineFn
-
- accumulatingFiredPanes() - Static method in class org.apache.beam.sdk.transforms.windowing.Window
-
Returns a new Window PTransform that uses the registered WindowFn and
Triggering behavior, and that accumulates elements in a pane after they are triggered.
- accumulatingFiredPanes() - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
Returns a new Window PTransform that uses the registered WindowFn and
Triggering behavior, and that accumulates elements in a pane after they are triggered.
- accumulatingFiredPanes() - Method in class org.apache.beam.sdk.transforms.windowing.Window.Unbound
-
Returns a new Window PTransform that uses the registered WindowFn and
Triggering behavior, and that accumulates elements in a pane after they are triggered.
- add(Long) - Method in class org.apache.beam.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique
-
Adds a value to the heap, returning whether the value is (large enough
to be) in the heap.
- add(DisplayData.Item<?>) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register the given display item.
- addComposite(TransformTreeNode) - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Adds a composite operation to the transform node.
- addIfNotDefault(DisplayData.Item<T>, T) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register the given display item if the value is different than the specified default.
- addIfNotNull(DisplayData.Item<?>) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register the given display item if the value is not null.
- addInput(TransformTreeNode, PInput) - Method in class org.apache.beam.sdk.runners.TransformHierarchy
-
Adds an input to the given node.
- addInput(ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique, T) - Method in class org.apache.beam.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
-
- addInput(InputT) - Method in interface org.apache.beam.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator
-
Adds the given input value to this accumulator, modifying
this accumulator.
- addInput(AccumT, InputT) - Method in class org.apache.beam.sdk.transforms.Combine.AccumulatingCombineFn
-
- addInput(double[], Double) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
- addInput(Combine.Holder<V>, V) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
- addInput(int[], Integer) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
- addInput(long[], Long) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
- addInput(AccumT, InputT) - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Adds the given input value to the given accumulator, returning the
new accumulator value.
- addInput(List<V>, V) - Method in class org.apache.beam.sdk.transforms.Combine.IterableCombineFn
-
- addInput(K, AccumT, InputT) - Method in class org.apache.beam.sdk.transforms.Combine.KeyedCombineFn
-
Adds the given input value to the given accumulator, returning the new accumulator value.
- addInput(Object[], DataT) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- addInput(Object[], DataT, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFnWithContext
-
- addInput(K, Object[], DataT) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFn
-
- addInput(K, Object[], DataT, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFnWithContext
-
- addInput(AccumT, InputT, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
Adds the given input value to the given accumulator, returning the
new accumulator value.
- addInput(K, AccumT, InputT, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.KeyedCombineFnWithContext
-
Adds the given input value to the given accumulator, returning the new accumulator value.
- addInput(Top.BoundedHeap<KV<Integer, T>, SerializableComparator<KV<Integer, T>>>, T) - Method in class org.apache.beam.sdk.transforms.Sample.FixedSizedSampleFn
-
- addInputProducer(PValue, TransformTreeNode) - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Adds an input to the transform node.
- addTraceFor(AbstractGoogleClient, String) - Method in class org.apache.beam.sdk.options.GoogleApiDebugOptions.GoogleApiTracer
-
- addTraceFor(AbstractGoogleClientRequest<?>, String) - Method in class org.apache.beam.sdk.options.GoogleApiDebugOptions.GoogleApiTracer
-
- addValue(InputT) - Method in interface org.apache.beam.sdk.transforms.Aggregator
-
Adds a new value into the Aggregator.
- addValueInternal(PValue) - Method in class org.apache.beam.sdk.Pipeline
-
- advance() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- advance() - Method in class org.apache.beam.sdk.io.Source.Reader
-
Advances the reader to the next valid record.
- advance() - Method in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
Advances the reader to the next valid record.
- advanceImpl() - Method in class org.apache.beam.sdk.io.FileBasedSource.FileBasedReader
-
- advanceImpl() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
Advances to the next record and returns true, or returns false if there is no next
record.
- AfterAll - Class in org.apache.beam.sdk.transforms.windowing
-
Create a
Trigger that fires and finishes once after all of its sub-triggers have fired.
- AfterDelayFromFirstElement - Class in org.apache.beam.sdk.transforms.windowing
-
A base class for triggers that happen after a processing time delay from the arrival
of the first element in a pane.
- AfterDelayFromFirstElement(TimeDomain, List<SerializableFunction<Instant, Instant>>) - Constructor for class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- AfterEach - Class in org.apache.beam.sdk.transforms.windowing
-
A composite
Trigger that executes its sub-triggers in order.
- AfterFirst - Class in org.apache.beam.sdk.transforms.windowing
-
Create a composite
Trigger that fires once after at least one of its sub-triggers have
fired.
- AfterPane - Class in org.apache.beam.sdk.transforms.windowing
-
Triggers that fire based on properties of the elements in the current pane.
- AfterProcessingTime - Class in org.apache.beam.sdk.transforms.windowing
-
AfterProcessingTime triggers fire based on the current processing time.
- AfterWatermark - Class in org.apache.beam.sdk.transforms.windowing
-
AfterWatermark triggers fire based on progress of the system watermark.
- AfterWatermark.AfterWatermarkEarlyAndLate - Class in org.apache.beam.sdk.transforms.windowing
-
- AfterWatermark.FromEndOfWindow - Class in org.apache.beam.sdk.transforms.windowing
-
A watermark trigger targeted relative to the end of the window.
- AfterWatermarkEarlyAndLate(Trigger.OnceTrigger, Trigger.OnceTrigger) - Constructor for class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- Aggregator<InputT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
An Aggregator<InputT> enables monitoring of values of type InputT,
to be combined across all bundles.
- AggregatorPipelineExtractor - Class in org.apache.beam.sdk.runners
-
- AggregatorPipelineExtractor(Pipeline) - Constructor for class org.apache.beam.sdk.runners.AggregatorPipelineExtractor
-
Creates an
AggregatorPipelineExtractor for the given
Pipeline.
- AggregatorRetrievalException - Exception in org.apache.beam.sdk.runners
-
Signals that an exception has occurred while retrieving
Aggregators.
- AggregatorRetrievalException(String, Throwable) - Constructor for exception org.apache.beam.sdk.runners.AggregatorRetrievalException
-
Constructs a new AggregatorRetrievalException with the specified detail message and
cause.
- AggregatorRetriever - Class in org.apache.beam.sdk.transforms
-
- AggregatorValues<T> - Class in org.apache.beam.sdk.runners
-
A collection of values associated with an
Aggregator.
- AggregatorValues() - Constructor for class org.apache.beam.sdk.runners.AggregatorValues
-
- alignedTo(Duration, Instant) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
Aligns timestamps to the smallest multiple of size since the offset greater
than the timestamp.
- alignedTo(Duration) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
Aligns the time to be the smallest multiple of size greater than the timestamp
since the epoch.
- ALL_CONTEXTS - Static variable in class org.apache.beam.sdk.testing.CoderProperties
-
All the contexts, for use in test cases.
- ALL_KEYS - Static variable in class org.apache.beam.sdk.io.range.ByteKeyRange
-
The range of all keys, with empty start and end keys.
- allowsDynamicSplitting() - Method in class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
- allowsDynamicSplitting() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
Whether this reader should allow dynamic splitting of the offset ranges.
- AlwaysPassMatcher() - Constructor for class org.apache.beam.sdk.testing.TestPipelineOptions.AlwaysPassMatcher
-
- AlwaysPassMatcherFactory() - Constructor for class org.apache.beam.sdk.testing.TestPipelineOptions.AlwaysPassMatcherFactory
-
- and(TupleTag<V>, List<V>) - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult
-
Returns a new
CoGbkResult based on this, with the given tag and given data
added to it.
- and(TupleTag<V>, PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
Returns a new KeyedPCollectionTuple<K> that is the same as this,
appended with the given PCollection.
- and(PCollection.IsBounded) - Method in enum org.apache.beam.sdk.values.PCollection.IsBounded
-
Returns the composed IsBounded property.
- and(PCollection<T>) - Method in class org.apache.beam.sdk.values.PCollectionList
-
- and(Iterable<PCollection<T>>) - Method in class org.apache.beam.sdk.values.PCollectionList
-
- and(TupleTag<T>, PCollection<T>) - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- and(TupleTag<?>) - Method in class org.apache.beam.sdk.values.TupleTagList
-
- and(List<TupleTag<?>>) - Method in class org.apache.beam.sdk.values.TupleTagList
-
- any(long) - Static method in class org.apache.beam.sdk.transforms.Sample
-
Sample#any(long) takes a PCollection<T> and a limit, and
produces a new PCollection<T> containing up to limit
elements of the input PCollection.
- applicableTo(PCollection<?>) - Static method in class org.apache.beam.sdk.transforms.GroupByKey
-
- ApplicationNameOptions - Interface in org.apache.beam.sdk.options
-
Options that allow setting the application name.
- AppliedPTransform<InputT extends PInput,OutputT extends POutput,TransformT extends PTransform<? super InputT,OutputT>> - Class in org.apache.beam.sdk.transforms
-
Represents the application of a
PTransform to a specific input to produce
a specific output.
- apply(InputT) - Method in interface org.apache.beam.sdk.coders.DelegateCoder.CodingFunction
-
- apply(PInput) - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
- apply(PBegin) - Method in class org.apache.beam.sdk.io.CountingInput.BoundedCountingInput
-
- apply(PBegin) - Method in class org.apache.beam.sdk.io.CountingInput.UnboundedCountingInput
-
- apply(PInput) - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.io.PubsubUnboundedSink
-
- apply(PBegin) - Method in class org.apache.beam.sdk.io.PubsubUnboundedSource
-
- apply(PInput) - Method in class org.apache.beam.sdk.io.Read.Bounded
-
- apply(PInput) - Method in class org.apache.beam.sdk.io.Read.Unbounded
-
- apply(PInput) - Method in class org.apache.beam.sdk.io.TextIO.Read.Bound
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.io.Write.Bound
-
- apply(PTransform<? super PBegin, OutputT>) - Method in class org.apache.beam.sdk.Pipeline
-
- apply(String, PTransform<? super PBegin, OutputT>) - Method in class org.apache.beam.sdk.Pipeline
-
- apply(PTransform<InputT, OutputT>, InputT) - Method in class org.apache.beam.sdk.runners.PipelineRunner
-
Applies a transform to the given input, returning the output.
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.testing.PAssert.GroupThenAssert
-
- apply(PCollection<Iterable<T>>) - Method in class org.apache.beam.sdk.testing.PAssert.GroupThenAssertForSingleton
-
- apply(PBegin) - Method in class org.apache.beam.sdk.testing.PAssert.OneSideInputAssert
-
- apply(double, double) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
Applies the binary operation to the two operands, returning the result.
- apply(V, V) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
Applies the binary operation to the two operands, returning the result.
- apply(int, int) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
Applies the binary operation to the two operands, returning the result.
- apply(long, long) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
Applies the binary operation to the two operands, returning the result.
- apply(Iterable<? extends InputT>) - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Applies this CombineFn to a collection of input values
to produce a combined output value.
- apply(PCollection<InputT>) - Method in class org.apache.beam.sdk.transforms.Combine.Globally
-
- apply(PCollection<InputT>) - Method in class org.apache.beam.sdk.transforms.Combine.GloballyAsSingletonView
-
- apply(PCollection<? extends KV<K, ? extends Iterable<InputT>>>) - Method in class org.apache.beam.sdk.transforms.Combine.GroupedValues
-
- apply(K, Iterable<? extends InputT>) - Method in class org.apache.beam.sdk.transforms.Combine.KeyedCombineFn
-
Applies this KeyedCombineFn to a key and a collection
of input values to produce a combined output value.
- apply(PCollection<KV<K, InputT>>) - Method in class org.apache.beam.sdk.transforms.Combine.PerKey
-
- apply(PCollection<KV<K, InputT>>) - Method in class org.apache.beam.sdk.transforms.Combine.PerKeyWithHotKeyFanout
-
- apply(K, Iterable<? extends InputT>, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.KeyedCombineFnWithContext
-
Applies this KeyedCombineFnWithContext to a key and a collection
of input values to produce a combined output value.
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.Count.PerElement
-
- apply(PInput) - Method in class org.apache.beam.sdk.transforms.Create.TimestampedValues
-
- apply(PInput) - Method in class org.apache.beam.sdk.transforms.Create.Values
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.Filter
-
- apply(PCollection<InputT>) - Method in class org.apache.beam.sdk.transforms.FlatMapElements
-
- apply(PCollection<? extends Iterable<T>>) - Method in class org.apache.beam.sdk.transforms.Flatten.FlattenIterables
-
- apply(PCollectionList<T>) - Method in class org.apache.beam.sdk.transforms.Flatten.FlattenPCollectionList
-
- apply(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.GroupByKey
-
- apply(PCollection<? extends InputT>) - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.Bound
-
- apply(KeyedPCollectionTuple<K>) - Method in class org.apache.beam.sdk.transforms.join.CoGroupByKey
-
- apply(PTransform<KeyedPCollectionTuple<K>, OutputT>) - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
- apply(String, PTransform<KeyedPCollectionTuple<K>, OutputT>) - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
Applies the given
PTransform to this input
KeyedPCollectionTuple and returns
its
OutputT.
- apply(PCollection<? extends KV<K, ?>>) - Method in class org.apache.beam.sdk.transforms.Keys
-
- apply(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.KvSwap
-
- apply(PCollection<InputT>) - Method in class org.apache.beam.sdk.transforms.MapElements
-
- apply(double, double) - Method in class org.apache.beam.sdk.transforms.Max.MaxDoubleFn
-
- apply(T, T) - Method in class org.apache.beam.sdk.transforms.Max.MaxFn
-
- apply(int, int) - Method in class org.apache.beam.sdk.transforms.Max.MaxIntegerFn
-
- apply(long, long) - Method in class org.apache.beam.sdk.transforms.Max.MaxLongFn
-
- apply(double, double) - Method in class org.apache.beam.sdk.transforms.Min.MinDoubleFn
-
- apply(T, T) - Method in class org.apache.beam.sdk.transforms.Min.MinFn
-
- apply(int, int) - Method in class org.apache.beam.sdk.transforms.Min.MinIntegerFn
-
- apply(long, long) - Method in class org.apache.beam.sdk.transforms.Min.MinLongFn
-
- apply(PCollection<? extends InputT>) - Method in class org.apache.beam.sdk.transforms.ParDo.Bound
-
- apply(PCollection<? extends InputT>) - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.Partition
-
- apply(InputT) - Method in class org.apache.beam.sdk.transforms.PTransform
-
Applies this PTransform on the given InputT, and returns its
Output.
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.RemoveDuplicates
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.RemoveDuplicates.WithRepresentativeValues
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.Sample.SampleAny
-
- apply(InputT) - Method in interface org.apache.beam.sdk.transforms.SerializableFunction
-
Returns the result of invoking this function on the given input.
- apply(double, double) - Method in class org.apache.beam.sdk.transforms.Sum.SumDoubleFn
-
- apply(int, int) - Method in class org.apache.beam.sdk.transforms.Sum.SumIntegerFn
-
- apply(long, long) - Method in class org.apache.beam.sdk.transforms.Sum.SumLongFn
-
- apply(PCollection<? extends KV<?, V>>) - Method in class org.apache.beam.sdk.transforms.Values
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.View.AsIterable
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.View.AsList
-
- apply(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.View.AsMap
-
- apply(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.View.AsMultimap
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.View.AsSingleton
-
- apply(PCollection<ElemT>) - Method in class org.apache.beam.sdk.transforms.View.CreatePCollectionView
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
- apply(PCollection<V>) - Method in class org.apache.beam.sdk.transforms.WithKeys
-
- apply(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.WithTimestamps
-
- apply(PTransform<? super PBegin, OutputT>) - Method in class org.apache.beam.sdk.values.PBegin
-
- apply(String, PTransform<? super PBegin, OutputT>) - Method in class org.apache.beam.sdk.values.PBegin
-
Applies the given
PTransform to this input
PBegin,
using
name to identify this specific application of the transform.
- apply(PTransform<? super PCollection<T>, OutputT>) - Method in class org.apache.beam.sdk.values.PCollection
-
- apply(String, PTransform<? super PCollection<T>, OutputT>) - Method in class org.apache.beam.sdk.values.PCollection
-
Applies the given
PTransform to this input
PCollection,
using
name to identify this specific application of the transform.
- apply(PTransform<PCollectionList<T>, OutputT>) - Method in class org.apache.beam.sdk.values.PCollectionList
-
- apply(String, PTransform<PCollectionList<T>, OutputT>) - Method in class org.apache.beam.sdk.values.PCollectionList
-
Applies the given
PTransform to this input
PCollectionList,
using
name to identify this specific application of the transform.
- apply(PTransform<PCollectionTuple, OutputT>) - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- apply(String, PTransform<PCollectionTuple, OutputT>) - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- applyTransform(InputT, PTransform<? super InputT, OutputT>) - Static method in class org.apache.beam.sdk.Pipeline
-
- applyTransform(String, InputT, PTransform<? super InputT, OutputT>) - Static method in class org.apache.beam.sdk.Pipeline
-
Applies the given PTransform to this input InputT and returns
its OutputT.
- ApproximateQuantiles - Class in org.apache.beam.sdk.transforms
-
PTransforms for getting an idea of a PCollection's
data distribution using approximate N-tiles (e.g.
- ApproximateQuantiles.ApproximateQuantilesCombineFn<T,ComparatorT extends Comparator<T> & Serializable> - Class in org.apache.beam.sdk.transforms
-
The ApproximateQuantilesCombineFn combiner gives an idea
of the distribution of a collection of values using approximate
N-tiles.
- ApproximateUnique - Class in org.apache.beam.sdk.transforms
-
PTransforms for estimating the number of distinct elements
in a PCollection, or the number of distinct values
associated with each key in a PCollection of KVs.
- ApproximateUnique() - Constructor for class org.apache.beam.sdk.transforms.ApproximateUnique
-
- ApproximateUnique.ApproximateUniqueCombineFn<T> - Class in org.apache.beam.sdk.transforms
-
CombineFn that computes an estimate of the number of
distinct values that were combined.
- ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique - Class in org.apache.beam.sdk.transforms
-
A heap utility class to efficiently track the largest added elements.
- ApproximateUniqueCombineFn(long, Coder<T>) - Constructor for class org.apache.beam.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
-
- areAllSubtriggersFinished() - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.TriggerInfo
-
Returns true if all the sub-triggers of the current trigger are marked finished.
- as(Class<T>) - Method in interface org.apache.beam.sdk.options.PipelineOptions
-
Transforms this object into an object of type <T> saving each property
that has been manipulated.
- as(Class<T>) - Static method in class org.apache.beam.sdk.options.PipelineOptionsFactory
-
Creates and returns an object that implements <T>.
- as(Class<T>) - Method in class org.apache.beam.sdk.options.PipelineOptionsFactory.Builder
-
Creates and returns an object that implements <T> using the values configured on
this builder during construction.
- asCloudObject() - Method in class org.apache.beam.sdk.coders.AvroCoder
-
- asCloudObject() - Method in interface org.apache.beam.sdk.coders.Coder
-
Returns the CloudObject that represents this Coder.
- asCloudObject() - Method in class org.apache.beam.sdk.coders.CustomCoder
-
Returns the CloudObject that represents this Coder.
- asCloudObject() - Method in class org.apache.beam.sdk.coders.IterableCoder
-
- asCloudObject() - Method in class org.apache.beam.sdk.coders.JAXBCoder
-
- asCloudObject() - Method in class org.apache.beam.sdk.coders.KvCoder
-
- asCloudObject() - Method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
- asCloudObject() - Method in class org.apache.beam.sdk.coders.SerializableCoder
-
- asCloudObject() - Method in class org.apache.beam.sdk.coders.StandardCoder
-
- asCloudObject() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
-
- asCloudObject() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResultSchema
-
- asCloudObject() - Method in class org.apache.beam.sdk.values.TupleTag
-
- asIterable() - Static method in class org.apache.beam.sdk.transforms.View
-
- asKeyedFn() - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
- asKeyedFn() - Method in interface org.apache.beam.sdk.transforms.CombineFnBase.GlobalCombineFn
-
Converts this
GloballyCombineFn into an equivalent
CombineFnBase.PerKeyCombineFn that ignores the keys passed to it and
combines the values according to this
GloballyCombineFn.
- asKeyedFn() - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
- asList() - Static method in class org.apache.beam.sdk.transforms.View
-
- asMap() - Method in class org.apache.beam.sdk.transforms.display.DisplayData
-
- asMap() - Static method in class org.apache.beam.sdk.transforms.View
-
- asMultimap() - Static method in class org.apache.beam.sdk.transforms.View
-
- asPath() - Method in class org.apache.beam.sdk.io.PubsubIO.PubsubSubscription
-
Returns the string representation of this subscription as a path used in the Cloud Pub/Sub
API.
- asPath() - Method in class org.apache.beam.sdk.io.PubsubIO.PubsubTopic
-
Returns the string representation of this topic as a path used in the Cloud Pub/Sub
API.
- assertSourcesEqualReferenceSource(BoundedSource<T>, List<? extends BoundedSource<T>>, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Given a reference Source and a list of Sources, assert that the union of
the records read from the list of sources is equal to the records read from the reference
source.
- assertSplitAtFractionBehavior(BoundedSource<T>, int, double, SourceTestUtils.ExpectedSplitOutcome, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
- assertSplitAtFractionExhaustive(BoundedSource<T>, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Asserts that for each possible start position,
BoundedSource.BoundedReader#splitAtFraction at every interesting fraction (halfway
between two fractions that differ by at least one item) can be called successfully and the
results are consistent if a split succeeds.
- assertSplitAtFractionFails(BoundedSource<T>, int, double, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Asserts that the source's reader fails to splitAtFraction(fraction)
after reading numItemsToReadBeforeSplit items.
- assertSplitAtFractionSucceedsAndConsistent(BoundedSource<T>, int, double, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Verifies some consistency properties of
BoundedSource.BoundedReader#splitAtFraction on the given source.
- assertUnstartedReaderReadsSameAsItsSource(BoundedSource.BoundedReader<T>, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Assert that a Reader returns a Source that, when read from, produces the same
records as the reader.
- AssignContext() - Constructor for class org.apache.beam.sdk.transforms.windowing.WindowFn.AssignContext
-
- assignedWindows(WindowFn<T, W>, long) - Static method in class org.apache.beam.sdk.testing.WindowFnTestUtils
-
- assignOutputTime(Instant, W) - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn
-
Returns the output timestamp to use for data depending on the given
inputTimestamp in the specified window.
- assignOutputTime(W) - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.DependsOnlyOnWindow
-
Returns the output timestamp to use for data in the specified window.
- assignOutputTime(Instant, W) - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.DependsOnlyOnWindow
-
Returns the output timestamp to use for data depending on the given
inputTimestamp in the specified window.
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.FixedWindows
-
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.PartitioningWindowFn
-
Returns the single window to which elements with this timestamp belong.
- assignWindows(WindowFn<Object, GlobalWindow>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindows
-
- assignWindows(WindowFn<Object, W>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.InvalidWindows
-
- assignWindows(WindowFn<T, W>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.PartitioningWindowFn
-
- assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.Sessions
-
- assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- assignWindows(WindowFn<T, W>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn
-
Given a timestamp and element, returns the set of windows into which it
should be placed.
- asSingleton() - Static method in class org.apache.beam.sdk.transforms.View
-
- asSingletonView() - Method in class org.apache.beam.sdk.transforms.Combine.Globally
-
Returns a
PTransform that produces a
PCollectionView
whose elements are the result of combining elements per-window in
the input
PCollection.
- asV1Beta1Path() - Method in class org.apache.beam.sdk.io.PubsubIO.PubsubSubscription
-
- asV1Beta1Path() - Method in class org.apache.beam.sdk.io.PubsubIO.PubsubTopic
-
- asV1Beta2Path() - Method in class org.apache.beam.sdk.io.PubsubIO.PubsubSubscription
-
- asV1Beta2Path() - Method in class org.apache.beam.sdk.io.PubsubIO.PubsubTopic
-
- AtomicCoder<T> - Class in org.apache.beam.sdk.coders
-
- AtomicCoder() - Constructor for class org.apache.beam.sdk.coders.AtomicCoder
-
- AvroCoder<T> - Class in org.apache.beam.sdk.coders
-
A
Coder using Avro binary format.
- AvroCoder(Class<T>, Schema) - Constructor for class org.apache.beam.sdk.coders.AvroCoder
-
- AvroIO - Class in org.apache.beam.sdk.io
-
- AvroIO.Read - Class in org.apache.beam.sdk.io
-
A root
PTransform that reads from an Avro file (or multiple Avro
files matching a pattern) and returns a
PCollection containing
the decoding of each record.
- AvroIO.Read.Bound<T> - Class in org.apache.beam.sdk.io
-
A
PTransform that reads from an Avro file (or multiple Avro
files matching a pattern) and returns a bounded
PCollection containing
the decoding of each record.
- AvroIO.Write - Class in org.apache.beam.sdk.io
-
A root
PTransform that writes a
PCollection to an Avro file (or
multiple Avro files matching a sharding pattern).
- AvroIO.Write.Bound<T> - Class in org.apache.beam.sdk.io
-
A
PTransform that writes a bounded
PCollection to an Avro file (or
multiple Avro files matching a sharding pattern).
- AvroReader(AvroSource<T>) - Constructor for class org.apache.beam.sdk.io.AvroSource.AvroReader
-
Reads Avro records of type T from the specified source.
- AvroSource<T> - Class in org.apache.beam.sdk.io
-
- AvroSource.AvroReader<T> - Class in org.apache.beam.sdk.io
-
- CalendarWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A collection of
WindowFns that windows values into calendar-based
windows such as spans of days, months, or years.
- CalendarWindows() - Constructor for class org.apache.beam.sdk.transforms.windowing.CalendarWindows
-
- CalendarWindows.DaysWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn that windows elements into periods measured by days.
- CalendarWindows.MonthsWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn that windows elements into periods measured by months.
- CalendarWindows.YearsWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn that windows elements into periods measured by years.
- CannotProvideCoderException - Exception in org.apache.beam.sdk.coders
-
- CannotProvideCoderException(String) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(String, CannotProvideCoderException.ReasonCode) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(String, Throwable) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(String, Throwable, CannotProvideCoderException.ReasonCode) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(Throwable) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(Throwable, CannotProvideCoderException.ReasonCode) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException.ReasonCode - Enum in org.apache.beam.sdk.coders
-
Indicates the reason that
Coder inference failed.
- clear(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- clear(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- clear(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.DefaultTrigger
-
- clear(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
Clear any state associated with this trigger in the given window.
- clearOutputElements() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Clears the record of the elements output so far to the main output.
- clearSideOutputElements(TupleTag<T>) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Clears the record of the elements output so far to the side
output with the given tag.
- cloneAs(Class<T>) - Method in interface org.apache.beam.sdk.options.PipelineOptions
-
Makes a deep clone of this object, and transforms the cloned object into the specified
type kls.
- close() - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriter
-
Closes the channel and return the bundle result.
- close() - Method in class org.apache.beam.sdk.io.FileBasedSource.FileBasedReader
-
- close() - Method in class org.apache.beam.sdk.io.Sink.Writer
-
Finishes writing the bundle.
- close() - Method in class org.apache.beam.sdk.io.Source.Reader
-
Closes the reader.
- Coder<T> - Interface in org.apache.beam.sdk.coders
-
A
Coder<T> defines how to encode and decode values of type
T into
byte streams.
- Coder.Context - Class in org.apache.beam.sdk.coders
-
The context in which encoding or decoding is being done.
- Coder.NonDeterministicException - Class in org.apache.beam.sdk.coders
-
Exception thrown by
Coder.verifyDeterministic() if the encoding is
not deterministic, including details of why the encoding is not deterministic.
- coderAllowsEncoding(Coder<T>, String) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderConsistentWithEquals(Coder<T>, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderConsistentWithEqualsInContext(Coder<T>, Coder.Context, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderDecodeEncodeContentsEqual(Coder<CollectionT>, CollectionT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<Collection<T>>,
and value of type Collection<T>, encoding followed by decoding yields an
equal value of type Collection<T>, in any Coder.Context.
- coderDecodeEncodeContentsEqualInContext(Coder<CollectionT>, Coder.Context, CollectionT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<Collection<T>>,
and value of type Collection<T>, encoding followed by decoding yields an
equal value of type Collection<T>, in the given Coder.Context.
- coderDecodeEncodeContentsInSameOrder(Coder<IterableT>, IterableT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<Collection<T>>,
and value of type Collection<T>, encoding followed by decoding yields an
equal value of type Collection<T>, in any Coder.Context.
- coderDecodeEncodeContentsInSameOrderInContext(Coder<IterableT>, Coder.Context, IterableT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<Iterable<T>>,
and value of type Iterable<T>, encoding followed by decoding yields an
equal value of type Collection<T>, in the given Coder.Context.
- coderDecodeEncodeEqual(Coder<T>, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>,
and value of type T, encoding followed by decoding yields an
equal value of type T, in any Coder.Context.
- coderDecodeEncodeEqualInContext(Coder<T>, Coder.Context, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>, Coder.Context,
and value of type T, encoding followed by decoding yields an
equal value of type T.
- coderDecodesBase64(Coder<T>, String, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderDecodesBase64(Coder<T>, List<String>, List<T>) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderDecodesBase64ContentsEqual(Coder<IterableT>, String, IterableT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderDecodesBase64ContentsEqual(Coder<IterableT>, List<String>, List<IterableT>) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderDeterministic(Coder<T>, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>, and values of
type T, if the values are equal then the encoded bytes are equal, in any
Coder.Context.
- coderDeterministicInContext(Coder<T>, Coder.Context, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>, Coder.Context, and values of
type T, if the values are equal then the encoded bytes are equal.
- coderEncodesBase64(Coder<T>, T, String) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderEncodesBase64(Coder<T>, List<T>, List<String>) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- CoderException - Exception in org.apache.beam.sdk.coders
-
An
Exception thrown if there is a problem encoding or decoding a value.
- CoderException(String) - Constructor for exception org.apache.beam.sdk.coders.CoderException
-
- CoderException(String, Throwable) - Constructor for exception org.apache.beam.sdk.coders.CoderException
-
- CoderException(Throwable) - Constructor for exception org.apache.beam.sdk.coders.CoderException
-
- CoderFactories - Class in org.apache.beam.sdk.coders
-
Static utility methods for creating and working with
Coders.
- CoderFactory - Interface in org.apache.beam.sdk.coders
-
- coderHasEncodingId(Coder<T>, String) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- CoderProperties - Class in org.apache.beam.sdk.testing
-
Properties for use in
Coder tests.
- CoderProperties() - Constructor for class org.apache.beam.sdk.testing.CoderProperties
-
- CoderProvider - Interface in org.apache.beam.sdk.coders
-
- coderProvider() - Static method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
- CoderProviders - Class in org.apache.beam.sdk.coders
-
- CoderRegistry - Class in org.apache.beam.sdk.coders
-
A
CoderRegistry allows registering the default
Coder to use for a Java class,
and looking up and instantiating the default
Coder for a Java type.
- CoderRegistry() - Constructor for class org.apache.beam.sdk.coders.CoderRegistry
-
- coderSerializable(Coder<T>) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- CoGbkResult - Class in org.apache.beam.sdk.transforms.join
-
- CoGbkResult(CoGbkResultSchema, Iterable<RawUnionValue>) - Constructor for class org.apache.beam.sdk.transforms.join.CoGbkResult
-
- CoGbkResult(CoGbkResultSchema, Iterable<RawUnionValue>, int) - Constructor for class org.apache.beam.sdk.transforms.join.CoGbkResult
-
- CoGbkResult.CoGbkResultCoder - Class in org.apache.beam.sdk.transforms.join
-
- CoGbkResultSchema - Class in org.apache.beam.sdk.transforms.join
-
- CoGbkResultSchema(TupleTagList) - Constructor for class org.apache.beam.sdk.transforms.join.CoGbkResultSchema
-
Builds a schema from a tuple of TupleTag<?>s.
- CoGroupByKey<K> - Class in org.apache.beam.sdk.transforms.join
-
- CollectionCoder<T> - Class in org.apache.beam.sdk.coders
-
- CollectionCoder(Coder<T>) - Constructor for class org.apache.beam.sdk.coders.CollectionCoder
-
- Combine - Class in org.apache.beam.sdk.transforms
-
PTransforms for combining PCollection elements
globally and per-key.
- combine(Instant, Instant) - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn
-
Combines the given output times, which must be from the same window, into an output time
for a computed value.
- combine(Instant, Instant) - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.Defaults
-
Combines the given output times, which must be from the same window, into an output time
for a computed value.
- combine(Instant, Instant) - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.DependsOnlyOnWindow
-
Combines the given output times, which must be from the same window, into an output time
for a computed value.
- Combine.AccumulatingCombineFn<InputT,AccumT extends Combine.AccumulatingCombineFn.Accumulator<InputT,AccumT,OutputT>,OutputT> - Class in org.apache.beam.sdk.transforms
-
- Combine.AccumulatingCombineFn.Accumulator<InputT,AccumT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
The type of mutable accumulator values used by this
AccumulatingCombineFn.
- Combine.BinaryCombineDoubleFn - Class in org.apache.beam.sdk.transforms
-
An abstract subclass of
Combine.CombineFn for implementing combiners that are more
easily and efficiently expressed as binary operations on
doubles.
- Combine.BinaryCombineFn<V> - Class in org.apache.beam.sdk.transforms
-
An abstract subclass of
Combine.CombineFn for implementing combiners that are more
easily expressed as binary operations.
- Combine.BinaryCombineIntegerFn - Class in org.apache.beam.sdk.transforms
-
An abstract subclass of
Combine.CombineFn for implementing combiners that are more
easily and efficiently expressed as binary operations on
ints
- Combine.BinaryCombineLongFn - Class in org.apache.beam.sdk.transforms
-
An abstract subclass of
Combine.CombineFn for implementing combiners that are more
easily and efficiently expressed as binary operations on
longs.
- Combine.CombineFn<InputT,AccumT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A CombineFn<InputT, AccumT, OutputT> specifies how to combine a
collection of input values of type InputT into a single
output value of type OutputT.
- Combine.Globally<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
Combine.Globally<InputT, OutputT> takes a
PCollection<InputT>
and returns a
PCollection<OutputT> whose elements are the result of
combining all the elements in each window of the input
PCollection,
using a specified
CombineFn<InputT, AccumT, OutputT>.
- Combine.GloballyAsSingletonView<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
Combine.GloballyAsSingletonView<InputT, OutputT> takes a
PCollection<InputT>
and returns a
PCollectionView<OutputT> whose elements are the result of
combining all the elements in each window of the input
PCollection,
using a specified
CombineFn<InputT, AccumT, OutputT>.
- Combine.GroupedValues<K,InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
GroupedValues<K, InputT, OutputT> takes a
PCollection<KV<K, Iterable<InputT>>>, such as the result of
GroupByKey, applies a specified
KeyedCombineFn<K, InputT, AccumT, OutputT>
to each of the input
KV<K, Iterable<InputT>> elements to
produce a combined output
KV<K, OutputT> element, and returns a
PCollection<KV<K, OutputT>> containing all the combined output
elements.
- Combine.Holder<V> - Class in org.apache.beam.sdk.transforms
-
Holds a single value value of type V which may or may not be present.
- Combine.IterableCombineFn<V> - Class in org.apache.beam.sdk.transforms
-
- Combine.KeyedCombineFn<K,InputT,AccumT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A KeyedCombineFn<K, InputT, AccumT, OutputT> specifies how to combine
a collection of input values of type InputT, associated with
a key of type K, into a single output value of type
OutputT.
- Combine.PerKey<K,InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
PerKey<K, InputT, OutputT> takes a
PCollection<KV<K, InputT>>, groups it by key, applies a
combining function to the InputT values associated with each
key to produce a combined OutputT value, and returns a
PCollection<KV<K, OutputT>> representing a map from each
distinct key of the input PCollection to the corresponding
combined value.
- Combine.PerKeyWithHotKeyFanout<K,InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
- Combine.SimpleCombineFn<V> - Class in org.apache.beam.sdk.transforms
-
Deprecated.
- CombineFn() - Constructor for class org.apache.beam.sdk.transforms.Combine.CombineFn
-
- CombineFnBase - Class in org.apache.beam.sdk.transforms
-
This class contains the shared interfaces and abstract classes for different types of combine
functions.
- CombineFnBase() - Constructor for class org.apache.beam.sdk.transforms.CombineFnBase
-
- CombineFnBase.GlobalCombineFn<InputT,AccumT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
A GloballyCombineFn<InputT, AccumT, OutputT> specifies how to combine a
collection of input values of type InputT into a single
output value of type OutputT.
- CombineFnBase.PerKeyCombineFn<K,InputT,AccumT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
A PerKeyCombineFn<K, InputT, AccumT, OutputT> specifies how to combine
a collection of input values of type InputT, associated with
a key of type K, into a single output value of type
OutputT.
- CombineFns - Class in org.apache.beam.sdk.transforms
-
Static utility methods that create combine function instances.
- CombineFns() - Constructor for class org.apache.beam.sdk.transforms.CombineFns
-
- CombineFns.CoCombineResult - Class in org.apache.beam.sdk.transforms
-
A tuple of outputs produced by a composed combine functions.
- CombineFns.ComposeCombineFnBuilder - Class in org.apache.beam.sdk.transforms
-
- CombineFns.ComposedCombineFn<DataT> - Class in org.apache.beam.sdk.transforms
-
- CombineFns.ComposedCombineFnWithContext<DataT> - Class in org.apache.beam.sdk.transforms
-
- CombineFns.ComposedKeyedCombineFn<DataT,K> - Class in org.apache.beam.sdk.transforms
-
- CombineFns.ComposedKeyedCombineFnWithContext<DataT,K> - Class in org.apache.beam.sdk.transforms
-
- CombineFns.ComposeKeyedCombineFnBuilder - Class in org.apache.beam.sdk.transforms
-
- CombineFnWithContext() - Constructor for class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
- combineOutputTimes(OutputTimeFn<?>, Iterable<? extends Instant>) - Static method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFns
-
Applies the given
OutputTimeFn to the given output times, obtaining
the output time for a value computed.
- CombineWithContext - Class in org.apache.beam.sdk.transforms
-
This class contains combine functions that have access to PipelineOptions and side inputs
through CombineWithContext.Context.
- CombineWithContext() - Constructor for class org.apache.beam.sdk.transforms.CombineWithContext
-
- CombineWithContext.CombineFnWithContext<InputT,AccumT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A combine function that has access to PipelineOptions and side inputs through
CombineWithContext.Context.
- CombineWithContext.Context - Class in org.apache.beam.sdk.transforms
-
Information accessible to all methods in CombineFnWithContext
and KeyedCombineFnWithContext.
- CombineWithContext.KeyedCombineFnWithContext<K,InputT,AccumT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A keyed combine function that has access to PipelineOptions and side inputs through
CombineWithContext.Context.
- CombineWithContext.RequiresContextInternal - Interface in org.apache.beam.sdk.transforms
-
An internal interface for signaling that a GloballyCombineFn
or a PerKeyCombineFn needs to access CombineWithContext.Context.
- compact(AccumT) - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Returns an accumulator that represents the same logical value as the
input accumulator, but may have a more compact representation.
- compact(List<V>) - Method in class org.apache.beam.sdk.transforms.Combine.IterableCombineFn
-
- compact(K, AccumT) - Method in class org.apache.beam.sdk.transforms.Combine.KeyedCombineFn
-
Returns an accumulator that represents the same logical value as the
input accumulator, but may have a more compact representation.
- compact(Object[]) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- compact(Object[], CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFnWithContext
-
- compact(K, Object[]) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFn
-
- compact(K, Object[], CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFnWithContext
-
- compact(AccumT, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
Returns an accumulator that represents the same logical value as the
input accumulator, but may have a more compact representation.
- compact(K, AccumT, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.KeyedCombineFnWithContext
-
Returns an accumulator that represents the same logical value as the
input accumulator, but may have a more compact representation.
- compare(T, T) - Method in class org.apache.beam.sdk.transforms.Top.Largest
-
- compare(T, T) - Method in class org.apache.beam.sdk.transforms.Top.Smallest
-
- compare(KV<K, V>, KV<K, V>) - Method in class org.apache.beam.sdk.values.KV.OrderByKey
-
- compare(KV<K, V>, KV<K, V>) - Method in class org.apache.beam.sdk.values.KV.OrderByValue
-
- compareTo(ByteKey) - Method in class org.apache.beam.sdk.io.range.ByteKey
-
- compareTo(IntervalWindow) - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
- compose() - Static method in class org.apache.beam.sdk.transforms.CombineFns
-
- ComposeCombineFnBuilder() - Constructor for class org.apache.beam.sdk.transforms.CombineFns.ComposeCombineFnBuilder
-
- composeKeyed() - Static method in class org.apache.beam.sdk.transforms.CombineFns
-
- ComposeKeyedCombineFnBuilder() - Constructor for class org.apache.beam.sdk.transforms.CombineFns.ComposeKeyedCombineFnBuilder
-
- CompressedReader(CompressedSource<T>, FileBasedSource.FileBasedReader<T>) - Constructor for class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
Create a CompressedReader from a CompressedSource and delegate reader.
- CompressedSource<T> - Class in org.apache.beam.sdk.io
-
A Source that reads from compressed files.
- CompressedSource.CompressedReader<T> - Class in org.apache.beam.sdk.io
-
- CompressedSource.CompressionMode - Enum in org.apache.beam.sdk.io
-
Default compression types supported by the CompressedSource.
- CompressedSource.DecompressingChannelFactory - Interface in org.apache.beam.sdk.io
-
Factory interface for creating channels that decompress the content of an underlying channel.
- computeTargetTimestamp(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BigDecimalCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BigEndianIntegerCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BigEndianLongCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BigIntegerCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.ByteCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.ByteStringCoder
-
- consistentWithEquals() - Method in interface org.apache.beam.sdk.coders.Coder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.DoubleCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.DurationCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.InstantCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.KvCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.NullableCoder
-
NullableCoder is consistent with equals if the nested Coder is.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.StandardCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.StringUtf8Coder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.VarIntCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.VarLongCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.VoidCoder
-
- contains(IntervalWindow) - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
Returns whether this window contains the given window.
- containsInAnyOrder(T...) - Method in interface org.apache.beam.sdk.testing.PAssert.IterableAssert
-
Asserts that the iterable in question contains the provided elements.
- containsInAnyOrder(Iterable<T>) - Method in interface org.apache.beam.sdk.testing.PAssert.IterableAssert
-
Asserts that the iterable in question contains the provided elements.
- containsKey(ByteKey) - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
Returns
true if the specified
ByteKey is contained within this range.
- Context(boolean) - Constructor for class org.apache.beam.sdk.coders.Coder.Context
-
- Context() - Constructor for class org.apache.beam.sdk.transforms.CombineWithContext.Context
-
- Context() - Constructor for class org.apache.beam.sdk.transforms.DoFn.Context
-
- Context() - Constructor for class org.apache.beam.sdk.transforms.DoFnWithContext.Context
-
- convertToArgs(PipelineOptions) - Static method in class org.apache.beam.sdk.testing.TestPipeline
-
- copyFrom(byte[]) - Static method in class org.apache.beam.sdk.io.range.ByteKey
-
Creates a new
ByteKey backed by a copy of the specified
byte[].
- copyToOutputFiles(List<String>, PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Copy temporary files to final output filenames using the file naming template.
- Count - Class in org.apache.beam.sdk.transforms
-
- Count.PerElement<T> - Class in org.apache.beam.sdk.transforms
-
Count.PerElement<T> takes a PCollection<T> and returns a
PCollection<KV<T, Long>> representing a map from each distinct element of the input
PCollection to the number of times that element occurs in the input.
- CounterMark(long, Instant) - Constructor for class org.apache.beam.sdk.io.CountingSource.CounterMark
-
Creates a checkpoint mark reflecting the last emitted value.
- CountingInput - Class in org.apache.beam.sdk.io
-
- CountingInput() - Constructor for class org.apache.beam.sdk.io.CountingInput
-
- CountingInput.BoundedCountingInput - Class in org.apache.beam.sdk.io
-
A
PTransform that will produce a specified number of
Longs starting from
0.
- CountingInput.UnboundedCountingInput - Class in org.apache.beam.sdk.io
-
- CountingSource - Class in org.apache.beam.sdk.io
-
A source that produces longs.
- CountingSource.CounterMark - Class in org.apache.beam.sdk.io
-
The checkpoint for an unbounded
CountingSource is simply the last value produced.
- CrashingRunner - Class in org.apache.beam.sdk.testing
-
- CrashingRunner() - Constructor for class org.apache.beam.sdk.testing.CrashingRunner
-
- create(List<? extends Coder<?>>) - Method in interface org.apache.beam.sdk.coders.CoderFactory
-
Returns a Coder<?>, given argument coder to use for
values of a particular type, given the Coders for each of
the type's generic parameter types.
- create(PipelineOptions) - Method in interface org.apache.beam.sdk.options.DefaultValueFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.GcpOptions.CredentialDirFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.GcpOptions.DefaultProjectFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.GcpOptions.GcpTempLocationFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.GcpOptions.GcpUserCredentialsFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.GcsOptions.ExecutorServiceFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.PipelineOptions.DirectRunner
-
- create() - Method in class org.apache.beam.sdk.options.PipelineOptionsFactory.Builder
-
Creates and returns an object that implements
PipelineOptions using the values
configured on this builder during construction.
- create() - Static method in class org.apache.beam.sdk.options.PipelineOptionsFactory
-
- create(PipelineOptions) - Static method in class org.apache.beam.sdk.Pipeline
-
Constructs a pipeline from the provided options.
- create() - Static method in class org.apache.beam.sdk.testing.TestPipeline
-
Creates and returns a new test pipeline.
- create(PipelineOptions) - Method in class org.apache.beam.sdk.testing.TestPipelineOptions.AlwaysPassMatcherFactory
-
- create(int, ComparatorT) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
Returns an approximate quantiles combiner with the given
compareFn and desired number of quantiles.
- create(int) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
- create(int, ComparatorT, long, double) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
Creates an approximate quantiles combiner with the given
compareFn and desired number of quantiles.
- Create<T> - Class in org.apache.beam.sdk.transforms
-
Create<T> takes a collection of elements of type T
known when the pipeline is constructed and returns a
PCollection<T> containing the elements.
- Create() - Constructor for class org.apache.beam.sdk.transforms.Create
-
- create() - Static method in class org.apache.beam.sdk.transforms.GroupByKey
-
Returns a GroupByKey<K, V> PTransform.
- create() - Static method in class org.apache.beam.sdk.transforms.join.CoGroupByKey
-
Returns a CoGroupByKey<K> PTransform.
- create() - Static method in class org.apache.beam.sdk.transforms.Keys
-
Returns a Keys<K> PTransform.
- create() - Static method in class org.apache.beam.sdk.transforms.KvSwap
-
Returns a KvSwap<K, V> PTransform.
- create() - Static method in class org.apache.beam.sdk.transforms.RemoveDuplicates
-
Returns a RemoveDuplicates<T> PTransform.
- create() - Static method in class org.apache.beam.sdk.transforms.Values
-
Returns a Values<V> PTransform.
- Create.TimestampedValues<T> - Class in org.apache.beam.sdk.transforms
-
A PTransform that creates a PCollection whose elements have
associated timestamps.
- Create.Values<T> - Class in org.apache.beam.sdk.transforms
-
A PTransform that creates a PCollection from a set of in-memory objects.
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Returns a new, mutable accumulator value, representing the accumulation of zero input values.
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.IterableCombineFn
-
- createAccumulator(K) - Method in class org.apache.beam.sdk.transforms.Combine.KeyedCombineFn
-
Returns a new, mutable accumulator value representing the accumulation of zero input values.
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- createAccumulator(CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFnWithContext
-
- createAccumulator(K) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFn
-
- createAccumulator(K, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFnWithContext
-
- createAccumulator(CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
Returns a new, mutable accumulator value, representing the accumulation of zero input values.
- createAccumulator(K, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.KeyedCombineFnWithContext
-
Returns a new, mutable accumulator value representing the accumulation of zero input values.
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Sample.FixedSizedSampleFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Top.TopCombineFn
-
- createAggregator(String, Combine.CombineFn<? super AggInputT, ?, AggOutputT>) - Method in class org.apache.beam.sdk.transforms.DoFn
-
- createAggregator(String, SerializableFunction<Iterable<AggInputT>, AggInputT>) - Method in class org.apache.beam.sdk.transforms.DoFn
-
- createAggregator(String, Combine.CombineFn<? super AggInputT, ?, AggOutputT>) - Method in class org.apache.beam.sdk.transforms.DoFnWithContext
-
- createAggregator(String, SerializableFunction<Iterable<AggInputT>, AggInputT>) - Method in class org.apache.beam.sdk.transforms.DoFnWithContext
-
- createAggregatorInternal(String, Combine.CombineFn<AggInputT, ?, AggOutputT>) - Method in class org.apache.beam.sdk.transforms.DoFn.Context
-
- createDatumReader() - Method in class org.apache.beam.sdk.coders.AvroCoder
-
- createDatumWriter() - Method in class org.apache.beam.sdk.coders.AvroCoder
-
- createDecompressingChannel(ReadableByteChannel) - Method in enum org.apache.beam.sdk.io.CompressedSource.CompressionMode
-
- createDecompressingChannel(ReadableByteChannel) - Method in interface org.apache.beam.sdk.io.CompressedSource.DecompressingChannelFactory
-
Given a channel, create a channel that decompresses the content read from the channel.
- createForSubrangeOfFile(String, long, long) - Method in class org.apache.beam.sdk.io.AvroSource
-
- createForSubrangeOfFile(String, long, long) - Method in class org.apache.beam.sdk.io.BlockBasedSource
-
Creates a BlockBasedSource for the specified range in a single file.
- createForSubrangeOfFile(String, long, long) - Method in class org.apache.beam.sdk.io.CompressedSource
-
Creates a CompressedSource for a subrange of a file.
- createForSubrangeOfFile(String, long, long) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
Creates and returns a new FileBasedSource of the same type as the current
FileBasedSource backed by a given file and an offset range.
- createForSubrangeOfFile(String, long, long) - Method in class org.apache.beam.sdk.io.XmlSource
-
- createPane(boolean, boolean, PaneInfo.Timing) - Static method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
- createPane(boolean, boolean, PaneInfo.Timing, long, long) - Static method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
Factory method to create a
PaneInfo with the specified parameters.
- createPrimitiveOutputInternal(Pipeline, WindowingStrategy<?, ?>, PCollection.IsBounded) - Static method in class org.apache.beam.sdk.values.PCollection
-
Creates and returns a new
PCollection for a primitive output.
- createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.BoundedSource
-
- createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- createReader(PipelineOptions, CheckpointMarkT) - Method in class org.apache.beam.sdk.io.UnboundedSource
-
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.AvroSource
-
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.BlockBasedSource
-
Creates a BlockBasedReader.
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.CompressedSource
-
Creates a FileBasedReader to read a single file.
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
Creates and returns an instance of a FileBasedReader implementation for the current
source assuming the source represents a single file.
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.XmlSource
-
- createSourceForSubrange(long, long) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- createSourceForSubrange(long, long) - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
- createStructuralValues(Coder<T>, List<T>) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Testing utilities below depend on standard assertions and matchers to compare elements read by
sources.
- createWriteOperation(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSink
-
- createWriteOperation(PipelineOptions) - Method in class org.apache.beam.sdk.io.Sink
-
- createWriteOperation(PipelineOptions) - Method in class org.apache.beam.sdk.io.XmlSink.Bound
-
- createWriter(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
- createWriter(PipelineOptions) - Method in class org.apache.beam.sdk.io.Sink.WriteOperation
-
Creates a new
Sink.Writer to write a bundle of the input to the sink.
- createWriter(PipelineOptions) - Method in class org.apache.beam.sdk.io.XmlSink.XmlWriteOperation
-
- CredentialDirFactory() - Constructor for class org.apache.beam.sdk.options.GcpOptions.CredentialDirFactory
-
- currentEventTime() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.TriggerContext
-
The current event time for the input or null if unknown.
- currentProcessingTime() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.TriggerContext
-
The current processing time.
- currentSynchronizedProcessingTime() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.TriggerContext
-
The current synchronized upstream processing time or null if unknown.
- CustomCoder<T> - Class in org.apache.beam.sdk.coders
-
An abstract base class for writing a
Coder class that encodes itself via Java
serialization.
- CustomCoder() - Constructor for class org.apache.beam.sdk.coders.CustomCoder
-
- days(int) - Static method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows
-
Returns a
WindowFn that windows elements into periods measured by days.
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.AvroCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigDecimalCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigEndianIntegerCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigEndianLongCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigIntegerCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteArrayCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteStringCoder
-
- decode(InputStream, Coder.Context) - Method in interface org.apache.beam.sdk.coders.Coder
-
Decodes a value of type T from the given input stream in
the given context.
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.DelegateCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.DoubleCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.DurationCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.InstantCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.IterableLikeCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.JAXBCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.KvCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.MapCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.NullableCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.SerializableCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.StringDelegateCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.StringUtf8Coder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.TableRowJsonCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.TextualIntegerCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.VarIntCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.VarLongCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.VoidCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.transforms.join.UnionCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindow.Coder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.transforms.windowing.PaneInfo.PaneInfoCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.values.TimestampedValue.TimestampedValueCoder
-
- decodePane(byte) - Static method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.CollectionCoder
-
Builds an instance of
IterableT, this coder's associated
Iterable-like
subtype, from a list of decoded elements.
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.IterableCoder
-
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.IterableLikeCoder
-
Builds an instance of
IterableT, this coder's associated
Iterable-like
subtype, from a list of decoded elements.
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.ListCoder
-
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.SetCoder
-
Builds an instance of
IterableT, this coder's associated
Iterable-like
subtype, from a list of decoded elements.
- Default - Annotation Type in org.apache.beam.sdk.options
-
Default represents a set of annotations that can be used to annotate getter properties
on
PipelineOptions with information representing the default value to be returned
if no value is specified.
- Default.Boolean - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified boolean primitive value.
- Default.Byte - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified byte primitive value.
- Default.Character - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified char primitive value.
- Default.Class - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified
Class value.
- Default.Double - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified double primitive value.
- Default.Enum - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified enum.
- Default.Float - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified float primitive value.
- Default.InstanceFactory - Annotation Type in org.apache.beam.sdk.options
-
- Default.Integer - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified int primitive value.
- Default.Long - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified long primitive value.
- Default.Short - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified short primitive value.
- Default.String - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified
String
value.
- DEFAULT_MAX_NUM_ELEMENTS - Static variable in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
The cost (in time and space) to compute quantiles to a given
accuracy is a function of the total number of elements in the
data set.
- DEFAULT_PUBSUB_CODER - Static variable in class org.apache.beam.sdk.io.PubsubIO
-
The default
Coder used to translate to/from Cloud Pub/Sub messages.
- DEFAULT_TEXT_CODER - Static variable in class org.apache.beam.sdk.io.TextIO
-
The default coder, which returns each line of the input file as a string.
- DefaultCoder - Annotation Type in org.apache.beam.sdk.coders
-
The
DefaultCoder annotation
specifies a default
Coder class to handle encoding and decoding
instances of the annotated class.
- DefaultPipelineOptionsRegistrar - Class in org.apache.beam.sdk.options
-
A registrar containing the default SDK options.
- DefaultPipelineOptionsRegistrar() - Constructor for class org.apache.beam.sdk.options.DefaultPipelineOptionsRegistrar
-
- DefaultProjectFactory() - Constructor for class org.apache.beam.sdk.options.GcpOptions.DefaultProjectFactory
-
- Defaults() - Constructor for class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults
-
- Defaults() - Constructor for class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.Defaults
-
- DefaultTrigger - Class in org.apache.beam.sdk.transforms.windowing
-
A trigger that is equivalent to Repeatedly.forever(AfterWatermark.pastEndOfWindow()).
- defaultValue() - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Returns the default value when there are no values added to the accumulator.
- defaultValue() - Method in interface org.apache.beam.sdk.transforms.CombineFnBase.GlobalCombineFn
-
Returns the default value when there are no values added to the accumulator.
- defaultValue() - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
- defaultValue() - Method in class org.apache.beam.sdk.transforms.View.AsSingleton
-
Returns the default value of this transform, or null if there isn't one.
- DefaultValueFactory<T> - Interface in org.apache.beam.sdk.options
-
- DELAYED_UNTIL_TAG - Static variable in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- DelegateCoder<T,IntermediateT> - Class in org.apache.beam.sdk.coders
-
A
DelegateCoder<T, IntermediateT> wraps a
Coder for
IntermediateT and
encodes/decodes values of type
T by converting
to/from
IntermediateT and then encoding/decoding using the underlying
Coder<IntermediateT>.
- DelegateCoder(Coder<IntermediateT>, DelegateCoder.CodingFunction<T, IntermediateT>, DelegateCoder.CodingFunction<IntermediateT, T>) - Constructor for class org.apache.beam.sdk.coders.DelegateCoder
-
- DelegateCoder.CodingFunction<InputT,OutputT> - Interface in org.apache.beam.sdk.coders
-
- deleteTimer(Instant, TimeDomain) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.TriggerContext
-
Removes the timer set in this trigger context for the given
Instant
and
TimeDomain.
- dependsOnlyOnEarliestInputTimestamp() - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.Defaults
-
Returns true if the result of combination of many output timestamps actually depends
only on the earliest.
- dependsOnlyOnEarliestInputTimestamp() - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn
-
Returns true if the result of combination of many output timestamps actually depends
only on the earliest.
- dependsOnlyOnEarliestInputTimestamp() - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.DependsOnlyOnWindow
-
Returns true if the result of combination of many output timestamps actually depends
only on the earliest.
- dependsOnlyOnWindow() - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.Defaults
-
Returns true if the result does not depend on what outputs were combined but only
the window they are in.
- dependsOnlyOnWindow() - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn
-
Returns true if the result does not depend on what outputs were combined but only
the window they are in.
- DependsOnlyOnWindow() - Constructor for class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.DependsOnlyOnWindow
-
- dependsOnlyOnWindow() - Method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFn.DependsOnlyOnWindow
-
Returns true if the result does not depend on what outputs were combined but only
the window they are in.
- describeTo(Description) - Method in class org.apache.beam.sdk.testing.TestPipelineOptions.AlwaysPassMatcher
-
- Description - Annotation Type in org.apache.beam.sdk.options
-
Descriptions are used to generate human readable output when the --help
command is specified.
- DeterministicStandardCoder<T> - Class in org.apache.beam.sdk.coders
-
- DeterministicStandardCoder() - Constructor for class org.apache.beam.sdk.coders.DeterministicStandardCoder
-
- DIRECTORY_CONTAINER - Static variable in class org.apache.beam.sdk.io.ShardNameTemplate
-
Shard is a file within a directory.
- DirectRunner() - Constructor for class org.apache.beam.sdk.options.PipelineOptions.DirectRunner
-
- discardingFiredPanes() - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
Returns a new Window PTransform that uses the registered WindowFn and
Triggering behavior, and that discards elements in a pane after they are triggered.
- discardingFiredPanes() - Static method in class org.apache.beam.sdk.transforms.windowing.Window
-
Returns a new Window PTransform that uses the registered WindowFn and
Triggering behavior, and that discards elements in a pane after they are triggered.
- discardingFiredPanes() - Method in class org.apache.beam.sdk.transforms.windowing.Window.Unbound
-
Returns a new Window PTransform that uses the registered WindowFn and
Triggering behavior, and that discards elements in a pane after they are triggered.
- DisplayData - Class in org.apache.beam.sdk.transforms.display
-
Static display data associated with a pipeline component.
- DisplayData.Builder - Interface in org.apache.beam.sdk.transforms.display
-
Utility to build up display data from a component and its included
subcomponents.
- DisplayData.Identifier - Class in org.apache.beam.sdk.transforms.display
-
Unique identifier for a display data item within a component.
- DisplayData.Item<T> - Class in org.apache.beam.sdk.transforms.display
-
Items are the unit of display data.
- DisplayData.Type - Enum in org.apache.beam.sdk.transforms.display
-
Display data type.
- DoFn<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
The argument to
ParDo providing the code to use to process
elements of the input
PCollection.
- DoFn() - Constructor for class org.apache.beam.sdk.transforms.DoFn
-
- DoFn.Context - Class in org.apache.beam.sdk.transforms
-
Information accessible to all methods in this DoFn.
- DoFn.ProcessContext - Class in org.apache.beam.sdk.transforms
-
- DoFn.RequiresWindowAccess - Interface in org.apache.beam.sdk.transforms
-
- DoFnReflector - Class in org.apache.beam.sdk.transforms
-
Utility implementing the necessary reflection for working with
DoFnWithContexts.
- DoFnReflector() - Constructor for class org.apache.beam.sdk.transforms.DoFnReflector
-
- DoFnReflector.DoFnInvoker<InputT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
Interface for invoking the DoFn processing methods.
- DoFnTester<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A harness for unit-testing a
DoFn.
- DoFnTester.CloningBehavior - Enum in org.apache.beam.sdk.transforms
-
- DoFnWithContext<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
The argument to
ParDo providing the code to use to process
elements of the input
PCollection.
- DoFnWithContext() - Constructor for class org.apache.beam.sdk.transforms.DoFnWithContext
-
- DoFnWithContext.Context - Class in org.apache.beam.sdk.transforms
-
Information accessible to all methods in this DoFnWithContext.
- DoFnWithContext.ExtraContextFactory<InputT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
Interface for runner implementors to provide implementations of extra context information.
- DoFnWithContext.FinishBundle - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method to use to prepare an instance for processing a batch of elements.
- DoFnWithContext.ProcessContext - Class in org.apache.beam.sdk.transforms
-
- DoFnWithContext.ProcessElement - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method to use for processing elements.
- DoFnWithContext.StartBundle - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method to use to prepare an instance for processing a batch of elements.
- DoubleCoder - Class in org.apache.beam.sdk.coders
-
- doubles() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- doublesGlobally() - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform that takes an input PCollection<Double> and returns a
PCollection<Double> whose contents is the maximum of the input PCollection's
elements, or Double.NEGATIVE_INFINITY if there are no elements.
- doublesGlobally() - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform that takes an input PCollection<Double> and returns a
PCollection<Double> whose contents is the minimum of the input PCollection's
elements, or Double.POSITIVE_INFINITY if there are no elements.
- doublesGlobally() - Static method in class org.apache.beam.sdk.transforms.Sum
-
Returns a PTransform that takes an input
PCollection<Double> and returns a
PCollection<Double> whose contents is the sum of the
input PCollection's elements, or
0 if there are no elements.
- doublesPerKey() - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform that takes an input PCollection<KV<K, Double>> and returns
a PCollection<KV<K, Double>> that contains an output element mapping each distinct key
in the input PCollection to the maximum of the values associated with that key in the
input PCollection.
- doublesPerKey() - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform that takes an input PCollection<KV<K, Double>> and returns
a PCollection<KV<K, Double>> that contains an output element mapping each distinct key
in the input PCollection to the minimum of the values associated with that key in the
input PCollection.
- doublesPerKey() - Static method in class org.apache.beam.sdk.transforms.Sum
-
Returns a PTransform that takes an input
PCollection<KV<K, Double>> and returns a
PCollection<KV<K, Double>> that contains an output
element mapping each distinct key in the input
PCollection to the sum of the values associated with
that key in the input PCollection.
- DurationCoder - Class in org.apache.beam.sdk.coders
-
- FAILURE_COUNTER - Static variable in class org.apache.beam.sdk.testing.PAssert
-
- fewKeys() - Method in class org.apache.beam.sdk.transforms.GroupByKey
-
Returns whether it groups just few keys.
- FileBasedReader(FileBasedSource<T>) - Constructor for class org.apache.beam.sdk.io.FileBasedSource.FileBasedReader
-
Subclasses should not perform IO operations at the constructor.
- FileBasedSink<T> - Class in org.apache.beam.sdk.io
-
Abstract
Sink for file-based output.
- FileBasedSink(String, String) - Constructor for class org.apache.beam.sdk.io.FileBasedSink
-
Construct a FileBasedSink with the given base output filename and extension.
- FileBasedSink(String, String, String) - Constructor for class org.apache.beam.sdk.io.FileBasedSink
-
Construct a FileBasedSink with the given base output filename, extension, and file naming
template.
- FileBasedSink.FileBasedWriteOperation<T> - Class in org.apache.beam.sdk.io
-
- FileBasedSink.FileBasedWriteOperation.TemporaryFileRetention - Enum in org.apache.beam.sdk.io
-
Options for handling of temporary output files.
- FileBasedSink.FileBasedWriter<T> - Class in org.apache.beam.sdk.io
-
- FileBasedSink.FileResult - Class in org.apache.beam.sdk.io
-
Result of a single bundle write.
- FileBasedSource<T> - Class in org.apache.beam.sdk.io
-
A common base class for all file-based
Sources.
- FileBasedSource(String, long) - Constructor for class org.apache.beam.sdk.io.FileBasedSource
-
Create a FileBaseSource based on a file or a file pattern specification.
- FileBasedSource(String, long, long, long) - Constructor for class org.apache.beam.sdk.io.FileBasedSource
-
Create a FileBasedSource based on a single file.
- FileBasedSource.FileBasedReader<T> - Class in org.apache.beam.sdk.io
-
A
reader that implements code common to readers of
FileBasedSources.
- FileBasedSource.Mode - Enum in org.apache.beam.sdk.io
-
A given FileBasedSource represents a file resource of one of these types.
- FileBasedWriteOperation(FileBasedSink<T>) - Constructor for class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Construct a FileBasedWriteOperation using the same base filename for both temporary and
output files.
- FileBasedWriteOperation(FileBasedSink<T>, String) - Constructor for class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Construct a FileBasedWriteOperation.
- FileBasedWriteOperation(FileBasedSink<T>, String, FileBasedSink.FileBasedWriteOperation.TemporaryFileRetention) - Constructor for class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Create a new FileBasedWriteOperation.
- FileBasedWriter(FileBasedSink.FileBasedWriteOperation<T>) - Constructor for class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriter
-
Construct a new FileBasedWriter with a base filename.
- fileNamingTemplate - Variable in class org.apache.beam.sdk.io.FileBasedSink
-
Naming template for output files.
- FileResult(String) - Constructor for class org.apache.beam.sdk.io.FileBasedSink.FileResult
-
- Filter<T> - Class in org.apache.beam.sdk.transforms
-
PTransforms for filtering from a PCollection the
elements satisfying a predicate, or satisfying an inequality with
a given value based on the elements' natural ordering.
- finalize(Iterable<FileBasedSink.FileResult>, PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Finalizes writing by copying temporary output files to their final location and optionally
removing temporary files.
- finalize(Iterable<WriteT>, PipelineOptions) - Method in class org.apache.beam.sdk.io.Sink.WriteOperation
-
Given an Iterable of results from bundle writes, performs finalization after writing and
closes the sink.
- finalizeCheckpoint() - Method in class org.apache.beam.sdk.io.CountingSource.CounterMark
-
- finalizeCheckpoint() - Method in interface org.apache.beam.sdk.io.UnboundedSource.CheckpointMark
-
Called by the system to signal that this checkpoint mark has been committed along with
all the records which have been read from the
UnboundedSource.UnboundedReader since the
previous checkpoint was taken.
- finishBundle(DoFn<T, Void>.Context) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound.PubsubBoundedWriter
-
- finishBundle(DoFn<InputT, OutputT>.Context) - Method in class org.apache.beam.sdk.transforms.DoFn
-
Finishes processing this batch of elements.
- finishBundle() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- finishBundle(DoFn<InputT, OutputT>.Context) - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
-
- finishedInAllMergingWindows() - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.MergingTriggerInfo
-
Return true if the trigger is finished in all windows being merged.
- finishedInAnyMergingWindow() - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.MergingTriggerInfo
-
Return true if the trigger is finished in any window being merged.
- finishSpecifying() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Finish specifying a transform.
- finishSpecifying() - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
- finishSpecifying() - Method in class org.apache.beam.sdk.values.PBegin
-
- finishSpecifying() - Method in class org.apache.beam.sdk.values.PCollectionList
-
- finishSpecifying() - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- finishSpecifying() - Method in interface org.apache.beam.sdk.values.PInput
-
After building, finalizes this
PInput to make it ready for
being used as an input to a
PTransform.
- finishSpecifying() - Method in class org.apache.beam.sdk.values.PValueBase
-
- finishSpecifying() - Method in class org.apache.beam.sdk.values.TypedPValue
-
After building, finalizes this
PValue to make it ready for
running.
- finishSpecifyingOutput() - Method in class org.apache.beam.sdk.values.PCollectionList
-
- finishSpecifyingOutput() - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- finishSpecifyingOutput() - Method in interface org.apache.beam.sdk.values.POutput
-
As part of applying the producing
PTransform, finalizes this
output to make it ready for being used as an input and for running.
- finishSpecifyingOutput() - Method in class org.apache.beam.sdk.values.POutputValueBase
-
- firstOf(CoderProvider...) - Static method in class org.apache.beam.sdk.coders.CoderProviders
-
Returns a
CoderProvider that consults each of the provider
coderProviders
and returns the first
Coder provided.
- firstUnfinishedSubTrigger() - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.TriggerInfo
-
Returns the first unfinished sub-trigger.
- fixedSizeGlobally(int) - Static method in class org.apache.beam.sdk.transforms.Sample
-
Returns a PTransform that takes a PCollection<T>,
selects sampleSize elements, uniformly at random, and returns a
PCollection<Iterable<T>> containing the selected elements.
- fixedSizePerKey(int) - Static method in class org.apache.beam.sdk.transforms.Sample
-
Returns a PTransform that takes an input
PCollection<KV<K, V>> and returns a
PCollection<KV<K, Iterable<V>>> that contains an output
element mapping each distinct key in the input
PCollection to a sample of sampleSize values
associated with that key in the input PCollection, taken
uniformly at random.
- FixedWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn that windows values into fixed-size timestamp-based windows.
- FlatMapElements<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
PTransforms for mapping a simple function that returns iterables over the elements of a
PCollection and merging the results.
- FlatMapElements.MissingOutputTypeDescriptor<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
- Flatten - Class in org.apache.beam.sdk.transforms
-
Flatten<T> takes multiple PCollection<T>s bundled
into a PCollectionList<T> and returns a single
PCollection<T> containing all the elements in all the input
PCollections.
- Flatten() - Constructor for class org.apache.beam.sdk.transforms.Flatten
-
- Flatten.FlattenIterables<T> - Class in org.apache.beam.sdk.transforms
-
FlattenIterables<T> takes a PCollection<Iterable<T>> and returns a
PCollection<T> that contains all the elements from each iterable.
- Flatten.FlattenPCollectionList<T> - Class in org.apache.beam.sdk.transforms
-
- FlattenIterables() - Constructor for class org.apache.beam.sdk.transforms.Flatten.FlattenIterables
-
- floats() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- forCoder(Coder<T>) - Static method in class org.apache.beam.sdk.coders.CoderFactories
-
- forever(Trigger) - Static method in class org.apache.beam.sdk.transforms.windowing.Repeatedly
-
Create a composite trigger that repeatedly executes the trigger repeated, firing each
time it fires and ignoring any indications to finish.
- forKey(K, Coder<K>) - Method in class org.apache.beam.sdk.transforms.Combine.KeyedCombineFn
-
- forKey(K, Coder<K>) - Method in interface org.apache.beam.sdk.transforms.CombineFnBase.PerKeyCombineFn
-
- forKey(K, Coder<K>) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.KeyedCombineFnWithContext
-
- forTrigger(ExecutableTrigger) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.OnElementContext
-
Create an OnElementContext for executing the given trigger.
- forTrigger(ExecutableTrigger) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.OnMergeContext
-
Create an OnMergeContext for executing the given trigger.
- forTrigger(ExecutableTrigger) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.TriggerContext
-
Create a sub-context for the given sub-trigger.
- from(String) - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
Returns a new
PTransform that's like this one but
that reads from the file(s) with the given name or pattern.
- from(String) - Static method in class org.apache.beam.sdk.io.AvroIO.Read
-
Returns a
PTransform that reads from the file(s)
with the given name or pattern.
- from(String) - Static method in class org.apache.beam.sdk.io.AvroSource
-
Creates an
AvroSource that reads from the given file name or pattern ("glob").
- from(FileBasedSource<T>) - Static method in class org.apache.beam.sdk.io.CompressedSource
-
Creates a CompressedSource from an underlying FileBasedSource.
- from(BoundedSource<T>) - Method in class org.apache.beam.sdk.io.Read.Builder
-
Returns a new Read.Bounded PTransform reading from the given
BoundedSource.
- from(UnboundedSource<T, ?>) - Method in class org.apache.beam.sdk.io.Read.Builder
-
Returns a new Read.Unbounded PTransform reading from the given
UnboundedSource.
- from(BoundedSource<T>) - Static method in class org.apache.beam.sdk.io.Read
-
Returns a new Read.Bounded PTransform reading from the given
BoundedSource.
- from(UnboundedSource<T, ?>) - Static method in class org.apache.beam.sdk.io.Read
-
Returns a new Read.Unbounded PTransform reading from the given
UnboundedSource.
- from(String) - Method in class org.apache.beam.sdk.io.TextIO.Read.Bound
-
Returns a new transform for reading from text files that's like this one but
that reads from the file(s) with the given name or pattern.
- from(String) - Static method in class org.apache.beam.sdk.io.TextIO.Read
-
Returns a transform for reading text files that reads from the file(s)
with the given filename or filename pattern.
- from(String) - Static method in class org.apache.beam.sdk.io.XmlSource
-
Creates an XmlSource for a single XML file or a set of XML files defined by a Java "glob" file
pattern.
- from(HasDisplayData) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
- fromArgs(String[]) - Method in class org.apache.beam.sdk.options.PipelineOptionsFactory.Builder
-
Sets the command line arguments to parse when constructing the
PipelineOptions.
- fromArgs(String[]) - Static method in class org.apache.beam.sdk.options.PipelineOptionsFactory
-
Sets the command line arguments to parse when constructing the
PipelineOptions.
- fromIterableInternal(Iterable<WindowedValue<?>>) - Method in interface org.apache.beam.sdk.values.PCollectionView
-
For internal use only.
- fromOptions(PipelineOptions) - Static method in class org.apache.beam.sdk.runners.PipelineRunner
-
Constructs a runner from the provided options.
- fromOptions(PipelineOptions) - Static method in class org.apache.beam.sdk.testing.CrashingRunner
-
- fromOptions(PipelineOptions) - Static method in class org.apache.beam.sdk.testing.TestPipeline
-
- fromPath(String) - Static method in class org.apache.beam.sdk.io.PubsubIO.PubsubSubscription
-
Creates a class representing a Pub/Sub subscription from the specified subscription path.
- fromPath(String) - Static method in class org.apache.beam.sdk.io.PubsubIO.PubsubTopic
-
Creates a class representing a Cloud Pub/Sub topic from the specified topic path.
- fromStaticMethods(Class<T>) - Static method in class org.apache.beam.sdk.coders.CoderFactories
-
Creates a
CoderFactory built from particular static methods of a class that
implements
Coder.
- fromStaticMethods(Class<T>) - Static method in class org.apache.beam.sdk.coders.CoderProviders
-
Creates a
CoderProvider built from particular static methods of a class that
implements
Coder.
- GcpOptions - Interface in org.apache.beam.sdk.options
-
Options used to configure Google Cloud Platform project and credentials.
- GcpOptions.CredentialDirFactory - Class in org.apache.beam.sdk.options
-
Returns the default credential directory of ${user.home}/.store/data-flow.
- GcpOptions.DefaultProjectFactory - Class in org.apache.beam.sdk.options
-
Attempts to infer the default project based upon the environment this application
is executing within.
- GcpOptions.GcpTempLocationFactory - Class in org.apache.beam.sdk.options
-
- GcpOptions.GcpUserCredentialsFactory - Class in org.apache.beam.sdk.options
-
Attempts to load the GCP credentials.
- GcpTempLocationFactory() - Constructor for class org.apache.beam.sdk.options.GcpOptions.GcpTempLocationFactory
-
- GcpUserCredentialsFactory() - Constructor for class org.apache.beam.sdk.options.GcpOptions.GcpUserCredentialsFactory
-
- GcsOptions - Interface in org.apache.beam.sdk.options
-
Options used to configure Google Cloud Storage.
- GcsOptions.ExecutorServiceFactory - Class in org.apache.beam.sdk.options
-
- generateDestinationFilenames(int) - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Generate output bundle filenames.
- generateInitialSplits(int, PipelineOptions) - Method in class org.apache.beam.sdk.io.UnboundedSource
-
Returns a list of UnboundedSource objects representing the instances of this source
that should be used when executing the workflow.
- get(TupleTag<V>) - Method in class org.apache.beam.sdk.transforms.CombineFns.CoCombineResult
-
Returns the value represented by the given
TupleTag.
- get(int) - Method in class org.apache.beam.sdk.values.PCollectionList
-
Returns the
PCollection at the given index (origin zero).
- get(TupleTag<T>) - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- get(int) - Method in class org.apache.beam.sdk.values.TupleTagList
-
Returns the
TupleTag at the given index (origin zero).
- getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
- getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class org.apache.beam.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
-
- getAccumulatorCoder(CoderRegistry, Coder<Double>) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
- getAccumulatorCoder(CoderRegistry, Coder<V>) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
- getAccumulatorCoder(CoderRegistry, Coder<Integer>) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
- getAccumulatorCoder(CoderRegistry, Coder<Long>) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
- getAccumulatorCoder(CoderRegistry, Coder<InputT>) - Method in interface org.apache.beam.sdk.transforms.CombineFnBase.GlobalCombineFn
-
Returns the Coder to use for accumulator AccumT
values, or null if it is not able to be inferred.
- getAccumulatorCoder(CoderRegistry, Coder<K>, Coder<InputT>) - Method in interface org.apache.beam.sdk.transforms.CombineFnBase.PerKeyCombineFn
-
Returns the Coder to use for accumulator AccumT
values, or null if it is not able to be inferred.
- getAccumulatorCoder(CoderRegistry, Coder<DataT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- getAccumulatorCoder(CoderRegistry, Coder<DataT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFnWithContext
-
- getAccumulatorCoder(CoderRegistry, Coder<K>, Coder<DataT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFn
-
- getAccumulatorCoder(CoderRegistry, Coder<K>, Coder<DataT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFnWithContext
-
- getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class org.apache.beam.sdk.transforms.Sample.FixedSizedSampleFn
-
- getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class org.apache.beam.sdk.transforms.Top.TopCombineFn
-
- getAggregators(DoFn<?, ?>) - Static method in class org.apache.beam.sdk.transforms.AggregatorRetriever
-
- getAggregatorSteps() - Method in class org.apache.beam.sdk.runners.AggregatorPipelineExtractor
-
- getAggregatorValue(Aggregator<?, AggregateT>) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- getAggregatorValues(Aggregator<?, T>) - Method in interface org.apache.beam.sdk.PipelineResult
-
Retrieves the current value of the provided
Aggregator.
- getAll(TupleTag<V>) - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult
-
Returns the values from the table represented by the given
TupleTag<V> as an Iterable<V> (which may be empty if there
are no results).
- getAll() - Method in class org.apache.beam.sdk.values.PCollectionList
-
- getAll() - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- getAll() - Method in class org.apache.beam.sdk.values.TupleTagList
-
- getAllowedEncodings() - Method in interface org.apache.beam.sdk.coders.Coder
-
- getAllowedEncodings() - Method in class org.apache.beam.sdk.coders.DelegateCoder
-
- getAllowedEncodings() - Method in class org.apache.beam.sdk.coders.StandardCoder
-
- getAllowedEncodings() - Method in class org.apache.beam.sdk.coders.StringDelegateCoder
-
- getAllowedTimestampSkew() - Method in class org.apache.beam.sdk.transforms.DoFn
-
- getAllowedTimestampSkew() - Method in class org.apache.beam.sdk.transforms.DoFnWithContext
-
- getAllowedTimestampSkew() - Method in class org.apache.beam.sdk.transforms.WithTimestamps
-
Returns the allowed timestamp skew duration, which is the maximum
duration that timestamps can be shifted backwards from the timestamp of the input element.
- getAppliedFn(CoderRegistry, Coder<? extends KV<K, ? extends Iterable<InputT>>>, WindowingStrategy<?, ?>) - Method in class org.apache.beam.sdk.transforms.Combine.GroupedValues
-
- getAppName() - Method in interface org.apache.beam.sdk.options.ApplicationNameOptions
-
Name of application, for display purposes.
- getArgumentTypes(Method) - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
Returns a list of argument types for the given method, which must
be a part of the class.
- getAuthorizationServerEncodedUrl() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
The authorization server URL to use for OAuth 2 authentication.
- getBaseOutputFilename() - Method in class org.apache.beam.sdk.io.FileBasedSink
-
Returns the base output filename for this file based sink.
- getBytes() - Method in class org.apache.beam.sdk.io.range.ByteKey
-
Returns a newly-allocated
byte[] representing this
ByteKey.
- getBytesPerOffset() - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
Returns approximately how many bytes of data correspond to a single offset in this source.
- getCause() - Method in class org.apache.beam.sdk.transforms.windowing.InvalidWindows
-
Returns the reason that this WindowFn is invalid.
- getChannelFactory() - Method in class org.apache.beam.sdk.io.CompressedSource
-
- getCheckpointMark() - Method in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
- getCheckpointMarkCoder() - Method in class org.apache.beam.sdk.io.UnboundedSource
-
Returns a
Coder for encoding and decoding the checkpoints for this source, or
null if the checkpoints do not need to be durably committed.
- getClasses() - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
Returns a set of
TypeDescriptors, one for each
superclass (including this class).
- getCloningBehavior() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- getCoder(TypeDescriptor<T>) - Method in interface org.apache.beam.sdk.coders.CoderProvider
-
Provides a coder for a given class, if possible.
- getCoder(TypeDescriptor<T>) - Method in class org.apache.beam.sdk.coders.CoderRegistry
-
- getCoder() - Method in class org.apache.beam.sdk.coders.DelegateCoder
-
Returns the coder used to encode/decode the intermediate values produced/consumed by the
coding functions of this DelegateCoder.
- getCoder() - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- getCoder() - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
- getCoder() - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
- getCoder() - Static method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
- getCoder() - Method in class org.apache.beam.sdk.values.PCollection
-
Returns the
Coder used by this
PCollection to encode and decode
the values stored in it.
- getCoder() - Method in class org.apache.beam.sdk.values.TypedPValue
-
Returns the
Coder used by this
TypedPValue to encode and decode
the values stored in it.
- getCoderArguments() - Method in class org.apache.beam.sdk.coders.AtomicCoder
-
- getCoderArguments() - Method in class org.apache.beam.sdk.coders.AvroCoder
-
- getCoderArguments() - Method in interface org.apache.beam.sdk.coders.Coder
-
If this is a Coder for a parameterized type, returns the
list of Coders being used for each of the parameters, or
returns null if this cannot be done or this is not a
parameterized type.
- getCoderArguments() - Method in class org.apache.beam.sdk.coders.IterableLikeCoder
-
- getCoderArguments() - Method in class org.apache.beam.sdk.coders.KvCoder
-
- getCoderArguments() - Method in class org.apache.beam.sdk.coders.MapCoder
-
If this is a Coder for a parameterized type, returns the
list of Coders being used for each of the parameters, or
returns null if this cannot be done or this is not a
parameterized type.
- getCoderArguments() - Method in class org.apache.beam.sdk.coders.NullableCoder
-
- getCoderArguments() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
-
- getCoderArguments() - Method in class org.apache.beam.sdk.transforms.join.UnionCoder
-
- getCoderArguments() - Method in class org.apache.beam.sdk.values.TimestampedValue.TimestampedValueCoder
-
- getCoderInternal() - Method in interface org.apache.beam.sdk.values.PCollectionView
-
For internal use only.
- getCoderRegistry() - Method in class org.apache.beam.sdk.Pipeline
-
- getCoGbkResultSchema() - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
- getCollection() - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple.TaggedKeyedPCollection
-
Returns the underlying PCollection of this TaggedKeyedPCollection.
- getCombineFn() - Method in interface org.apache.beam.sdk.transforms.Aggregator
-
- getCombineFn() - Method in class org.apache.beam.sdk.transforms.Combine.GloballyAsSingletonView
-
- getComponents() - Method in class org.apache.beam.sdk.coders.StandardCoder
-
Returns the list of
Coders that are components of this
Coder.
- getComponents() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
-
- getComponents() - Method in class org.apache.beam.sdk.transforms.join.UnionCoder
-
- getComponentType() - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
Returns the component type if this type is an array type,
otherwise returns null.
- getCompressionType() - Method in class org.apache.beam.sdk.io.TextIO.Read.Bound
-
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterAll
-
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterEach
-
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterFirst
-
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterProcessingTime
-
- getContinuationTrigger() - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.FromEndOfWindow
-
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.DefaultTrigger
-
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.Repeatedly
-
- getContinuationTrigger() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
Return a trigger to use after a GroupByKey to preserve the
intention of this trigger.
- getContinuationTrigger(List<Trigger>) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
- getContinuationTrigger() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.OnceTrigger
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Max.MaxDoubleFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Max.MaxIntegerFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Max.MaxLongFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Min.MinDoubleFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Min.MinIntegerFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Min.MinLongFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Sum.SumDoubleFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Sum.SumIntegerFn
-
- getCounter(String) - Method in class org.apache.beam.sdk.transforms.Sum.SumLongFn
-
- getCredentialDir() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
Directory for storing dataflow credentials after execution of the OAuth 2 webflow.
- getCredentialFactoryClass() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
The class of the credential factory that should be created and used to create
credentials.
- getCredentialId() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
This option controls which credential store to use when creating the credentials
using the OAuth 2 webflow.
- getCurrent() - Method in class org.apache.beam.sdk.io.BlockBasedSource.BlockBasedReader
-
- getCurrent() - Method in class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
Gets the current record from the delegate reader.
- getCurrent() - Method in class org.apache.beam.sdk.io.Source.Reader
-
- getCurrent() - Method in class org.apache.beam.sdk.runners.TransformHierarchy
-
Returns the last TransformTreeNode on the stack.
- getCurrentBlock() - Method in class org.apache.beam.sdk.io.AvroSource.AvroReader
-
- getCurrentBlock() - Method in class org.apache.beam.sdk.io.BlockBasedSource.BlockBasedReader
-
- getCurrentBlockOffset() - Method in class org.apache.beam.sdk.io.AvroSource.AvroReader
-
- getCurrentBlockOffset() - Method in class org.apache.beam.sdk.io.BlockBasedSource.BlockBasedReader
-
Returns the largest offset such that starting to read from that offset includes the current
block.
- getCurrentBlockSize() - Method in class org.apache.beam.sdk.io.AvroSource.AvroReader
-
- getCurrentBlockSize() - Method in class org.apache.beam.sdk.io.BlockBasedSource.BlockBasedReader
-
Returns the size of the current block in bytes as it is represented in the underlying file,
if possible.
- getCurrentOffset() - Method in class org.apache.beam.sdk.io.BlockBasedSource.BlockBasedReader
-
- getCurrentOffset() - Method in class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
- getCurrentOffset() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- getCurrentRecord() - Method in class org.apache.beam.sdk.io.BlockBasedSource.Block
-
Returns the current record.
- getCurrentRecordId() - Method in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
Returns a unique identifier for the current record.
- getCurrentSource() - Method in class org.apache.beam.sdk.io.AvroSource.AvroReader
-
- getCurrentSource() - Method in class org.apache.beam.sdk.io.BoundedSource.BoundedReader
-
Returns a Source describing the same input that this Reader currently reads
(including items already read).
- getCurrentSource() - Method in class org.apache.beam.sdk.io.FileBasedSource.FileBasedReader
-
- getCurrentSource() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- getCurrentSource() - Method in class org.apache.beam.sdk.io.Source.Reader
-
Returns a Source describing the same input that this Reader currently reads
(including items already read).
- getCurrentSource() - Method in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
- getCurrentTime(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
To complete an implementation, return the desired time from the TriggerContext.
- getCurrentTime(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterProcessingTime
-
- getCurrentTimestamp() - Method in class org.apache.beam.sdk.io.BoundedSource.BoundedReader
-
By default, returns the minimum possible timestamp.
- getCurrentTimestamp() - Method in class org.apache.beam.sdk.io.Source.Reader
-
Returns the timestamp associated with the current data item.
- getDayOfMonth() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- getDayOfMonth() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- getDefaultCoder(TypeDescriptor<T>) - Method in class org.apache.beam.sdk.coders.CoderRegistry
-
Returns the
Coder to use by default for values of the given type.
- getDefaultCoder(TypeDescriptor<OutputT>, TypeDescriptor<InputT>, Coder<InputT>) - Method in class org.apache.beam.sdk.coders.CoderRegistry
-
Returns the
Coder to use by default for values of the given type, where the given input
type uses the given
Coder.
- getDefaultCoder(Class<? extends T>, Class<T>, Map<Type, ? extends Coder<?>>, TypeVariable<?>) - Method in class org.apache.beam.sdk.coders.CoderRegistry
-
Returns the
Coder to use for the specified type parameter specialization of the
subclass, given
Coders to use for all other type parameters (if any).
- getDefaultCoder(T) - Method in class org.apache.beam.sdk.coders.CoderRegistry
-
Returns the
Coder to use for the provided example value, if it can be determined.
- getDefaultCoder(Class<T>) - Method in class org.apache.beam.sdk.coders.CoderRegistry
-
Returns the
Coder to use by default for values of the given class.
- getDefaultOutputCoder(SerializableFunction<InputT, OutputT>, Coder<InputT>) - Method in class org.apache.beam.sdk.coders.CoderRegistry
-
Returns the
Coder to use on elements produced by this function, given the
Coder
used for its input elements.
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.AvroSource
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.CompressedSource
-
Returns the delegate source's default output coder.
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.Read.Bounded
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.Read.Unbounded
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.Source
-
Returns the default Coder to use for the data read from this source.
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.TextIO.Read.Bound
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.XmlSource
-
- getDefaultOutputCoder(CoderRegistry, Coder<Double>) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
- getDefaultOutputCoder(CoderRegistry, Coder<V>) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
- getDefaultOutputCoder(CoderRegistry, Coder<Integer>) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
- getDefaultOutputCoder(CoderRegistry, Coder<Long>) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
- getDefaultOutputCoder(PCollection<? extends KV<K, ? extends Iterable<InputT>>>) - Method in class org.apache.beam.sdk.transforms.Combine.GroupedValues
-
- getDefaultOutputCoder(CoderRegistry, Coder<InputT>) - Method in interface org.apache.beam.sdk.transforms.CombineFnBase.GlobalCombineFn
-
Returns the Coder to use by default for output
OutputT values, or null if it is not able to be inferred.
- getDefaultOutputCoder(CoderRegistry, Coder<K>, Coder<InputT>) - Method in interface org.apache.beam.sdk.transforms.CombineFnBase.PerKeyCombineFn
-
Returns the Coder to use by default for output
OutputT values, or null if it is not able to be inferred.
- getDefaultOutputCoder(PInput) - Method in class org.apache.beam.sdk.transforms.Create.Values
-
- getDefaultOutputCoder(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.Filter
-
- getDefaultOutputCoder(PCollectionList<T>) - Method in class org.apache.beam.sdk.transforms.Flatten.FlattenPCollectionList
-
- getDefaultOutputCoder(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.GroupByKey
-
- getDefaultOutputCoder(PCollection<? extends InputT>) - Method in class org.apache.beam.sdk.transforms.ParDo.Bound
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- getDefaultOutputCoder(PCollection<? extends InputT>, TypedPValue<T>) - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- getDefaultOutputCoder() - Method in class org.apache.beam.sdk.transforms.PTransform
-
Returns the default Coder to use for the output of this
single-output PTransform.
- getDefaultOutputCoder(InputT) - Method in class org.apache.beam.sdk.transforms.PTransform
-
Returns the default Coder to use for the output of this
single-output PTransform when applied to the given input.
- getDefaultOutputCoder(InputT, TypedPValue<T>) - Method in class org.apache.beam.sdk.transforms.PTransform
-
Returns the default Coder to use for the given output of
this single-output PTransform when applied to the given input.
- getDefaultOutputCoder(CoderRegistry, Coder<T>) - Method in class org.apache.beam.sdk.transforms.Sample.FixedSizedSampleFn
-
- getDefaultOutputCoder(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
- getDoFnClass(DoFn<?, ?>) - Static method in class org.apache.beam.sdk.transforms.DoFnReflector
-
- getElemCoder() - Method in class org.apache.beam.sdk.coders.IterableLikeCoder
-
- getElementCoder() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSink
-
- getElementCoder() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSource
-
- getElements() - Method in class org.apache.beam.sdk.transforms.Create.Values
-
- getEnclosingNode() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Returns the enclosing composite transform node, or null if there is none.
- getEncodedElementByteSize(BigDecimal, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigDecimalCoder
-
Returns the size in bytes of the encoded value using this coder.
- getEncodedElementByteSize(Integer, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigEndianIntegerCoder
-
Returns the size in bytes of the encoded value using this coder.
- getEncodedElementByteSize(Long, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigEndianLongCoder
-
Returns the size in bytes of the encoded value using this coder.
- getEncodedElementByteSize(BigInteger, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigIntegerCoder
-
Returns the size in bytes of the encoded value using this coder.
- getEncodedElementByteSize(byte[], Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteArrayCoder
-
- getEncodedElementByteSize(Byte, Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteCoder
-
Returns the size in bytes of the encoded value using this coder.
- getEncodedElementByteSize(ByteString, Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteStringCoder
-
- getEncodedElementByteSize(Double, Coder.Context) - Method in class org.apache.beam.sdk.coders.DoubleCoder
-
Returns the size in bytes of the encoded value using this coder.
- getEncodedElementByteSize(T, Coder.Context) - Method in class org.apache.beam.sdk.coders.NullableCoder
-
Overridden to short-circuit the default StandardCoder behavior of encoding and
counting the bytes.
- getEncodedElementByteSize(T, Coder.Context) - Method in class org.apache.beam.sdk.coders.StandardCoder
-
Returns the size in bytes of the encoded value using this coder.
- getEncodedElementByteSize(String, Coder.Context) - Method in class org.apache.beam.sdk.coders.StringUtf8Coder
-
Returns the size in bytes of the encoded value using this coder.
- getEncodedElementByteSize(TableRow, Coder.Context) - Method in class org.apache.beam.sdk.coders.TableRowJsonCoder
-
- getEncodedElementByteSize(Integer, Coder.Context) - Method in class org.apache.beam.sdk.coders.TextualIntegerCoder
-
- getEncodedElementByteSize(Integer, Coder.Context) - Method in class org.apache.beam.sdk.coders.VarIntCoder
-
- getEncodedElementByteSize(Long, Coder.Context) - Method in class org.apache.beam.sdk.coders.VarLongCoder
-
- getEncodedElementByteSize(Void, Coder.Context) - Method in class org.apache.beam.sdk.coders.VoidCoder
-
- getEncodingId() - Method in class org.apache.beam.sdk.coders.AvroCoder
-
The encoding identifier is designed to support evolution as per the design of Avro
In order to use this class effectively, carefully read the Avro
documentation at
Schema Resolution
to ensure that the old and new schema
match.
- getEncodingId() - Method in interface org.apache.beam.sdk.coders.Coder
-
- getEncodingId() - Method in class org.apache.beam.sdk.coders.CustomCoder
-
- getEncodingId() - Method in class org.apache.beam.sdk.coders.DelegateCoder
-
- getEncodingId() - Method in class org.apache.beam.sdk.coders.JAXBCoder
-
- getEncodingId() - Method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
The encoding identifier is designed to support evolution as per the design of Protocol
Buffers.
- getEncodingId() - Method in class org.apache.beam.sdk.coders.SerializableCoder
-
- getEncodingId() - Method in class org.apache.beam.sdk.coders.StandardCoder
-
- getEncodingId() - Method in class org.apache.beam.sdk.coders.StringDelegateCoder
-
The encoding id is the fully qualified name of the encoded/decoded class.
- getEndKey() - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
- getEndOffset() - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
Returns the specified ending offset of the source.
- getEstimatedSizeBytes(PipelineOptions) - Method in class org.apache.beam.sdk.io.BoundedSource
-
An estimate of the total size (in bytes) of the data that would be read from this source.
- getEstimatedSizeBytes(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- getEstimatedSizeBytes(PipelineOptions) - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
- getExecutorService() - Method in interface org.apache.beam.sdk.options.GcsOptions
-
The ExecutorService instance to use to create threads, can be overridden to specify an
ExecutorService that is compatible with the users environment.
- getExpandedOutputs() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Returns the transform outputs, in expanded form.
- getExtensionRegistry() - Method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
Returns the
ExtensionRegistry listing all known Protocol Buffers extension messages
to
T registered with this
ProtoCoder.
- getFallbackCoderProvider() - Method in class org.apache.beam.sdk.coders.CoderRegistry
-
- getFanout() - Method in class org.apache.beam.sdk.transforms.Combine.GloballyAsSingletonView
-
- getFilename() - Method in class org.apache.beam.sdk.io.FileBasedSink.FileResult
-
- getFilenamePrefix() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
- getFilenamePrefix() - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
- getFilenameSuffix() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
- getFilenameSuffix() - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
- getFileOrPatternSpec() - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- getFilepattern() - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
- getFilepattern() - Method in class org.apache.beam.sdk.io.TextIO.Read.Bound
-
- getFn() - Method in class org.apache.beam.sdk.transforms.Combine.GroupedValues
-
Returns the KeyedCombineFn used by this Combine operation.
- getFn() - Method in class org.apache.beam.sdk.transforms.Combine.PerKey
-
- getFn() - Method in class org.apache.beam.sdk.transforms.ParDo.Bound
-
- getFn() - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- getFractionConsumed() - Method in class org.apache.beam.sdk.io.BlockBasedSource.BlockBasedReader
-
- getFractionConsumed() - Method in class org.apache.beam.sdk.io.BoundedSource.BoundedReader
-
Returns a value in [0, 1] representing approximately what fraction of the
current source this reader has read so far, or
null if such
an estimate is not available.
- getFractionConsumed() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- getFractionConsumed() - Method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
- getFractionConsumed() - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- getFractionConsumed() - Method in interface org.apache.beam.sdk.io.range.RangeTracker
-
- getFractionOfBlockConsumed() - Method in class org.apache.beam.sdk.io.BlockBasedSource.Block
-
Returns the fraction of the block already consumed, if possible, as a value in
[0, 1].
- getFullName() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
- getFullName() - Method in class org.apache.beam.sdk.transforms.AppliedPTransform
-
- getFullNameForTesting(PTransform<?, ?>) - Method in class org.apache.beam.sdk.Pipeline
-
- getGapDuration() - Method in class org.apache.beam.sdk.transforms.windowing.Sessions
-
- getGcpCredential() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
The credential instance that should be used to authenticate against GCP services.
- getGcpTempLocation() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
A GCS path for storing temporary files in GCP.
- getGcsEndpoint() - Method in interface org.apache.beam.sdk.options.GcsOptions
-
GCS endpoint to use.
- getGcsUploadBufferSizeBytes() - Method in interface org.apache.beam.sdk.options.GcsOptions
-
The buffer size (in bytes) to use when uploading files to GCS.
- getGcsUtil() - Method in interface org.apache.beam.sdk.options.GcsOptions
-
The GcsUtil instance that should be used to communicate with Google Cloud Storage.
- getGoogleApiTrace() - Method in interface org.apache.beam.sdk.options.GoogleApiDebugOptions
-
This option enables tracing of API calls to Google services used within the
Dataflow SDK.
- getId() - Method in class org.apache.beam.sdk.values.TupleTag
-
Returns the id of this TupleTag.
- getIdLabel() - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- getIdLabel() - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
- getIdLabel() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSink
-
- getIdLabel() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSource
-
- getIncompatibleGlobalWindowErrorMessage() - Method in interface org.apache.beam.sdk.transforms.CombineFnBase.GlobalCombineFn
-
Returns the error message for not supported default values in Combine.globally().
- getIncompatibleGlobalWindowErrorMessage() - Method in class org.apache.beam.sdk.transforms.Top.TopCombineFn
-
- getIndex(TupleTag<?>) - Method in class org.apache.beam.sdk.transforms.join.CoGbkResultSchema
-
Returns the index for the given tuple tag, if the tag is present in this
schema, -1 if it isn't.
- getIndex() - Method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
The zero-based index of this trigger firing that produced this pane.
- getInput() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Returns the transform input, in unexpanded form.
- getInput() - Method in class org.apache.beam.sdk.transforms.AppliedPTransform
-
- getInputs() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Returns a mapping of inputs to the producing nodes for all inputs to
the transform.
- getInputTypeDescriptor() - Method in class org.apache.beam.sdk.transforms.DoFn
-
Returns a
TypeDescriptor capturing what is known statically
about the input type of this
DoFn instance's most-derived
class.
- getInputTypeDescriptor() - Method in class org.apache.beam.sdk.transforms.DoFnWithContext
-
Returns a
TypeDescriptor capturing what is known statically
about the input type of this
DoFnWithContext instance's most-derived
class.
- getInputTypeDescriptor() - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
-
- getInputTypeDescriptor() - Method in class org.apache.beam.sdk.transforms.SimpleFunction
-
Returns a
TypeDescriptor capturing what is known statically
about the input type of this
DoFn instance's most-derived
class.
- getInputValueCoder(Coder<KV<K, V>>) - Static method in class org.apache.beam.sdk.transforms.GroupByKey
-
Returns the Coder of the values of the input to this transform.
- getInsertDefault() - Method in class org.apache.beam.sdk.transforms.Combine.GloballyAsSingletonView
-
- getInstanceComponents(T) - Static method in class org.apache.beam.sdk.coders.AtomicCoder
-
Returns a list of values contained in the provided example
value, one per type parameter.
- getInstanceComponents(Object) - Method in interface org.apache.beam.sdk.coders.CoderFactory
-
Returns a list of objects contained in value, one per
type argument, or null if none can be determined.
- getInstanceComponents(Collection<T>) - Static method in class org.apache.beam.sdk.coders.CollectionCoder
-
Returns the first element in this collection if it is non-empty,
otherwise returns null.
- getInstanceComponents(Iterable<T>) - Static method in class org.apache.beam.sdk.coders.IterableCoder
-
Returns the first element in this iterable if it is non-empty,
otherwise returns null.
- getInstanceComponents(KV<K, V>) - Static method in class org.apache.beam.sdk.coders.KvCoder
-
- getInstanceComponents(List<T>) - Static method in class org.apache.beam.sdk.coders.ListCoder
-
Returns the first element in this list if it is non-empty,
otherwise returns null.
- getInstanceComponents(Map<K, V>) - Static method in class org.apache.beam.sdk.coders.MapCoder
-
Returns the key and value for an arbitrary element of this map,
if it is non-empty, otherwise returns null.
- getInstanceComponents(Set<T>) - Static method in class org.apache.beam.sdk.coders.SetCoder
-
Returns the first element in this set if it is non-empty,
otherwise returns null.
- getInstanceComponents(TimestampedValue<T>) - Static method in class org.apache.beam.sdk.values.TimestampedValue.TimestampedValueCoder
-
- getInstanceComponentsHelper(IterableT) - Static method in class org.apache.beam.sdk.coders.IterableLikeCoder
-
Returns the first element in the iterable-like exampleValue if it is non-empty,
otherwise returns null.
- getInterfaces() - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
Returns a set of
TypeDescriptors, one for each
interface implemented by this class.
- getJAXBClass() - Method in class org.apache.beam.sdk.coders.JAXBCoder
-
- getKey() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Identifier
-
- getKey() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
The key for the display item.
- getKey() - Method in class org.apache.beam.sdk.values.KV
-
Returns the key of this
KV.
- getKeyCoder() - Method in class org.apache.beam.sdk.coders.KvCoder
-
- getKeyCoder() - Method in class org.apache.beam.sdk.coders.MapCoder
-
- getKeyCoder(Coder<KV<K, V>>) - Static method in class org.apache.beam.sdk.transforms.GroupByKey
-
Returns the Coder of the keys of the input to this
transform, which is also used as the Coder of the keys of
the output of this transform.
- getKeyCoder() - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
- getKeyedCollections() - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
- getKindString() - Method in class org.apache.beam.sdk.io.Read.Bounded
-
- getKindString() - Method in class org.apache.beam.sdk.io.Read.Unbounded
-
- getKindString() - Method in class org.apache.beam.sdk.transforms.ParDo.Bound
-
- getKindString() - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- getKindString() - Method in class org.apache.beam.sdk.transforms.PTransform
-
Returns the name to use by default for this PTransform
(not including the names of any enclosing PTransforms).
- getKindString() - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
- getKindString() - Method in class org.apache.beam.sdk.values.PValueBase
-
- getLabel() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
Retrieve the optional label for an item.
- getLastEmitted() - Method in class org.apache.beam.sdk.io.CountingSource.CounterMark
-
Returns the last value emitted by the reader.
- getLinkUrl() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
Retrieve the optional link URL for an item.
- getMainOutputTag() - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- getMaxEndOffset(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- getMaxEndOffset(PipelineOptions) - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
Returns the actual ending offset of the current source.
- getMaxNumRecords() - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- getMaxReadTime() - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- getMessage() - Method in class org.apache.beam.sdk.coders.Coder.NonDeterministicException
-
- getMessageType() - Method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
Returns the Protocol Buffers
Message type this
ProtoCoder supports.
- getMinBundleSize() - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
Returns the minimum bundle size that should be used when splitting the source into sub-sources.
- getMode() - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- getMonthOfYear() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- getName() - Method in interface org.apache.beam.sdk.transforms.Aggregator
-
Returns the name of the Aggregator.
- getName() - Method in class org.apache.beam.sdk.transforms.PTransform
-
Returns the transform name.
- getName() - Method in class org.apache.beam.sdk.values.PCollection
-
- getName() - Method in interface org.apache.beam.sdk.values.PValue
-
Returns the name of this
PValue.
- getName() - Method in class org.apache.beam.sdk.values.PValueBase
-
- getNamespace() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Identifier
-
- getNamespace() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
The namespace for the display item.
- getNonSpeculativeIndex() - Method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
The zero-based index of this trigger firing among non-speculative panes.
- getNumber() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- getNumber() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- getNumber() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- getNumShards() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
- getNumShards() - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
- getNumShards() - Method in class org.apache.beam.sdk.io.Write.Bound
-
Returns the number of shards that will be produced in the output.
- getOffset() - Method in class org.apache.beam.sdk.transforms.windowing.FixedWindows
-
- getOffset() - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- getOnCreateMatcher() - Method in interface org.apache.beam.sdk.testing.TestPipelineOptions
-
- getOnly(TupleTag<V>) - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult
-
If there is a singleton value for the given tag, returns it.
- getOnly(TupleTag<V>, V) - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult
-
If there is a singleton value for the given tag, returns it.
- getOnSuccessMatcher() - Method in interface org.apache.beam.sdk.testing.TestPipelineOptions
-
- getOptions() - Method in class org.apache.beam.sdk.Pipeline
-
- getOriginalWindowFn() - Method in class org.apache.beam.sdk.transforms.windowing.InvalidWindows
-
Returns the original windowFn that this InvalidWindows replaced.
- getOutName(int) - Method in class org.apache.beam.sdk.values.TupleTag
-
If this TupleTag is tagging output outputIndex of
a PTransform, returns the name that should be used by
default for the output.
- getOutput() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Returns the transform output, in unexpanded form.
- getOutput() - Method in class org.apache.beam.sdk.transforms.AppliedPTransform
-
- getOutputKvCoder(Coder<KV<K, V>>) - Static method in class org.apache.beam.sdk.transforms.GroupByKey
-
Returns the Coder of the output of this transform.
- getOutputStrategyInternal(WindowingStrategy<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
- getOutputTime(Instant, GlobalWindow) - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindows
-
- getOutputTime(Instant, W) - Method in class org.apache.beam.sdk.transforms.windowing.InvalidWindows
-
- getOutputTime(Instant, W) - Method in class org.apache.beam.sdk.transforms.windowing.PartitioningWindowFn
-
- getOutputTime(Instant, IntervalWindow) - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
Ensures that later sliding windows have an output time that is past the end of earlier windows.
- getOutputTime(Instant, W) - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn
-
Returns the output timestamp to use for data depending on the given
inputTimestamp in the specified window.
- getOutputType() - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Returns a
TypeDescriptor capturing what is known statically
about the output type of this
CombineFn instance's
most-derived class.
- getOutputTypeDescriptor() - Method in class org.apache.beam.sdk.transforms.DoFn
-
Returns a
TypeDescriptor capturing what is known statically
about the output type of this
DoFn instance's
most-derived class.
- getOutputTypeDescriptor() - Method in class org.apache.beam.sdk.transforms.DoFnWithContext
-
Returns a
TypeDescriptor capturing what is known statically
about the output type of this
DoFnWithContext instance's
most-derived class.
- getOutputTypeDescriptor() - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
-
- getOutputTypeDescriptor() - Method in class org.apache.beam.sdk.transforms.SimpleFunction
-
Returns a
TypeDescriptor capturing what is known statically
about the output type of this
DoFn instance's
most-derived class.
- getPeriod() - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- getPipeline() - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
- getPipeline() - Method in class org.apache.beam.sdk.values.PBegin
-
- getPipeline() - Method in class org.apache.beam.sdk.values.PCollectionList
-
- getPipeline() - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- getPipeline() - Method in interface org.apache.beam.sdk.values.PInput
-
- getPipeline() - Method in interface org.apache.beam.sdk.values.POutput
-
- getPipeline() - Method in class org.apache.beam.sdk.values.POutputValueBase
-
- getPipelineOptions() - Method in class org.apache.beam.sdk.options.DefaultPipelineOptionsRegistrar
-
- getPipelineOptions() - Method in interface org.apache.beam.sdk.options.PipelineOptionsRegistrar
-
- getPipelineOptions() - Method in class org.apache.beam.sdk.transforms.CombineWithContext.Context
-
Returns the
PipelineOptions specified with the
PipelineRunner
invoking this
KeyedCombineFn.
- getPipelineOptions() - Method in class org.apache.beam.sdk.transforms.DoFn.Context
-
Returns the
PipelineOptions specified with the
PipelineRunner
invoking this
DoFn.
- getPipelineOptions() - Method in class org.apache.beam.sdk.transforms.DoFnWithContext.Context
-
Returns the
PipelineOptions specified with the
PipelineRunner
invoking this
DoFnWithContext.
- getPipelineRunners() - Method in interface org.apache.beam.sdk.runners.PipelineRunnerRegistrar
-
- getPositionForFractionConsumed(double) - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
Returns a position P such that the range [start, P) represents approximately
the given fraction of the range [start, end).
- getProducingTransformInternal() - Method in class org.apache.beam.sdk.values.POutputValueBase
-
- getProducingTransformInternal() - Method in interface org.apache.beam.sdk.values.PValue
-
- getProject() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSource
-
- getProject() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
Project id to use when launching jobs.
- getPubsubRootUrl() - Method in interface org.apache.beam.sdk.options.PubsubOptions
-
Root URL for use with the Pubsub API.
- getRange() - Method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
Returns the current range.
- getRawType() - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
- getReason() - Method in exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- getReasons() - Method in class org.apache.beam.sdk.coders.Coder.NonDeterministicException
-
- getRecordClass() - Method in class org.apache.beam.sdk.io.XmlSource
-
- getRecordElement() - Method in class org.apache.beam.sdk.io.XmlSource
-
- getRecordType() - Method in class org.apache.beam.sdk.coders.SerializableCoder
-
- getRegisteredOptions() - Static method in class org.apache.beam.sdk.options.PipelineOptionsFactory
-
- getRootCause() - Method in exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- getRootElement() - Method in class org.apache.beam.sdk.io.XmlSource
-
- getRunner() - Method in interface org.apache.beam.sdk.options.PipelineOptions
-
The pipeline runner that will be used to execute the pipeline.
- getRunner() - Method in class org.apache.beam.sdk.Pipeline
-
- getSchema() - Method in class org.apache.beam.sdk.coders.AvroCoder
-
Returns the schema used by this coder.
- getSchema() - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
- getSchema() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
- getSchema() - Method in class org.apache.beam.sdk.io.AvroSource
-
- getSchema() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult
-
- getSecretsFile() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
This option controls which file to use when attempting to create the credentials
using the OAuth 2 webflow.
- getServiceAccountKeyfile() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
This option controls which file to use when attempting to create the credentials using the
service account method.
- getServiceAccountName() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
This option controls which service account to use when attempting to create the credentials
using the service account method.
- getShardNameTemplate() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns the current shard name template string.
- getShardNameTemplate() - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
Returns the current shard name template string.
- getShardTemplate() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
- getShardTemplate() - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
- getShortValue() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
Return the optional short value for an item, or null if none is provided.
- getSideInputs() - Method in class org.apache.beam.sdk.transforms.Combine.GroupedValues
-
- getSideInputs() - Method in class org.apache.beam.sdk.transforms.Combine.PerKey
-
Returns the side inputs used by this Combine operation.
- getSideInputs() - Method in class org.apache.beam.sdk.transforms.ParDo.Bound
-
- getSideInputs() - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- getSideInputWindow(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindows
-
- getSideInputWindow(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.InvalidWindows
-
- getSideInputWindow(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.PartitioningWindowFn
-
- getSideInputWindow(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.Sessions
-
- getSideInputWindow(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
Return the earliest window that contains the end of the main-input window.
- getSideInputWindow(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn
-
Returns the window of the side input corresponding to the given window of
the main input.
- getSideOutputTags() - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- getSink() - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Returns the FileBasedSink for this write operation.
- getSink() - Method in class org.apache.beam.sdk.io.Sink.WriteOperation
-
Returns the Sink that this write operation writes to.
- getSink() - Method in class org.apache.beam.sdk.io.Write.Bound
-
Returns the
Sink associated with this PTransform.
- getSink() - Method in class org.apache.beam.sdk.io.XmlSink.XmlWriteOperation
-
Return the XmlSink.Bound for this write operation.
- getSize() - Method in class org.apache.beam.sdk.transforms.windowing.FixedWindows
-
- getSize() - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- getSource() - Method in class org.apache.beam.sdk.io.Read.Bounded
-
Returns the BoundedSource used to create this Read PTransform.
- getSource() - Method in class org.apache.beam.sdk.io.Read.Unbounded
-
Returns the UnboundedSource used to create this Read PTransform.
- getSplitBacklogBytes() - Method in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
Returns the size of the backlog of unread data in the underlying data source represented by
this split of this source.
- getSplitPointsConsumed() - Method in class org.apache.beam.sdk.io.BoundedSource.BoundedReader
-
- getSplitPointsConsumed() - Method in class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
- getSplitPointsConsumed() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- getSplitPointsConsumed() - Method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
- getSplitPointsProcessed() - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
Returns the total number of split points that have been processed.
- getSplitPointsRemaining() - Method in class org.apache.beam.sdk.io.AvroSource.AvroReader
-
- getSplitPointsRemaining() - Method in class org.apache.beam.sdk.io.BoundedSource.BoundedReader
-
- getSplitPointsRemaining() - Method in class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
- getSplitPointsRemaining() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- getStableUniqueNames() - Method in interface org.apache.beam.sdk.options.PipelineOptions
-
Whether to check for stable unique names on each transform.
- getStartDate() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- getStartDate() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- getStartDate() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- getStartKey() - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
- getStartOffset() - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
Returns the starting offset of the source.
- getStartPosition() - Method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
- getStartPosition() - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- getStartPosition() - Method in interface org.apache.beam.sdk.io.range.RangeTracker
-
Returns the starting position of the current range, inclusive.
- getStartTime() - Method in class org.apache.beam.sdk.io.CountingSource.CounterMark
-
Returns the time the reader was started.
- getState() - Method in interface org.apache.beam.sdk.PipelineResult
-
Retrieves the current state of the pipeline execution.
- getStopPosition() - Method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
- getStopPosition() - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- getStopPosition() - Method in interface org.apache.beam.sdk.io.range.RangeTracker
-
Returns the ending position of the current range, exclusive.
- getSubscription() - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- getSubscription() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSource
-
- getSupertype(Class<? super T>) - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
Returns the generic form of a supertype.
- getTag(int) - Method in class org.apache.beam.sdk.transforms.join.CoGbkResultSchema
-
Returns the tuple tag at the given index.
- getTagInternal() - Method in interface org.apache.beam.sdk.values.PCollectionView
-
A unique identifier, for internal use.
- getTempDatasetId() - Method in interface org.apache.beam.sdk.options.BigQueryOptions
-
- getTempLocation() - Method in interface org.apache.beam.sdk.options.PipelineOptions
-
A pipeline level default location for storing temporary files.
- getTempRoot() - Method in interface org.apache.beam.sdk.testing.TestPipelineOptions
-
- getTimestamp() - Method in class org.apache.beam.sdk.values.TimestampedValue
-
- getTimestampLabel() - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- getTimestampLabel() - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
- getTimestampLabel() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSink
-
- getTimestampLabel() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSource
-
- getTimeZone() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- getTimeZone() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- getTimeZone() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- getTiming() - Method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
Return true if this is the last pane that will be produced in the associated window.
- getTokenServerUrl() - Method in interface org.apache.beam.sdk.options.GcpOptions
-
The token server URL to use for OAuth 2 authentication.
- getTopic() - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- getTopic() - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
- getTopic() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSink
-
- getTopic() - Method in class org.apache.beam.sdk.io.PubsubUnboundedSource
-
- getTotalBacklogBytes() - Method in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
Returns the size of the backlog of unread data in the underlying data source represented by
all splits of this source.
- getTotalValue(Combine.CombineFn<T, ?, T>) - Method in class org.apache.beam.sdk.runners.AggregatorValues
-
- getTransform() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Returns the transform associated with this transform node.
- getTransform() - Method in class org.apache.beam.sdk.transforms.AppliedPTransform
-
- getTupleTag() - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple.TaggedKeyedPCollection
-
Returns the TupleTag of this TaggedKeyedPCollection.
- getTupleTagList() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResultSchema
-
Returns the TupleTagList tuple associated with this schema.
- getType() - Method in class org.apache.beam.sdk.coders.AvroCoder
-
Returns the type this coder encodes/decodes.
- getType() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
- getType() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
- getType() - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
- getTypeDescriptor() - Method in class org.apache.beam.sdk.values.TupleTag
-
Returns a TypeDescriptor capturing what is known statically
about the type of this TupleTag instance's most-derived
class.
- getTypeDescriptor() - Method in class org.apache.beam.sdk.values.TypedPValue
-
- getTypeParameter(String) - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
- getUnionTag() - Method in class org.apache.beam.sdk.transforms.join.RawUnionValue
-
- getValue() - Method in class org.apache.beam.sdk.coders.StructuralByteArray
-
- getValue() - Method in class org.apache.beam.sdk.io.range.ByteKey
-
Returns an immutable
ByteString representing this
ByteKey.
- getValue() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
Retrieve the value of the display item.
- getValue() - Method in class org.apache.beam.sdk.transforms.join.RawUnionValue
-
- getValue() - Method in class org.apache.beam.sdk.values.KV
-
Returns the value of this
KV.
- getValue() - Method in class org.apache.beam.sdk.values.TimestampedValue
-
- getValueCoder() - Method in class org.apache.beam.sdk.coders.KvCoder
-
- getValueCoder() - Method in class org.apache.beam.sdk.coders.MapCoder
-
- getValues() - Method in class org.apache.beam.sdk.runners.AggregatorValues
-
Get the values of the
Aggregator at all steps it was used.
- getValuesAtSteps() - Method in class org.apache.beam.sdk.runners.AggregatorValues
-
Get the values of the
Aggregator by the user name at each step it was used.
- getView() - Method in class org.apache.beam.sdk.transforms.View.CreatePCollectionView
-
- getWatermark() - Method in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
Returns a timestamp before or at the timestamps of all future elements read by this reader.
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.AfterAll
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.AfterEach
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.AfterFirst
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.AfterProcessingTime
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.FromEndOfWindow
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.DefaultTrigger
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.Repeatedly
-
- getWatermarkThatGuaranteesFiring(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
Returns a bound in watermark time by which this trigger would have fired at least once
for a given window had there been input data.
- getWindowFn() - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
- getWindowingStrategy() - Method in class org.apache.beam.sdk.values.PCollection
-
- getWindowingStrategyInternal() - Method in interface org.apache.beam.sdk.values.PCollectionView
-
For internal use only.
- getWriteOperation() - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriter
-
Return the FileBasedWriteOperation that this Writer belongs to.
- getWriteOperation() - Method in class org.apache.beam.sdk.io.Sink.Writer
-
Returns the write operation this writer belongs to.
- getWriteOperation() - Method in class org.apache.beam.sdk.io.XmlSink.XmlWriter
-
Return the XmlWriteOperation this write belongs to.
- getWriterResultCoder() - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
- getWriterResultCoder() - Method in class org.apache.beam.sdk.io.Sink.WriteOperation
-
Returns a coder for the writer result type.
- globally(int, ComparatorT) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles
-
Returns a PTransform that takes a PCollection<T>
and returns a PCollection<List<T>> whose single value is a
List of the approximate N-tiles of the elements
of the input PCollection.
- globally(int) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles
-
- globally(int) - Static method in class org.apache.beam.sdk.transforms.ApproximateUnique
-
Returns a PTransform that takes a PCollection<T>
and returns a PCollection<Long> containing a single value
that is an estimate of the number of distinct elements in the
input PCollection.
- globally(double) - Static method in class org.apache.beam.sdk.transforms.ApproximateUnique
-
- globally(SerializableFunction<Iterable<V>, V>) - Static method in class org.apache.beam.sdk.transforms.Combine
-
Returns a
Combine.Globally PTransform
that uses the given
SerializableFunction to combine all
the elements in each window of the input
PCollection into a
single value in the output
PCollection.
- globally(CombineFnBase.GlobalCombineFn<? super InputT, ?, OutputT>) - Static method in class org.apache.beam.sdk.transforms.Combine
-
Returns a
Combine.Globally PTransform
that uses the given
GloballyCombineFn to combine all
the elements in each window of the input
PCollection into a
single value in the output
PCollection.
- globally() - Static method in class org.apache.beam.sdk.transforms.Count
-
- globally() - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> whose contents is the maximum according to the natural ordering of T
of the input PCollection's elements, or null if there are no elements.
- globally(ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> whose contents is the maximum of the input PCollection's elements, or
null if there are no elements.
- globally() - Static method in class org.apache.beam.sdk.transforms.Mean
-
Returns a PTransform that takes an input
PCollection<NumT> and returns a
PCollection<Double> whose contents is the mean of the
input PCollection's elements, or
0 if there are no elements.
- globally() - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> whose contents is the minimum according to the natural ordering of T
of the input PCollection's elements, or null if there are no elements.
- globally(ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> whose contents is the minimum of the input PCollection's elements, or
null if there are no elements.
- GlobalWindow - Class in org.apache.beam.sdk.transforms.windowing
-
The default window into which all data is placed (via
GlobalWindows).
- GlobalWindow.Coder - Class in org.apache.beam.sdk.transforms.windowing
-
- GlobalWindows - Class in org.apache.beam.sdk.transforms.windowing
-
Default
WindowFn that assigns all data to the same window.
- GlobalWindows() - Constructor for class org.apache.beam.sdk.transforms.windowing.GlobalWindows
-
- GoogleApiDebugOptions - Interface in org.apache.beam.sdk.options
-
These options configure debug settings for Google API clients created within the Dataflow SDK.
- GoogleApiDebugOptions.GoogleApiTracer - Class in org.apache.beam.sdk.options
-
- GoogleApiTracer() - Constructor for class org.apache.beam.sdk.options.GoogleApiDebugOptions.GoogleApiTracer
-
- greaterThan(T) - Static method in class org.apache.beam.sdk.transforms.Filter
-
Returns a PTransform that takes an input
PCollection<T> and returns a PCollection<T> with
elements that are greater than a given value, based on the
elements' natural ordering.
- greaterThanEq(T) - Static method in class org.apache.beam.sdk.transforms.Filter
-
Returns a PTransform that takes an input
PCollection<T> and returns a PCollection<T> with
elements that are greater than or equal to a given value, based on
the elements' natural ordering.
- GroupByKey<K,V> - Class in org.apache.beam.sdk.transforms
-
GroupByKey<K, V> takes a PCollection<KV<K, V>>,
groups the values by key and windows, and returns a
PCollection<KV<K, Iterable<V>>> representing a map from
each distinct key and window of the input PCollection to an
Iterable over all the values associated with that key in
the input per window.
- groupedValues(SerializableFunction<Iterable<V>, V>) - Static method in class org.apache.beam.sdk.transforms.Combine
-
Returns a
Combine.GroupedValues
PTransform that takes a
PCollection of
KVs where a key maps to an
Iterable of values, e.g.,
the result of a
GroupByKey, then uses the given
SerializableFunction to combine all the values associated
with a key, ignoring the key.
- groupedValues(CombineFnBase.GlobalCombineFn<? super InputT, ?, OutputT>) - Static method in class org.apache.beam.sdk.transforms.Combine
-
Returns a
Combine.GroupedValues
PTransform that takes a
PCollection of
KVs where a key maps to an
Iterable of values, e.g.,
the result of a
GroupByKey, then uses the given
CombineFn to combine all the values associated with a
key, ignoring the key.
- groupedValues(CombineFnBase.PerKeyCombineFn<? super K, ? super InputT, ?, OutputT>) - Static method in class org.apache.beam.sdk.transforms.Combine
-
Returns a
Combine.GroupedValues
PTransform that takes a
PCollection of
KVs where a key maps to an
Iterable of values, e.g.,
the result of a
GroupByKey, then uses the given
KeyedCombineFn to combine all the values associated with
each key.
- identity() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
Returns the identity element of this operation, i.e.
- identity() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
Returns the value that should be used for the combine of the empty set.
- identity() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
Returns the identity element of this operation, i.e.
- identity() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
Returns the identity element of this operation, i.e.
- identity() - Method in class org.apache.beam.sdk.transforms.Max.MaxDoubleFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Max.MaxFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Max.MaxIntegerFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Max.MaxLongFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Min.MinDoubleFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Min.MinFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Min.MinIntegerFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Min.MinLongFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Sum.SumDoubleFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Sum.SumIntegerFn
-
- identity() - Method in class org.apache.beam.sdk.transforms.Sum.SumLongFn
-
- IDENTITY - Static variable in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- idLabel(String) - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
Returns a transform that's like this one but that reads unique message IDs
from the given message attribute.
- idLabel(String) - Static method in class org.apache.beam.sdk.io.PubsubIO.Read
-
Creates and returns a transform for reading from Cloud Pub/Sub where unique record
identifiers are expected to be provided as Pub/Sub message attributes.
- idLabel(String) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
Returns a new transform that's like this one but that publishes unique record IDs
to a message attribute with the specified name.
- idLabel(String) - Static method in class org.apache.beam.sdk.io.PubsubIO.Write
-
Creates a transform that writes to Pub/Sub, adding each record's unique identifier to the
published messages in an attribute with the specified name.
- in(Pipeline) - Static method in class org.apache.beam.sdk.values.PBegin
-
- in(Pipeline) - Static method in class org.apache.beam.sdk.values.PDone
-
- include(HasDisplayData) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register display data from the specified subcomponent.
- include(HasDisplayData, Class<?>) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register display data from the specified subcomponent, overriding the namespace of
subcomponent display items with the specified namespace.
- include(HasDisplayData, String) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register display data from the specified subcomponent, overriding the namespace of
subcomponent display items with the specified namespace.
- inCombinedNonLatePanes(BoundedWindow) - Method in interface org.apache.beam.sdk.testing.PAssert.IterableAssert
-
Creates a new
PAssert.IterableAssert like this one, but with the assertion restricted to only
run on the provided window across all panes that were not produced by the arrival of late
data.
- INDEX_OF_MAX - Static variable in class org.apache.beam.sdk.io.ShardNameTemplate
-
Shard name containing the index and max.
- inferType(Object) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
- inFinalPane(BoundedWindow) - Method in interface org.apache.beam.sdk.testing.PAssert.IterableAssert
-
Creates a new
PAssert.IterableAssert like this one, but with the assertion restricted to only
run on the provided window, running the checker only on the final pane for each key.
- inFinalPane(BoundedWindow) - Method in interface org.apache.beam.sdk.testing.PAssert.SingletonAssert
-
Creates a new
PAssert.SingletonAssert like this one, but with the assertion restricted to
only run on the provided window, running the checker only on the final pane for each key.
- initialize(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Initialization of the sink.
- initialize(PipelineOptions) - Method in class org.apache.beam.sdk.io.Sink.WriteOperation
-
Performs initialization before writing to the sink.
- initialize(AbstractGoogleClientRequest<?>) - Method in class org.apache.beam.sdk.options.GoogleApiDebugOptions.GoogleApiTracer
-
- inOnlyPane(BoundedWindow) - Method in interface org.apache.beam.sdk.testing.PAssert.SingletonAssert
-
Creates a new
PAssert.SingletonAssert like this one, but with the assertion restricted to
only run on the provided window.
- inOnTimePane(BoundedWindow) - Method in interface org.apache.beam.sdk.testing.PAssert.IterableAssert
-
Creates a new
PAssert.IterableAssert like this one, but with the assertion restricted to only
run on the provided window.
- inOnTimePane(BoundedWindow) - Method in interface org.apache.beam.sdk.testing.PAssert.SingletonAssert
-
Creates a new
PAssert.SingletonAssert like this one, but with the assertion restricted to
only run on the provided window, running the checker only on the on-time pane for each key.
- inOrder(Trigger...) - Static method in class org.apache.beam.sdk.transforms.windowing.AfterEach
-
Returns an AfterEach Trigger with the given subtriggers.
- INSTANCE - Static variable in class org.apache.beam.sdk.transforms.windowing.GlobalWindow.Coder
-
- INSTANCE - Static variable in class org.apache.beam.sdk.transforms.windowing.GlobalWindow
-
- INSTANCE - Static variable in class org.apache.beam.sdk.transforms.windowing.PaneInfo.PaneInfoCoder
-
- InstantCoder - Class in org.apache.beam.sdk.coders
-
A
Coder for joda
Instant that encodes it as a big endian
Long
shifted such that lexicographic ordering of the bytes corresponds to chronological order.
- integers() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- integersGlobally() - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform that takes an input PCollection<Integer> and returns a
PCollection<Integer> whose contents is the maximum of the input PCollection's
elements, or Integer.MIN_VALUE if there are no elements.
- integersGlobally() - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform that takes an input PCollection<Integer> and returns a
PCollection<Integer> whose contents is a single value that is the minimum of the input
PCollection's elements, or Integer.MAX_VALUE if there are no elements.
- integersGlobally() - Static method in class org.apache.beam.sdk.transforms.Sum
-
Returns a PTransform that takes an input
PCollection<Integer> and returns a
PCollection<Integer> whose contents is the sum of the
input PCollection's elements, or
0 if there are no elements.
- integersPerKey() - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform that takes an input PCollection<KV<K, Integer>> and
returns a PCollection<KV<K, Integer>> that contains an output element mapping each
distinct key in the input PCollection to the maximum of the values associated with that
key in the input PCollection.
- integersPerKey() - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform that takes an input PCollection<KV<K, Integer>> and
returns a PCollection<KV<K, Integer>> that contains an output element mapping each
distinct key in the input PCollection to the minimum of the values associated with that
key in the input PCollection.
- integersPerKey() - Static method in class org.apache.beam.sdk.transforms.Sum
-
Returns a PTransform that takes an input
PCollection<KV<K, Integer>> and returns a
PCollection<KV<K, Integer>> that contains an output
element mapping each distinct key in the input
PCollection to the sum of the values associated with
that key in the input PCollection.
- interpolateKey(double) - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
Returns a
ByteKey key such that
[startKey, key) represents
approximately the specified fraction of the range
[startKey, endKey).
- intersects(IntervalWindow) - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
Returns whether this window intersects the given window.
- IntervalWindow - Class in org.apache.beam.sdk.transforms.windowing
-
- IntervalWindow(Instant, Instant) - Constructor for class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
Creates a new IntervalWindow that represents the half-open time
interval [start, end).
- IntervalWindow(Instant, ReadableDuration) - Constructor for class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
- into(WindowFn<? super T, ?>) - Static method in class org.apache.beam.sdk.transforms.windowing.Window
-
Creates a
Window PTransform that uses the given
WindowFn to window the data.
- into(WindowFn<? super T, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Unbound
-
Returns a new
Window PTransform that's like this
transform but that will use the given
WindowFn, and that has
its input and output types bound.
- IntraBundleParallelization - Class in org.apache.beam.sdk.transforms
-
Provides multi-threading of
DoFns, using threaded execution to
process multiple elements concurrently within a bundle.
- IntraBundleParallelization() - Constructor for class org.apache.beam.sdk.transforms.IntraBundleParallelization
-
- IntraBundleParallelization.Bound<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A PTransform that, when applied to a PCollection<InputT>,
invokes a user-specified DoFn<InputT, OutputT> on all its elements,
with all its outputs collected into an output
PCollection<OutputT>.
- IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A multi-threaded DoFn wrapper.
- IntraBundleParallelization.Unbound - Class in org.apache.beam.sdk.transforms
-
An incomplete IntraBundleParallelization transform, with unbound input/output types.
- InvalidWindows<W extends BoundedWindow> - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn that represents an invalid pipeline state.
- InvalidWindows(String, WindowFn<?, W>) - Constructor for class org.apache.beam.sdk.transforms.windowing.InvalidWindows
-
- invokeFinishBundle(DoFnWithContext<InputT, OutputT>.Context, DoFnWithContext.ExtraContextFactory<InputT, OutputT>) - Method in interface org.apache.beam.sdk.transforms.DoFnReflector.DoFnInvoker
-
- invokeProcessElement(DoFnWithContext<InputT, OutputT>.ProcessContext, DoFnWithContext.ExtraContextFactory<InputT, OutputT>) - Method in interface org.apache.beam.sdk.transforms.DoFnReflector.DoFnInvoker
-
- invokeStartBundle(DoFnWithContext<InputT, OutputT>.Context, DoFnWithContext.ExtraContextFactory<InputT, OutputT>) - Method in interface org.apache.beam.sdk.transforms.DoFnReflector.DoFnInvoker
-
- inWindow(BoundedWindow) - Method in interface org.apache.beam.sdk.testing.PAssert.IterableAssert
-
Creates a new
PAssert.IterableAssert like this one, but with the assertion restricted to only
run on the provided window.
- isArray() - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
Returns true if this type is known to be an array type.
- isAtSplitPoint() - Method in class org.apache.beam.sdk.io.BlockBasedSource.BlockBasedReader
-
Returns true if the reader is at a split point.
- isAtSplitPoint() - Method in class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
Returns true only for the first record; compressed sources cannot be split.
- isAtSplitPoint() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- isBounded() - Method in class org.apache.beam.sdk.values.PCollection
-
- isCompatible(Trigger) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- isCompatible(Trigger) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- isCompatible(Trigger) - Method in class org.apache.beam.sdk.transforms.windowing.DefaultTrigger
-
- isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.FixedWindows
-
- isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindows
-
- isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.InvalidWindows
-
InvalidWindows objects with the same originalWindowFn are compatible.
- isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.Sessions
-
- isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- isCompatible(Trigger) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
Returns whether this performs the same triggering as the given Trigger.
- isCompatible(WindowFn<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn
-
Returns whether this performs the same merging as the given
WindowFn.
- isCompositeNode() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Returns true if this node represents a composite transform that does not perform
processing of its own, but merely encapsulates a sub-pipeline (which may be empty).
- isDisjoint(IntervalWindow) - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
Returns whether this window is disjoint from the given window.
- isDone() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- isDone() - Method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
- isDone() - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- isEmpty() - Method in class org.apache.beam.sdk.io.range.ByteKey
-
Returns
true if the
byte[] backing this
ByteKey is of length 0.
- isEmpty() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult
-
- isEmpty() - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
- isEqualTo(T) - Method in interface org.apache.beam.sdk.testing.PAssert.SingletonAssert
-
- isFinished() - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.TriggerInfo
-
Returns true if the current trigger is marked finished.
- isFinished(int) - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.TriggerInfo
-
Return true if the given subtrigger is marked finished.
- isFinishedSpecifyingInternal() - Method in class org.apache.beam.sdk.values.PValueBase
-
Returns whether this
PValueBase has been finalized, and
its core properties, e.g., name, can no longer be changed.
- isFirst() - Method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
Return true if this is the first pane produced for the associated window.
- isLast() - Method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
Return true if this is the last pane that will be produced in the associated window.
- isMerging() - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.TriggerInfo
-
Returns true if the windowing strategy of the current PCollection is a merging
WindowFn.
- isNonMerging() - Method in class org.apache.beam.sdk.transforms.windowing.NonMergingWindowFn
-
- isNonMerging() - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn
-
Returns true if this WindowFn never needs to merge any windows.
- isRegisterByteSizeObserverCheap(BigDecimal, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigDecimalCoder
-
- isRegisterByteSizeObserverCheap(Integer, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigEndianIntegerCoder
-
- isRegisterByteSizeObserverCheap(Long, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigEndianLongCoder
-
- isRegisterByteSizeObserverCheap(BigInteger, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigIntegerCoder
-
- isRegisterByteSizeObserverCheap(byte[], Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteArrayCoder
-
- isRegisterByteSizeObserverCheap(Byte, Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteCoder
-
- isRegisterByteSizeObserverCheap(ByteString, Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteStringCoder
-
- isRegisterByteSizeObserverCheap(T, Coder.Context) - Method in interface org.apache.beam.sdk.coders.Coder
-
- isRegisterByteSizeObserverCheap(Double, Coder.Context) - Method in class org.apache.beam.sdk.coders.DoubleCoder
-
- isRegisterByteSizeObserverCheap(ReadableDuration, Coder.Context) - Method in class org.apache.beam.sdk.coders.DurationCoder
-
- isRegisterByteSizeObserverCheap(Instant, Coder.Context) - Method in class org.apache.beam.sdk.coders.InstantCoder
-
- isRegisterByteSizeObserverCheap(IterableT, Coder.Context) - Method in class org.apache.beam.sdk.coders.IterableLikeCoder
-
- isRegisterByteSizeObserverCheap(KV<K, V>, Coder.Context) - Method in class org.apache.beam.sdk.coders.KvCoder
-
Returns whether both keyCoder and valueCoder are considered not expensive.
- isRegisterByteSizeObserverCheap(T, Coder.Context) - Method in class org.apache.beam.sdk.coders.NullableCoder
-
NullableCoder is cheap if valueCoder is cheap.
- isRegisterByteSizeObserverCheap(T, Coder.Context) - Method in class org.apache.beam.sdk.coders.StandardCoder
-
- isRegisterByteSizeObserverCheap(Integer, Coder.Context) - Method in class org.apache.beam.sdk.coders.VarIntCoder
-
- isRegisterByteSizeObserverCheap(Long, Coder.Context) - Method in class org.apache.beam.sdk.coders.VarLongCoder
-
- isRegisterByteSizeObserverCheap(Void, Coder.Context) - Method in class org.apache.beam.sdk.coders.VoidCoder
-
- isRegisterByteSizeObserverCheap(RawUnionValue, Coder.Context) - Method in class org.apache.beam.sdk.transforms.join.UnionCoder
-
Since this coder uses elementCoders.get(index) and coders that are known to run in constant
time, we defer the return value to that coder.
- isRootNode() - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
- isSplittable() - Method in class org.apache.beam.sdk.io.CompressedSource
-
Determines whether a single file represented by this source is splittable.
- isSplittable() - Method in class org.apache.beam.sdk.io.FileBasedSource
-
Determines whether a file represented by this source is can be split into bundles.
- isStarted() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- isStarted() - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- isStreaming() - Method in interface org.apache.beam.sdk.options.StreamingOptions
-
Set to true if running a streaming pipeline.
- isSubtypeOf(TypeDescriptor<?>) - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
Return true if this type is a subtype of the given type.
- isSupertypeOf(TypeDescriptor<?>) - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
Returns true if this type is assignable from the given type.
- isTerminal() - Method in enum org.apache.beam.sdk.PipelineResult.State
-
- isUnknown() - Method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
Return true if there is no timing information for the current
PaneInfo.
- isWholeStream - Variable in class org.apache.beam.sdk.coders.Coder.Context
-
Whether the encoded or decoded value fills the remainder of the
output or input (resp.) record/stream contents.
- item(String, String) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key and string value.
- item(String, Integer) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key and integer value.
- item(String, Long) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key and integer value.
- item(String, Float) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key and floating point value.
- item(String, Double) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key and floating point value.
- item(String, Boolean) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key and boolean value.
- item(String, Instant) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key and timestamp value.
- item(String, Duration) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key and duration value.
- item(String, Class<T>) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key and class value.
- item(String, DisplayData.Type, T) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData
-
Create a display item for the specified key, type, and value.
- Item() - Constructor for class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
- items() - Method in class org.apache.beam.sdk.transforms.display.DisplayData
-
- IterableCoder<T> - Class in org.apache.beam.sdk.coders
-
- IterableCoder(Coder<T>) - Constructor for class org.apache.beam.sdk.coders.IterableCoder
-
- IterableLikeCoder<T,IterableT extends Iterable<T>> - Class in org.apache.beam.sdk.coders
-
An abstract base class with functionality for assembling a
Coder for a class that implements
Iterable.
- IterableLikeCoder(Coder<T>, String) - Constructor for class org.apache.beam.sdk.coders.IterableLikeCoder
-
- iterables() - Static method in class org.apache.beam.sdk.transforms.Flatten
-
Returns a PTransform that takes a PCollection<Iterable<T>>
and returns a PCollection<T> containing all the elements from
all the Iterables.
- iterables(TypeDescriptor<T>) - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- of(TypeDescriptor<T>) - Static method in class org.apache.beam.sdk.coders.AvroCoder
-
Returns an AvroCoder instance for the provided element type.
- of(Class<T>) - Static method in class org.apache.beam.sdk.coders.AvroCoder
-
Returns an AvroCoder instance for the provided element class.
- of(Schema) - Static method in class org.apache.beam.sdk.coders.AvroCoder
-
Returns an AvroCoder instance for the Avro schema.
- of(Class<T>, Schema) - Static method in class org.apache.beam.sdk.coders.AvroCoder
-
Returns an AvroCoder instance for the provided element type
using the provided Avro schema.
- of(String, String) - Static method in class org.apache.beam.sdk.coders.AvroCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.BigDecimalCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.BigEndianIntegerCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.BigEndianLongCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.BigIntegerCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.ByteArrayCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.ByteCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.ByteStringCoder
-
- of(Coder<T>) - Static method in class org.apache.beam.sdk.coders.CollectionCoder
-
- of(List<Object>) - Static method in class org.apache.beam.sdk.coders.CollectionCoder
-
- of(String, String, String, String) - Static method in class org.apache.beam.sdk.coders.CustomCoder
-
- of(Coder<IntermediateT>, DelegateCoder.CodingFunction<T, IntermediateT>, DelegateCoder.CodingFunction<IntermediateT, T>) - Static method in class org.apache.beam.sdk.coders.DelegateCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.DoubleCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.DurationCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.InstantCoder
-
- of(Coder<T>) - Static method in class org.apache.beam.sdk.coders.IterableCoder
-
- of(List<Coder<?>>) - Static method in class org.apache.beam.sdk.coders.IterableCoder
-
- of(Class<T>) - Static method in class org.apache.beam.sdk.coders.JAXBCoder
-
Create a coder for a given type of JAXB annotated objects.
- of(String) - Static method in class org.apache.beam.sdk.coders.JAXBCoder
-
Constructor for JSON deserialization only.
- of(Coder<K>, Coder<V>) - Static method in class org.apache.beam.sdk.coders.KvCoder
-
- of(List<Coder<?>>) - Static method in class org.apache.beam.sdk.coders.KvCoder
-
- of(Coder<T>) - Static method in class org.apache.beam.sdk.coders.ListCoder
-
- of(List<Coder<?>>) - Static method in class org.apache.beam.sdk.coders.ListCoder
-
- of(Coder<K>, Coder<V>) - Static method in class org.apache.beam.sdk.coders.MapCoder
-
Produces a MapCoder with the given keyCoder and valueCoder.
- of(List<Coder<?>>) - Static method in class org.apache.beam.sdk.coders.MapCoder
-
- of(Coder<T>) - Static method in class org.apache.beam.sdk.coders.NullableCoder
-
- of(List<Coder<?>>) - Static method in class org.apache.beam.sdk.coders.NullableCoder
-
- of(Class<T>) - Static method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
Returns a
ProtoCoder for the given Protocol Buffers
Message.
- of(TypeDescriptor<T>) - Static method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
- of(String, List<String>) - Static method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
- of(TypeDescriptor<T>) - Static method in class org.apache.beam.sdk.coders.SerializableCoder
-
- of(Class<T>) - Static method in class org.apache.beam.sdk.coders.SerializableCoder
-
- of(String) - Static method in class org.apache.beam.sdk.coders.SerializableCoder
-
- of(Coder<T>) - Static method in class org.apache.beam.sdk.coders.SetCoder
-
Produces a
SetCoder with the given
elementCoder.
- of(List<Object>) - Static method in class org.apache.beam.sdk.coders.SetCoder
-
Dynamically typed constructor for JSON deserialization.
- of(Class<T>) - Static method in class org.apache.beam.sdk.coders.StringDelegateCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.StringUtf8Coder
-
- of() - Static method in class org.apache.beam.sdk.coders.TableRowJsonCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.TextualIntegerCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.VarIntCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.VarLongCoder
-
- of() - Static method in class org.apache.beam.sdk.coders.VoidCoder
-
- of(ByteString) - Static method in class org.apache.beam.sdk.io.range.ByteKey
-
Creates a new
ByteKey backed by the specified
ByteString.
- of(int...) - Static method in class org.apache.beam.sdk.io.range.ByteKey
-
Creates a new
ByteKey backed by a copy of the specified
int[].
- of(ByteKey, ByteKey) - Static method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
Creates a new
ByteKeyRange with the given start and end keys.
- of(ByteKeyRange) - Static method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
- of(String, InputT, OutputT, TransformT) - Static method in class org.apache.beam.sdk.transforms.AppliedPTransform
-
- of(SerializableFunction<Iterable<V>, V>) - Static method in class org.apache.beam.sdk.transforms.Combine.IterableCombineFn
-
Returns a CombineFn that uses the given
SerializableFunction to combine values.
- of(SerializableFunction<Iterable<V>, V>, int) - Static method in class org.apache.beam.sdk.transforms.Combine.IterableCombineFn
-
Returns a CombineFn that uses the given
SerializableFunction to combine values,
attempting to buffer at least bufferSize
values between invocations.
- of(SerializableFunction<Iterable<V>, V>) - Static method in class org.apache.beam.sdk.transforms.Combine.SimpleCombineFn
-
Deprecated.
- of(Iterable<T>) - Static method in class org.apache.beam.sdk.transforms.Create
-
Returns a new
Create.Values transform that produces a
PCollection containing elements of the provided
Iterable.
- of(T...) - Static method in class org.apache.beam.sdk.transforms.Create
-
Returns a new
Create.Values transform that produces a
PCollection containing the specified elements.
- of(Map<K, V>) - Static method in class org.apache.beam.sdk.transforms.Create
-
Returns a new
Create.Values transform that produces a
PCollection of
KVs corresponding to the keys and
values of the specified
Map.
- of(Class<?>, String) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData.Identifier
-
- of(String, String) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData.Identifier
-
- of(Class<? extends DoFnWithContext>) - Static method in class org.apache.beam.sdk.transforms.DoFnReflector
-
- of(DoFn<InputT, OutputT>) - Static method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns a
DoFnTester supporting unit-testing of the given
DoFn.
- of(DoFnWithContext<InputT, OutputT>) - Static method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns a
DoFnTester supporting unit-testing of the given
DoFn.
- of(DoFn<NewInputT, NewOutputT>) - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.Bound
-
- of(DoFn<InputT, OutputT>) - Static method in class org.apache.beam.sdk.transforms.IntraBundleParallelization
-
- of(DoFn<InputT, OutputT>) - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.Unbound
-
- of(CoGbkResultSchema, UnionCoder) - Static method in class org.apache.beam.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
-
- of(List<Coder<?>>, CoGbkResultSchema) - Static method in class org.apache.beam.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
-
- of(TupleTag<V>, List<V>) - Static method in class org.apache.beam.sdk.transforms.join.CoGbkResult
-
Returns a new CoGbkResult that contains just the given tag and given data.
- of(List<TupleTag<?>>) - Static method in class org.apache.beam.sdk.transforms.join.CoGbkResultSchema
-
- of(TupleTag<InputT>, PCollection<KV<K, InputT>>) - Static method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
Returns a new KeyedPCollectionTuple<K> with the given tag and initial
PCollection.
- of(List<Coder<?>>) - Static method in class org.apache.beam.sdk.transforms.join.UnionCoder
-
Builds a union coder with the given list of element coders.
- of(T, ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Max.MaxFn
-
- of(ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Max.MaxFn
-
- of(T, ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Min.MinFn
-
- of(ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Min.MinFn
-
- of(DoFn<InputT, OutputT>) - Static method in class org.apache.beam.sdk.transforms.ParDo
-
- of(DoFnWithContext<InputT, OutputT>) - Static method in class org.apache.beam.sdk.transforms.ParDo
-
- of(DoFn<InputT, OutputT>) - Method in class org.apache.beam.sdk.transforms.ParDo.Unbound
-
Returns a new
ParDo PTransform that's like this
transform but that will invoke the given
DoFn
function, and that has its input and output types bound.
- of(DoFnWithContext<InputT, OutputT>) - Method in class org.apache.beam.sdk.transforms.ParDo.Unbound
-
Returns a new
ParDo PTransform that's like this
transform but which will invoke the given
DoFnWithContext
function, and which has its input and output types bound.
- of(DoFn<InputT, OutputT>) - Method in class org.apache.beam.sdk.transforms.ParDo.UnboundMulti
-
Returns a new multi-output
ParDo PTransform
that's like this transform but that will invoke the given
DoFn function, and that has its input type bound.
- of(DoFn<InputT, OutputT>, Class<?>) - Method in class org.apache.beam.sdk.transforms.ParDo.UnboundMulti
-
- of(DoFnWithContext<InputT, OutputT>) - Method in class org.apache.beam.sdk.transforms.ParDo.UnboundMulti
-
Returns a new multi-output
ParDo PTransform
that's like this transform but which will invoke the given
DoFnWithContext function, and which has its input type bound.
- of(int, Partition.PartitionFn<? super T>) - Static method in class org.apache.beam.sdk.transforms.Partition
-
Returns a new Partition PTransform that divides
its input PCollection into the given number of partitions,
using the given partitioning function.
- of(int, ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Top
-
Returns a PTransform that takes an input
PCollection<T> and returns a PCollection<List<T>> with a
single element containing the largest count elements of the input
PCollection<T>, in decreasing order, sorted using the
given Comparator<T>.
- of(PCollectionView<ViewT>) - Static method in class org.apache.beam.sdk.transforms.View.CreatePCollectionView
-
- of(Trigger.OnceTrigger...) - Static method in class org.apache.beam.sdk.transforms.windowing.AfterAll
-
Returns an AfterAll Trigger with the given subtriggers.
- of(Trigger.OnceTrigger...) - Static method in class org.apache.beam.sdk.transforms.windowing.AfterFirst
-
Returns an AfterFirst Trigger with the given subtriggers.
- of() - Static method in class org.apache.beam.sdk.transforms.windowing.DefaultTrigger
-
Returns the default trigger.
- of(Duration) - Static method in class org.apache.beam.sdk.transforms.windowing.FixedWindows
-
Partitions the timestamp space into half-open intervals of the form
[N * size, (N + 1) * size), where 0 is the epoch.
- of(Duration) - Static method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
Assigns timestamps into half-open intervals of the form
[N * period, N * period + size), where 0 is the epoch.
- of(SerializableFunction<V, K>) - Static method in class org.apache.beam.sdk.transforms.WithKeys
-
Returns a PTransform that takes a PCollection<V>
and returns a PCollection<KV<K, V>>, where each of the
values in the input PCollection has been paired with a
key computed from the value by invoking the given
SerializableFunction.
- of(K) - Static method in class org.apache.beam.sdk.transforms.WithKeys
-
Returns a PTransform that takes a PCollection<V>
and returns a PCollection<KV<K, V>>, where each of the
values in the input PCollection has been paired with the
given key.
- of(SerializableFunction<T, Instant>) - Static method in class org.apache.beam.sdk.transforms.WithTimestamps
-
- of(K, V) - Static method in class org.apache.beam.sdk.values.KV
-
Returns a
KV with the given key and value.
- of(PCollection<T>) - Static method in class org.apache.beam.sdk.values.PCollectionList
-
- of(Iterable<PCollection<T>>) - Static method in class org.apache.beam.sdk.values.PCollectionList
-
- of(TupleTag<T>, PCollection<T>) - Static method in class org.apache.beam.sdk.values.PCollectionTuple
-
- of(V, Instant) - Static method in class org.apache.beam.sdk.values.TimestampedValue
-
Returns a new TimestampedValue with the given value and timestamp.
- of(Coder<T>) - Static method in class org.apache.beam.sdk.values.TimestampedValue.TimestampedValueCoder
-
- of(List<Object>) - Static method in class org.apache.beam.sdk.values.TimestampedValue.TimestampedValueCoder
-
- of(TupleTag<?>) - Static method in class org.apache.beam.sdk.values.TupleTagList
-
- of(List<TupleTag<?>>) - Static method in class org.apache.beam.sdk.values.TupleTagList
-
- of(Class<T>) - Static method in class org.apache.beam.sdk.values.TypeDescriptor
-
- of(Type) - Static method in class org.apache.beam.sdk.values.TypeDescriptor
-
- OFFSET_INFINITY - Static variable in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
Offset corresponding to infinity.
- OffsetBasedReader(OffsetBasedSource<T>) - Constructor for class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- OffsetBasedSource<T> - Class in org.apache.beam.sdk.io
-
A
BoundedSource that uses offsets to define starting and ending positions.
- OffsetBasedSource(long, long, long) - Constructor for class org.apache.beam.sdk.io.OffsetBasedSource
-
- OffsetBasedSource.OffsetBasedReader<T> - Class in org.apache.beam.sdk.io
-
- OffsetRangeTracker - Class in org.apache.beam.sdk.io.range
-
- OffsetRangeTracker(long, long) - Constructor for class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
Creates an OffsetRangeTracker for the specified range.
- ofPrimitiveOutputsInternal(Pipeline, TupleTagList, WindowingStrategy<?, ?>, PCollection.IsBounded) - Static method in class org.apache.beam.sdk.values.PCollectionTuple
-
- ofRecordClass(Class<T>) - Method in class org.apache.beam.sdk.io.XmlSink.Bound
-
Returns an XmlSink that writes objects of the class specified as XML elements.
- ON_TIME_AND_ONLY_FIRING - Static variable in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
PaneInfo to use when there will be exactly one firing and it is on time.
- OnceTrigger(List<Trigger>) - Constructor for class org.apache.beam.sdk.transforms.windowing.Trigger.OnceTrigger
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterAll
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterEach
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterFirst
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.FromEndOfWindow
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.DefaultTrigger
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.Repeatedly
-
- onElement(Trigger.OnElementContext) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
Called every time an element is incorporated into a window.
- OnElementContext() - Constructor for class org.apache.beam.sdk.transforms.windowing.Trigger.OnElementContext
-
- onFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterEach
-
- onFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- onFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.DefaultTrigger
-
- onFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.Repeatedly
-
- onFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.OnceTrigger
-
Adjusts the state of the trigger to be ready for the next pane.
- onFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
Adjusts the state of the trigger to be ready for the next pane.
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterAll
-
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterEach
-
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterFirst
-
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.FromEndOfWindow
-
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.DefaultTrigger
-
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.Repeatedly
-
- onMerge(Trigger.OnMergeContext) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
Called immediately after windows have been merged.
- OnMergeContext() - Constructor for class org.apache.beam.sdk.transforms.windowing.Trigger.OnMergeContext
-
- onOnlyFiring(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterAll
-
- onOnlyFiring(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- onOnlyFiring(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterFirst
-
- onOnlyFiring(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- onOnlyFiring(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.FromEndOfWindow
-
- onOnlyFiring(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.OnceTrigger
-
- open(String) - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriter
-
Opens the channel.
- open(String) - Method in class org.apache.beam.sdk.io.Sink.Writer
-
Performs bundle initialization.
- OrderByKey() - Constructor for class org.apache.beam.sdk.values.KV.OrderByKey
-
- OrderByValue() - Constructor for class org.apache.beam.sdk.values.KV.OrderByValue
-
- orFinally(Trigger.OnceTrigger) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
Specify an ending condition for this trigger.
- org.apache.beam.sdk - package org.apache.beam.sdk
-
Provides a simple, powerful model for building both batch and
streaming parallel data processing
Pipelines.
- org.apache.beam.sdk.annotations - package org.apache.beam.sdk.annotations
-
Defines annotations used across the SDK.
- org.apache.beam.sdk.coders - package org.apache.beam.sdk.coders
-
Defines
Coders
to specify how data is encoded to and decoded from byte strings.
- org.apache.beam.sdk.coders.protobuf - package org.apache.beam.sdk.coders.protobuf
-
Defines a
Coder
for Protocol Buffers messages,
ProtoCoder.
- org.apache.beam.sdk.io - package org.apache.beam.sdk.io
-
Defines transforms for reading and writing common storage formats, including
AvroIO,
org.apache.beam.sdk.io.BigQueryIO, and
TextIO.
- org.apache.beam.sdk.io.range - package org.apache.beam.sdk.io.range
-
Provides thread-safe helpers for implementing dynamic work rebalancing in position-based
bounded sources.
- org.apache.beam.sdk.options - package org.apache.beam.sdk.options
-
- org.apache.beam.sdk.runners - package org.apache.beam.sdk.runners
-
Defines runners for executing Pipelines in different modes, including
org.apache.beam.sdk.runners.DirectRunner and
org.apache.beam.sdk.runners.DataflowRunner.
- org.apache.beam.sdk.testing - package org.apache.beam.sdk.testing
-
Defines utilities for unit testing Dataflow pipelines.
- org.apache.beam.sdk.transforms - package org.apache.beam.sdk.transforms
-
Defines
PTransforms for transforming
data in a pipeline.
- org.apache.beam.sdk.transforms.display - package org.apache.beam.sdk.transforms.display
-
- org.apache.beam.sdk.transforms.join - package org.apache.beam.sdk.transforms.join
-
Defines the
CoGroupByKey transform
for joining multiple PCollections.
- org.apache.beam.sdk.transforms.windowing - package org.apache.beam.sdk.transforms.windowing
-
Defines the
Window transform
for dividing the elements in a PCollection into windows, and the
Trigger for controlling when those
elements are output.
- org.apache.beam.sdk.values - package org.apache.beam.sdk.values
-
- OUTER - Static variable in class org.apache.beam.sdk.coders.Coder.Context
-
The outer context: the value being encoded or decoded takes
up the remainder of the record/stream contents.
- output(OutputT) - Method in class org.apache.beam.sdk.transforms.DoFn.Context
-
Adds the given element to the main output PCollection.
- output(OutputT) - Method in class org.apache.beam.sdk.transforms.DoFnWithContext.Context
-
Adds the given element to the main output PCollection.
- outputAtEarliestInputTimestamp() - Static method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFns
-
The policy of outputting at the earliest of the input timestamps for non-late input data
that led to a computed value.
- outputAtEndOfWindow() - Static method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFns
-
The policy of outputting with timestamps at the end of the window.
- outputAtLatestInputTimestamp() - Static method in class org.apache.beam.sdk.transforms.windowing.OutputTimeFns
-
The policy of holding the watermark to the latest of the input timestamps
for non-late input data that led to a computed value.
- OutputTimeFn<W extends BoundedWindow> - Class in org.apache.beam.sdk.transforms.windowing
-
(Experimental) A function from timestamps of input values to the timestamp for a
computed value.
- OutputTimeFn() - Constructor for class org.apache.beam.sdk.transforms.windowing.OutputTimeFn
-
- OutputTimeFn.Defaults<W extends BoundedWindow> - Class in org.apache.beam.sdk.transforms.windowing
-
(Experimental) Default method implementations for
OutputTimeFn where the
output time depends on the input element timestamps and possibly the window.
- OutputTimeFn.DependsOnlyOnWindow<W extends BoundedWindow> - Class in org.apache.beam.sdk.transforms.windowing
-
(Experimental) Default method implementations for
OutputTimeFn when the
output time depends only on the window.
- OutputTimeFns - Class in org.apache.beam.sdk.transforms.windowing
-
(Experimental) Static utility methods and provided implementations for
OutputTimeFn.
- OutputTimeFns() - Constructor for class org.apache.beam.sdk.transforms.windowing.OutputTimeFns
-
- outputWithTimestamp(OutputT, Instant) - Method in class org.apache.beam.sdk.transforms.DoFn.Context
-
Adds the given element to the main output PCollection,
with the given timestamp.
- outputWithTimestamp(OutputT, Instant) - Method in class org.apache.beam.sdk.transforms.DoFnWithContext.Context
-
Adds the given element to the main output PCollection,
with the given timestamp.
- overlaps(ByteKeyRange) - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
Returns
true if the specified
ByteKeyRange overlaps this range.
- pane() - Method in class org.apache.beam.sdk.transforms.DoFn.ProcessContext
-
Returns information about the pane within this window into which the
input element has been assigned.
- pane() - Method in class org.apache.beam.sdk.transforms.DoFnWithContext.ProcessContext
-
Returns information about the pane within this window into which the
input element has been assigned.
- PaneInfo - Class in org.apache.beam.sdk.transforms.windowing
-
Provides information about the pane an element belongs to.
- PaneInfo.PaneInfoCoder - Class in org.apache.beam.sdk.transforms.windowing
-
A Coder for encoding PaneInfo instances.
- PaneInfo.Timing - Enum in org.apache.beam.sdk.transforms.windowing
-
Enumerates the possibilities for the timing of this pane firing related to the
input and output watermarks for its computation.
- PaneInfoCoder() - Constructor for class org.apache.beam.sdk.transforms.windowing.PaneInfo.PaneInfoCoder
-
- ParDo - Class in org.apache.beam.sdk.transforms
-
ParDo is the core element-wise transform in Google Cloud
Dataflow, invoking a user-specified function on each of the elements of the input
PCollection to produce zero or more output elements, all
of which are collected into the output
PCollection.
- ParDo() - Constructor for class org.apache.beam.sdk.transforms.ParDo
-
- ParDo.Bound<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A
PTransform that, when applied to a
PCollection<InputT>,
invokes a user-specified
DoFn<InputT, OutputT> on all its elements,
with all its outputs collected into an output
PCollection<OutputT>.
- ParDo.BoundMulti<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A
PTransform that, when applied to a
PCollection<InputT>, invokes a user-specified
DoFn<InputT, OutputT> on all its elements, which can emit elements
to any of the
PTransform's main and side output
PCollections, which are bundled into a result
PCollectionTuple.
- ParDo.Unbound - Class in org.apache.beam.sdk.transforms
-
An incomplete
ParDo transform, with unbound input/output types.
- ParDo.UnboundMulti<OutputT> - Class in org.apache.beam.sdk.transforms
-
An incomplete multi-output
ParDo transform, with unbound
input type.
- Partition<T> - Class in org.apache.beam.sdk.transforms
-
Partition takes a PCollection<T> and a
PartitionFn, uses the PartitionFn to split the
elements of the input PCollection into N partitions, and
returns a PCollectionList<T> that bundles N
PCollection<T>s containing the split elements.
- Partition.PartitionFn<T> - Interface in org.apache.beam.sdk.transforms
-
A function object that chooses an output partition for an element.
- partitionFor(T, int) - Method in interface org.apache.beam.sdk.transforms.Partition.PartitionFn
-
Chooses the partition into which to put the given element.
- PartitioningWindowFn<T,W extends BoundedWindow> - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn that places each value into exactly one window based on its timestamp and
never merges windows.
- PartitioningWindowFn() - Constructor for class org.apache.beam.sdk.transforms.windowing.PartitioningWindowFn
-
- PAssert - Class in org.apache.beam.sdk.testing
-
An assertion on the contents of a
PCollection incorporated into the pipeline.
- PAssert.GroupThenAssert<T> - Class in org.apache.beam.sdk.testing
-
A transform that applies an assertion-checking function over iterables of ActualT to
the entirety of the contents of its input.
- PAssert.GroupThenAssertForSingleton<T> - Class in org.apache.beam.sdk.testing
-
A transform that applies an assertion-checking function to a single iterable contained as the
sole element of a
PCollection.
- PAssert.IterableAssert<T> - Interface in org.apache.beam.sdk.testing
-
Builder interface for assertions applicable to iterables and PCollection contents.
- PAssert.OneSideInputAssert<ActualT> - Class in org.apache.beam.sdk.testing
-
An assertion checker that takes a single
PCollectionView<ActualT> and an assertion over
ActualT, and checks it within a
Beam pipeline.
- PAssert.SingletonAssert<T> - Interface in org.apache.beam.sdk.testing
-
Builder interface for assertions applicable to a single value.
- pastEndOfWindow() - Static method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark
-
Creates a trigger that fires when the watermark passes the end of the window.
- pastFirstElementInPane() - Static method in class org.apache.beam.sdk.transforms.windowing.AfterProcessingTime
-
Creates a trigger that fires when the current processing time passes the processing time
at which this trigger saw the first element in a pane.
- PBegin - Class in org.apache.beam.sdk.values
-
- PBegin(Pipeline) - Constructor for class org.apache.beam.sdk.values.PBegin
-
- PCollection<T> - Class in org.apache.beam.sdk.values
-
- PCollection.IsBounded - Enum in org.apache.beam.sdk.values
-
The enumeration of cases for whether a
PCollection is bounded.
- PCollectionList<T> - Class in org.apache.beam.sdk.values
-
- pCollections() - Static method in class org.apache.beam.sdk.transforms.Flatten
-
- PCollectionTuple - Class in org.apache.beam.sdk.values
-
- PCollectionView<T> - Interface in org.apache.beam.sdk.values
-
- PDone - Class in org.apache.beam.sdk.values
-
PDone is the output of a
PTransform that has a trivial result,
such as a
Write.
- peekOutputElements() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns the elements output so far to the main output.
- peekOutputElementsInWindow(BoundedWindow) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns the elements output so far to the main output in the provided window with associated
timestamps.
- peekOutputElementsInWindow(TupleTag<OutputT>, BoundedWindow) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns the elements output so far to the specified output in the provided window with
associated timestamps.
- peekOutputElementsWithTimestamp() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns the elements output so far to the main output with associated timestamps.
- peekSideOutputElements(TupleTag<T>) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns the elements output so far to the side output with the
given tag.
- perElement() - Static method in class org.apache.beam.sdk.transforms.Count
-
- PerElement() - Constructor for class org.apache.beam.sdk.transforms.Count.PerElement
-
- perKey(int, ComparatorT) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles
-
Returns a PTransform that takes a
PCollection<KV<K, V>> and returns a
PCollection<KV<K, List<V>>> that contains an output
element mapping each distinct key in the input
PCollection to a List of the approximate
N-tiles of the values associated with that key in the
input PCollection.
- perKey(int) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles
-
- perKey(int) - Static method in class org.apache.beam.sdk.transforms.ApproximateUnique
-
Returns a PTransform that takes a
PCollection<KV<K, V>> and returns a
PCollection<KV<K, Long>> that contains an output element
mapping each distinct key in the input PCollection to an
estimate of the number of distinct values associated with that
key in the input PCollection.
- perKey(double) - Static method in class org.apache.beam.sdk.transforms.ApproximateUnique
-
- perKey(SerializableFunction<Iterable<V>, V>) - Static method in class org.apache.beam.sdk.transforms.Combine
-
Returns a
Combine.PerKey PTransform that
first groups its input
PCollection of
KVs by keys and
windows, then invokes the given function on each of the values lists to
produce a combined value, and then returns a
PCollection
of
KVs mapping each distinct key to its combined value for each
window.
- perKey(CombineFnBase.GlobalCombineFn<? super InputT, ?, OutputT>) - Static method in class org.apache.beam.sdk.transforms.Combine
-
Returns a
Combine.PerKey PTransform that
first groups its input
PCollection of
KVs by keys and
windows, then invokes the given function on each of the values lists to
produce a combined value, and then returns a
PCollection
of
KVs mapping each distinct key to its combined value for each
window.
- perKey(CombineFnBase.PerKeyCombineFn<? super K, ? super InputT, ?, OutputT>) - Static method in class org.apache.beam.sdk.transforms.Combine
-
Returns a
Combine.PerKey PTransform that
first groups its input
PCollection of
KVs by keys and
windows, then invokes the given function on each of the key/values-lists
pairs to produce a combined value, and then returns a
PCollection of
KVs mapping each distinct key to
its combined value for each window.
- perKey() - Static method in class org.apache.beam.sdk.transforms.Count
-
- perKey() - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform that takes an input PCollection<KV<K, T>> and returns a
PCollection<KV<K, T>> that contains an output element mapping each distinct key in the
input PCollection to the maximum according to the natural ordering of T of the
values associated with that key in the input PCollection.
- perKey(ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform that takes an input PCollection<KV<K, T>> and returns a
PCollection<KV<K, T>> that contains one output element per key mapping each
to the maximum of the values associated with that key in the input PCollection.
- perKey() - Static method in class org.apache.beam.sdk.transforms.Mean
-
Returns a PTransform that takes an input
PCollection<KV<K, N>> and returns a
PCollection<KV<K, Double>> that contains an output
element mapping each distinct key in the input
PCollection to the mean of the values associated with
that key in the input PCollection.
- perKey() - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform that takes an input PCollection<KV<K, T>> and returns a
PCollection<KV<K, T>> that contains an output element mapping each distinct key in the
input PCollection to the minimum according to the natural ordering of T of the
values associated with that key in the input PCollection.
- perKey(ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform that takes an input PCollection<KV<K, T>> and returns a
PCollection<KV<K, T>> that contains one output element per key mapping each
to the minimum of the values associated with that key in the input PCollection.
- perKey(int, ComparatorT) - Static method in class org.apache.beam.sdk.transforms.Top
-
Returns a PTransform that takes an input
PCollection<KV<K, V>> and returns a
PCollection<KV<K, List<V>>> that contains an output
element mapping each distinct key in the input
PCollection to the largest count values
associated with that key in the input
PCollection<KV<K, V>>, in decreasing order, sorted using
the given Comparator<V>.
- PInput - Interface in org.apache.beam.sdk.values
-
The interface for things that might be input to a
PTransform.
- Pipeline - Class in org.apache.beam.sdk
-
- Pipeline(PipelineRunner<?>) - Constructor for class org.apache.beam.sdk.Pipeline
-
- Pipeline(PipelineRunner<?>, PipelineOptions) - Constructor for class org.apache.beam.sdk.Pipeline
-
- Pipeline.PipelineExecutionException - Exception in org.apache.beam.sdk
-
Thrown during execution of a
Pipeline, whenever user code within that
Pipeline throws an exception.
- Pipeline.PipelineVisitor - Interface in org.apache.beam.sdk
-
- Pipeline.PipelineVisitor.CompositeBehavior - Enum in org.apache.beam.sdk
-
Control enum for indicating whether or not a traversal should process the contents of
a composite transform or not.
- Pipeline.PipelineVisitor.Defaults - Class in org.apache.beam.sdk
-
- PipelineExecutionException(Throwable) - Constructor for exception org.apache.beam.sdk.Pipeline.PipelineExecutionException
-
- PipelineOptions - Interface in org.apache.beam.sdk.options
-
PipelineOptions are used to configure Pipelines.
- PipelineOptions.CheckEnabled - Enum in org.apache.beam.sdk.options
-
Enumeration of the possible states for a given check.
- PipelineOptions.DirectRunner - Class in org.apache.beam.sdk.options
-
A
DefaultValueFactory that obtains the class of the
DirectRunner if it exists
on the classpath, and throws an exception otherwise.
- PipelineOptionsFactory - Class in org.apache.beam.sdk.options
-
- PipelineOptionsFactory() - Constructor for class org.apache.beam.sdk.options.PipelineOptionsFactory
-
- PipelineOptionsFactory.Builder - Class in org.apache.beam.sdk.options
-
- PipelineOptionsRegistrar - Interface in org.apache.beam.sdk.options
-
- PipelineOptionsValidator - Class in org.apache.beam.sdk.options
-
- PipelineOptionsValidator() - Constructor for class org.apache.beam.sdk.options.PipelineOptionsValidator
-
- PipelineResult - Interface in org.apache.beam.sdk
-
- PipelineResult.State - Enum in org.apache.beam.sdk
-
Named constants for common values for the job state.
- PipelineRunner<ResultT extends PipelineResult> - Class in org.apache.beam.sdk.runners
-
- PipelineRunner() - Constructor for class org.apache.beam.sdk.runners.PipelineRunner
-
- PipelineRunnerRegistrar - Interface in org.apache.beam.sdk.runners
-
- plusDelayOf(Duration) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
Adds some delay to the original target time.
- popNode() - Method in class org.apache.beam.sdk.runners.TransformHierarchy
-
Removes the last TransformTreeNode from the stack.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.CompressedSource
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.CountingInput.BoundedCountingInput
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.CountingInput.UnboundedCountingInput
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.FileBasedSink
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound.PubsubBoundedReader
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound.PubsubBoundedWriter
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.Read.Bounded
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.Read.Unbounded
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.Sink
-
Register display data for the given transform or component.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.Source
-
Register display data for the given transform or component.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.TextIO.Read.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.Write.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.XmlSink.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.XmlSource
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Combine.Globally
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Combine.GloballyAsSingletonView
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Combine.GroupedValues
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Combine.IterableCombineFn
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Combine.PerKey
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Combine.PerKeyWithHotKeyFanout
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFnWithContext
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFn
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFnWithContext
-
- populateDisplayData(DisplayData.Builder) - Method in interface org.apache.beam.sdk.transforms.display.HasDisplayData
-
Register display data for the given transform or component.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.DoFn
-
Register display data for the given transform or component.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.DoFnWithContext
-
Register display data for the given transform or component.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Filter
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.GroupByKey
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.MapElements
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Max.MaxFn
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Min.MinFn
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.ParDo.Bound
-
Register display data for the given transform or component.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Partition
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.PTransform
-
Register display data for the given transform or component.
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Sample.FixedSizedSampleFn
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Sample.SampleAny
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.Top.TopCombineFn
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.windowing.FixedWindows
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.windowing.Sessions
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
- populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn
-
Register display data for the given transform or component.
- POutput - Interface in org.apache.beam.sdk.values
-
The interface for things that might be output from a
PTransform.
- POutputValueBase - Class in org.apache.beam.sdk.values
-
- POutputValueBase(Pipeline) - Constructor for class org.apache.beam.sdk.values.POutputValueBase
-
- POutputValueBase() - Constructor for class org.apache.beam.sdk.values.POutputValueBase
-
No-arg constructor for Java serialization only.
- prefetchOnElement(StateAccessor<?>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- prefetchOnElement(StateAccessor<?>) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
- prefetchOnFire(StateAccessor<?>) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
- prefetchOnMerge(MergingStateAccessor<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- prefetchOnMerge(MergingStateAccessor<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- prefetchOnMerge(MergingStateAccessor<?, ?>) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
- prefetchShouldFire(StateAccessor<?>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- prefetchShouldFire(StateAccessor<?>) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- prefetchShouldFire(StateAccessor<?>) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
- prepareWrite(WritableByteChannel) - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriter
-
Called with the channel that a subclass will write its header, footer, and values to.
- prepareWrite(WritableByteChannel) - Method in class org.apache.beam.sdk.io.XmlSink.XmlWriter
-
Creates the output stream that elements will be written to.
- printHelp(PrintStream) - Static method in class org.apache.beam.sdk.options.PipelineOptionsFactory
-
Outputs the set of registered options with the PipelineOptionsFactory
with a description for each one if available to the output stream.
- printHelp(PrintStream, Class<? extends PipelineOptions>) - Static method in class org.apache.beam.sdk.options.PipelineOptionsFactory
-
Outputs the set of options available to be set for the passed in
PipelineOptions
interface.
- processBundle(Iterable<? extends InputT>) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- processBundle(InputT...) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
A convenience method for testing
DoFns with bundles of elements.
- ProcessContext() - Constructor for class org.apache.beam.sdk.transforms.DoFn.ProcessContext
-
- ProcessContext() - Constructor for class org.apache.beam.sdk.transforms.DoFnWithContext.ProcessContext
-
- processElement(DoFn<Void, T>.ProcessContext) - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound.PubsubBoundedReader
-
- processElement(DoFn<T, Void>.ProcessContext) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound.PubsubBoundedWriter
-
- processElement(DoFn<InputT, OutputT>.ProcessContext) - Method in class org.apache.beam.sdk.transforms.DoFn
-
Processes one input element.
- processElement(InputT) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- processElement(DoFn<InputT, OutputT>.ProcessContext) - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
-
- producesSortedKeys(PipelineOptions) - Method in class org.apache.beam.sdk.io.AvroSource
-
- producesSortedKeys(PipelineOptions) - Method in class org.apache.beam.sdk.io.BoundedSource
-
Whether this source is known to produce key/value pairs sorted by lexicographic order on
the bytes of the encoded key.
- producesSortedKeys(PipelineOptions) - Method in class org.apache.beam.sdk.io.CompressedSource
-
Returns whether the delegate source produces sorted keys.
- producesSortedKeys(PipelineOptions) - Method in class org.apache.beam.sdk.io.XmlSource
-
- ProtoCoder<T extends com.google.protobuf.Message> - Class in org.apache.beam.sdk.coders.protobuf
-
A
Coder using Google Protocol Buffers binary format.
- PROVIDER - Static variable in class org.apache.beam.sdk.coders.AvroCoder
-
- PROVIDER - Static variable in class org.apache.beam.sdk.coders.SerializableCoder
-
- PTransform<InputT extends PInput,OutputT extends POutput> - Class in org.apache.beam.sdk.transforms
-
A
PTransform<InputT, OutputT> is an operation that takes an
InputT (some subtype of
PInput) and produces an
OutputT (some subtype of
POutput).
- PTransform() - Constructor for class org.apache.beam.sdk.transforms.PTransform
-
- PTransform(String) - Constructor for class org.apache.beam.sdk.transforms.PTransform
-
- PubsubBoundedReader() - Constructor for class org.apache.beam.sdk.io.PubsubIO.Read.Bound.PubsubBoundedReader
-
- PubsubBoundedWriter() - Constructor for class org.apache.beam.sdk.io.PubsubIO.Write.Bound.PubsubBoundedWriter
-
- PubsubIO - Class in org.apache.beam.sdk.io
-
Read and Write
PTransforms for Cloud Pub/Sub streams.
- PubsubIO.PubsubSubscription - Class in org.apache.beam.sdk.io
-
Class representing a Cloud Pub/Sub Subscription.
- PubsubIO.PubsubTopic - Class in org.apache.beam.sdk.io
-
Class representing a Cloud Pub/Sub Topic.
- PubsubIO.Read - Class in org.apache.beam.sdk.io
-
- PubsubIO.Read.Bound<T> - Class in org.apache.beam.sdk.io
-
A
PTransform that reads from a Cloud Pub/Sub source and returns
a unbounded
PCollection containing the items from the stream.
- PubsubIO.Read.Bound.PubsubBoundedReader - Class in org.apache.beam.sdk.io
-
Default reader when Pubsub subscription has some form of upper bound.
- PubsubIO.Write - Class in org.apache.beam.sdk.io
-
- PubsubIO.Write.Bound<T> - Class in org.apache.beam.sdk.io
-
- PubsubIO.Write.Bound.PubsubBoundedWriter - Class in org.apache.beam.sdk.io
-
Writer to Pubsub which batches messages from bounded collections.
- PubsubOptions - Interface in org.apache.beam.sdk.options
-
Properties that can be set when using Pubsub with the Beam SDK.
- PubsubUnboundedSink<T> - Class in org.apache.beam.sdk.io
-
A PTransform which streams messages to Pubsub.
- PubsubUnboundedSink(PubsubClient.PubsubClientFactory, PubsubClient.TopicPath, Coder<T>, String, String, int) - Constructor for class org.apache.beam.sdk.io.PubsubUnboundedSink
-
- PubsubUnboundedSource<T> - Class in org.apache.beam.sdk.io
-
A PTransform which streams messages from Pubsub.
- PubsubUnboundedSource(PubsubClient.PubsubClientFactory, PubsubClient.ProjectPath, PubsubClient.TopicPath, PubsubClient.SubscriptionPath, Coder<T>, String, String) - Constructor for class org.apache.beam.sdk.io.PubsubUnboundedSource
-
Construct an unbounded source to consume from the Pubsub subscription.
- pushNode(TransformTreeNode) - Method in class org.apache.beam.sdk.runners.TransformHierarchy
-
Add a TransformTreeNode to the stack.
- PValue - Interface in org.apache.beam.sdk.values
-
The interface for values that can be input to and output from
PTransforms.
- PValueBase - Class in org.apache.beam.sdk.values
-
A
PValueBase is an abstract base class that provides
sensible default implementations for methods of
PValue.
- PValueBase(Pipeline) - Constructor for class org.apache.beam.sdk.values.PValueBase
-
- PValueBase() - Constructor for class org.apache.beam.sdk.values.PValueBase
-
No-arg constructor for Java serialization only.
- Sample - Class in org.apache.beam.sdk.transforms
-
PTransforms for taking samples of the elements in a
PCollection, or samples of the values associated with each
key in a PCollection of KVs.
- Sample() - Constructor for class org.apache.beam.sdk.transforms.Sample
-
- Sample.FixedSizedSampleFn<T> - Class in org.apache.beam.sdk.transforms
-
CombineFn that computes a fixed-size sample of a
collection of values.
- Sample.SampleAny<T> - Class in org.apache.beam.sdk.transforms
-
A
PTransform that takes a
PCollection<T> and a limit, and
produces a new
PCollection<T> containing up to limit
elements of the input
PCollection.
- satisfies(SerializableFunction<Iterable<T>, Void>) - Method in interface org.apache.beam.sdk.testing.PAssert.IterableAssert
-
Applies the provided checking function (presumably containing assertions) to the
iterable in question.
- satisfies(SerializableFunction<T, Void>) - Method in interface org.apache.beam.sdk.testing.PAssert.SingletonAssert
-
Applies the provided checking function (presumably containing assertions) to the
value in question.
- SerializableCoder<T extends Serializable> - Class in org.apache.beam.sdk.coders
-
- SerializableCoder(Class<T>) - Constructor for class org.apache.beam.sdk.coders.SerializableCoder
-
- SerializableComparator<T> - Interface in org.apache.beam.sdk.transforms
-
A Comparator that is also Serializable.
- SerializableFunction<InputT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
A function that computes an output value of type
OutputT from an input value of type
InputT and is
Serializable.
- SerializableMatcher<T> - Interface in org.apache.beam.sdk.testing
-
- Sessions - Class in org.apache.beam.sdk.transforms.windowing
-
- set(long...) - Static method in class org.apache.beam.sdk.testing.WindowFnTestUtils
-
- setAppName(String) - Method in interface org.apache.beam.sdk.options.ApplicationNameOptions
-
- setAuthorizationServerEncodedUrl(String) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setCloningBehavior(DoFnTester.CloningBehavior) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- SetCoder<T> - Class in org.apache.beam.sdk.coders
-
- SetCoder(Coder<T>) - Constructor for class org.apache.beam.sdk.coders.SetCoder
-
- setCoder(Coder<T>) - Method in class org.apache.beam.sdk.values.PCollection
-
Sets the
Coder used by this
PCollection to encode and decode the
values stored in it.
- setCoder(Coder<T>) - Method in class org.apache.beam.sdk.values.TypedPValue
-
Sets the
Coder used by this
TypedPValue to encode and decode the
values stored in it.
- setCoderRegistry(CoderRegistry) - Method in class org.apache.beam.sdk.Pipeline
-
- setCredentialDir(String) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setCredentialFactoryClass(Class<? extends CredentialFactory>) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setCredentialId(String) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setExecutorService(ExecutorService) - Method in interface org.apache.beam.sdk.options.GcsOptions
-
- setFallbackCoderProvider(CoderProvider) - Method in class org.apache.beam.sdk.coders.CoderRegistry
-
- setFinished(boolean) - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.TriggerInfo
-
Sets the finished bit for the current trigger.
- setFinished(boolean, int) - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.TriggerInfo
-
Sets the finished bit for the given sub-trigger.
- setGcpCredential(Credential) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setGcpTempLocation(String) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setGcsEndpoint(String) - Method in interface org.apache.beam.sdk.options.GcsOptions
-
- setGcsUploadBufferSizeBytes(Integer) - Method in interface org.apache.beam.sdk.options.GcsOptions
-
- setGcsUtil(GcsUtil) - Method in interface org.apache.beam.sdk.options.GcsOptions
-
- setGoogleApiTrace(GoogleApiDebugOptions.GoogleApiTracer) - Method in interface org.apache.beam.sdk.options.GoogleApiDebugOptions
-
- setIsBoundedInternal(PCollection.IsBounded) - Method in class org.apache.beam.sdk.values.PCollection
-
- setName(String) - Method in class org.apache.beam.sdk.values.PCollection
-
- setName(String) - Method in class org.apache.beam.sdk.values.PValueBase
-
- setOnCreateMatcher(SerializableMatcher<PipelineResult>) - Method in interface org.apache.beam.sdk.testing.TestPipelineOptions
-
- setOnSuccessMatcher(SerializableMatcher<PipelineResult>) - Method in interface org.apache.beam.sdk.testing.TestPipelineOptions
-
- setOutput(TransformTreeNode, POutput) - Method in class org.apache.beam.sdk.runners.TransformHierarchy
-
Sets the output of a transform node.
- setOutput(POutput) - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Adds an output to the transform node.
- setProject(String) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setPubsubRootUrl(String) - Method in interface org.apache.beam.sdk.options.PubsubOptions
-
- setRunner(Class<? extends PipelineRunner<?>>) - Method in interface org.apache.beam.sdk.options.PipelineOptions
-
- sets(TypeDescriptor<T>) - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- setSecretsFile(String) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setServiceAccountKeyfile(String) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setServiceAccountName(String) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setSideInput(PCollectionView<T>, BoundedWindow, T) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- setSideInputs(Map<PCollectionView<?>, Map<BoundedWindow, ?>>) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Registers the tuple of values of the side input
PCollectionViews to
pass to the
DoFn under test.
- setStableUniqueNames(PipelineOptions.CheckEnabled) - Method in interface org.apache.beam.sdk.options.PipelineOptions
-
- setStreaming(boolean) - Method in interface org.apache.beam.sdk.options.StreamingOptions
-
- setTempDatasetId(String) - Method in interface org.apache.beam.sdk.options.BigQueryOptions
-
- setTempLocation(String) - Method in interface org.apache.beam.sdk.options.PipelineOptions
-
- setTempRoot(String) - Method in interface org.apache.beam.sdk.testing.TestPipelineOptions
-
- setTimer(Instant, TimeDomain) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.OnElementContext
-
Sets a timer to fire when the watermark or processing time is beyond the given timestamp.
- setTimer(Instant, TimeDomain) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.OnMergeContext
-
Sets a timer to fire when the watermark or processing time is beyond the given timestamp.
- setTokenServerUrl(String) - Method in interface org.apache.beam.sdk.options.GcpOptions
-
- setTypeDescriptorInternal(TypeDescriptor<T>) - Method in class org.apache.beam.sdk.values.PCollection
-
- setTypeDescriptorInternal(TypeDescriptor<T>) - Method in class org.apache.beam.sdk.values.TypedPValue
-
- setupDelegateAggregators() - Method in class org.apache.beam.sdk.transforms.DoFn.Context
-
Sets up
Aggregators created by the
DoFn so they are
usable within this context.
- setWindowingStrategyInternal(WindowingStrategy<?, ?>) - Method in class org.apache.beam.sdk.values.PCollection
-
- ShardNameTemplate - Class in org.apache.beam.sdk.io
-
Standard shard naming templates.
- ShardNameTemplate() - Constructor for class org.apache.beam.sdk.io.ShardNameTemplate
-
- shorts() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterAll
-
Returns true if the current state of the trigger indicates that its condition
is satisfied and it is ready to fire.
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterEach
-
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterFirst
-
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.FromEndOfWindow
-
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.DefaultTrigger
-
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.Repeatedly
-
- shouldFire(Trigger.TriggerContext) - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
Returns true if the current state of the trigger indicates that its condition
is satisfied and it is ready to fire.
- sideInput(PCollectionView<T>) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.Context
-
Returns the value of the side input for the window corresponding to the
window of the main input element.
- sideInput(PCollectionView<T>) - Method in class org.apache.beam.sdk.transforms.DoFn.ProcessContext
-
Returns the value of the side input for the window corresponding to the
window of the main input element.
- sideInput(PCollectionView<T>) - Method in class org.apache.beam.sdk.transforms.DoFnWithContext.ProcessContext
-
Returns the value of the side input.
- sideOutput(TupleTag<T>, T) - Method in class org.apache.beam.sdk.transforms.DoFn.Context
-
Adds the given element to the side output PCollection with the
given tag.
- sideOutput(TupleTag<T>, T) - Method in class org.apache.beam.sdk.transforms.DoFnWithContext.Context
-
Adds the given element to the side output PCollection with the
given tag.
- sideOutputWithTimestamp(TupleTag<T>, T, Instant) - Method in class org.apache.beam.sdk.transforms.DoFn.Context
-
Adds the given element to the specified side output PCollection,
with the given timestamp.
- sideOutputWithTimestamp(TupleTag<T>, T, Instant) - Method in class org.apache.beam.sdk.transforms.DoFnWithContext.Context
-
Adds the given element to the specified side output PCollection,
with the given timestamp.
- SimpleCombineFn(SerializableFunction<Iterable<V>, V>) - Constructor for class org.apache.beam.sdk.transforms.Combine.SimpleCombineFn
-
Deprecated.
- SimpleFunction<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
- SimpleFunction() - Constructor for class org.apache.beam.sdk.transforms.SimpleFunction
-
- sink - Variable in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
The Sink that this WriteOperation will write to.
- Sink<T> - Class in org.apache.beam.sdk.io
-
A
Sink represents a resource that can be written to using the
Write transform.
- Sink() - Constructor for class org.apache.beam.sdk.io.Sink
-
- Sink.WriteOperation<T,WriteT> - Class in org.apache.beam.sdk.io
-
- Sink.Writer<T,WriteT> - Class in org.apache.beam.sdk.io
-
A Writer writes a bundle of elements from a PCollection to a sink.
- size() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResultSchema
-
Returns the number of columns for this schema.
- size() - Method in class org.apache.beam.sdk.values.PCollectionList
-
- size() - Method in class org.apache.beam.sdk.values.TupleTagList
-
Returns the number of TupleTags in this TupleTagList.
- SlidingWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn that windows values into possibly overlapping fixed-size
timestamp-based windows.
- smallest(int) - Static method in class org.apache.beam.sdk.transforms.Top
-
Returns a PTransform that takes an input
PCollection<T> and returns a PCollection<List<T>> with a
single element containing the smallest count elements of the input
PCollection<T>, in increasing order, sorted according to
their natural order.
- Smallest() - Constructor for class org.apache.beam.sdk.transforms.Top.Smallest
-
- smallestPerKey(int) - Static method in class org.apache.beam.sdk.transforms.Top
-
Returns a PTransform that takes an input
PCollection<KV<K, V>> and returns a
PCollection<KV<K, List<V>>> that contains an output
element mapping each distinct key in the input
PCollection to the smallest count values
associated with that key in the input
PCollection<KV<K, V>>, in increasing order, sorted
according to their natural order.
- Source<T> - Class in org.apache.beam.sdk.io
-
Base class for defining input formats and creating a Source for reading the input.
- Source() - Constructor for class org.apache.beam.sdk.io.Source
-
- Source.Reader<T> - Class in org.apache.beam.sdk.io
-
The interface that readers of custom input sources must implement.
- SourceTestUtils - Class in org.apache.beam.sdk.testing
-
Helper functions and test harnesses for checking correctness of
Source
implementations.
- SourceTestUtils() - Constructor for class org.apache.beam.sdk.testing.SourceTestUtils
-
- SourceTestUtils.ExpectedSplitOutcome - Enum in org.apache.beam.sdk.testing
-
- span(IntervalWindow) - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
Returns the minimal window that includes both this window and
the given window.
- split(int) - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
Returns a list of up to
numSplits + 1 ByteKeys in ascending order,
where the keys have been interpolated to form roughly equal sub-ranges of this
ByteKeyRange, assuming a uniform distribution of keys within this range.
- SPLIT_POINTS_UNKNOWN - Static variable in class org.apache.beam.sdk.io.BoundedSource.BoundedReader
-
- splitAtFraction(double) - Method in class org.apache.beam.sdk.io.BoundedSource.BoundedReader
-
Tells the reader to narrow the range of the input it's going to read and give up
the remainder, so that the new range would contain approximately the given
fraction of the amount of data in the current range.
- splitAtFraction(double) - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- splitIntoBundles(long, PipelineOptions) - Method in class org.apache.beam.sdk.io.BoundedSource
-
Splits the source into bundles of approximately desiredBundleSizeBytes.
- splitIntoBundles(long, PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- splitIntoBundles(long, PipelineOptions) - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
- StandardCoder<T> - Class in org.apache.beam.sdk.coders
-
- StandardCoder() - Constructor for class org.apache.beam.sdk.coders.StandardCoder
-
- start() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- start() - Method in class org.apache.beam.sdk.io.Source.Reader
-
Initializes the reader and advances the reader to the first record.
- start() - Method in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
Initializes the reader and advances the reader to the first record.
- start() - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
Returns the start of this window, inclusive.
- startBundle(DoFn<T, Void>.Context) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound.PubsubBoundedWriter
-
- startBundle(DoFn<InputT, OutputT>.Context) - Method in class org.apache.beam.sdk.transforms.DoFn
-
Prepares this DoFn instance for processing a batch of elements.
- startBundle() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- startBundle(DoFn<InputT, OutputT>.Context) - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
-
- startImpl() - Method in class org.apache.beam.sdk.io.FileBasedSource.FileBasedReader
-
- startImpl() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- startReading(ReadableByteChannel) - Method in class org.apache.beam.sdk.io.AvroSource.AvroReader
-
- startReading(ReadableByteChannel) - Method in class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
Creates a decompressing channel from the input channel and passes it to its delegate reader's
FileBasedReader#startReading(ReadableByteChannel).
- startReading(ReadableByteChannel) - Method in class org.apache.beam.sdk.io.FileBasedSource.FileBasedReader
-
Performs any initialization of the subclass of FileBasedReader that involves IO
operations.
- state() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.OnMergeContext
-
- state() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.TriggerContext
-
Returns the interface for accessing persistent state.
- StreamingOptions - Interface in org.apache.beam.sdk.options
-
Options used to configure streaming.
- StringDelegateCoder<T> - Class in org.apache.beam.sdk.coders
-
A
Coder that wraps a
Coder<String>
and encodes/decodes values via string representations.
- StringDelegateCoder(Class<T>) - Constructor for class org.apache.beam.sdk.coders.StringDelegateCoder
-
- strings() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- StringUtf8Coder - Class in org.apache.beam.sdk.coders
-
- StructuralByteArray - Class in org.apache.beam.sdk.coders
-
A wrapper around a byte[] that uses structural, value-based
equality rather than byte[]'s normal object identity.
- StructuralByteArray(byte[]) - Constructor for class org.apache.beam.sdk.coders.StructuralByteArray
-
- structuralValue(byte[]) - Method in class org.apache.beam.sdk.coders.ByteArrayCoder
-
Returns an object with an Object.equals() method that represents structural equality
on the argument.
- structuralValue(T) - Method in interface org.apache.beam.sdk.coders.Coder
-
Returns an object with an Object.equals() method that represents structural equality
on the argument.
- structuralValue(T) - Method in class org.apache.beam.sdk.coders.DelegateCoder
-
Returns an object with an Object.equals() method that represents structural equality
on the argument.
- structuralValue(KV<K, V>) - Method in class org.apache.beam.sdk.coders.KvCoder
-
- structuralValue(T) - Method in class org.apache.beam.sdk.coders.NullableCoder
-
- structuralValue(T) - Method in class org.apache.beam.sdk.coders.StandardCoder
-
- structuralValue(T) - Method in class org.apache.beam.sdk.coders.StringDelegateCoder
-
- structuralValueConsistentWithEquals(Coder<T>, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- structuralValueConsistentWithEqualsInContext(Coder<T>, Coder.Context, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- subscription(String) - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
Returns a transform that's like this one but reading from the
given subscription.
- subscription(String) - Static method in class org.apache.beam.sdk.io.PubsubIO.Read
-
Creates and returns a transform for reading from a specific Cloud Pub/Sub subscription.
- subTrigger(int) - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.TriggerInfo
-
Access the executable version of the specified sub-trigger.
- subTriggers - Variable in class org.apache.beam.sdk.transforms.windowing.Trigger
-
- subTriggers() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
- subTriggers() - Method in interface org.apache.beam.sdk.transforms.windowing.Trigger.TriggerInfo
-
Access the executable versions of the sub-triggers of the current trigger.
- SUCCESS_COUNTER - Static variable in class org.apache.beam.sdk.testing.PAssert
-
- Sum - Class in org.apache.beam.sdk.transforms
-
PTransforms for computing the sum of the elements in a
PCollection, or the sum of the values associated with
each key in a PCollection of KVs.
- Sum.SumDoubleFn - Class in org.apache.beam.sdk.transforms
-
- Sum.SumIntegerFn - Class in org.apache.beam.sdk.transforms
-
- Sum.SumLongFn - Class in org.apache.beam.sdk.transforms
-
- SumDoubleFn() - Constructor for class org.apache.beam.sdk.transforms.Sum.SumDoubleFn
-
- SumIntegerFn() - Constructor for class org.apache.beam.sdk.transforms.Sum.SumIntegerFn
-
- SumLongFn() - Constructor for class org.apache.beam.sdk.transforms.Sum.SumLongFn
-
- TableRowJsonCoder - Class in org.apache.beam.sdk.coders
-
A
Coder that encodes BigQuery
TableRow objects in their native JSON format.
- TaggedKeyedPCollection(TupleTag<V>, PCollection<KV<K, V>>) - Constructor for class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple.TaggedKeyedPCollection
-
- takeOutputElements() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns the elements output so far to the main output.
- takeOutputElementsWithTimestamp() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns the elements output so far to the main output with associated timestamps.
- takeSideOutputElements(TupleTag<T>) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
Returns the elements output so far to the side output with the given tag.
- TEMPORARY_FILENAME_SEPARATOR - Static variable in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Name separator for temporary files.
- temporaryFileRetention - Variable in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation
-
Option to keep or remove temporary output files.
- testingPipelineOptions() - Static method in class org.apache.beam.sdk.testing.TestPipeline
-
- TestPipeline - Class in org.apache.beam.sdk.testing
-
A creator of test pipelines that can be used inside of tests that can be
configured to run locally or against a remote pipeline runner.
- TestPipelineOptions - Interface in org.apache.beam.sdk.testing
-
- TestPipelineOptions.AlwaysPassMatcher - Class in org.apache.beam.sdk.testing
-
Matcher which will always pass.
- TestPipelineOptions.AlwaysPassMatcherFactory - Class in org.apache.beam.sdk.testing
-
- TextIO - Class in org.apache.beam.sdk.io
-
- TextIO.CompressionType - Enum in org.apache.beam.sdk.io
-
Possible text file compression types.
- TextIO.Read - Class in org.apache.beam.sdk.io
-
A
PTransform that reads from a text file (or multiple text
files matching a pattern) and returns a
PCollection containing
the decoding of each of the lines of the text file(s).
- TextIO.Read.Bound<T> - Class in org.apache.beam.sdk.io
-
A
PTransform that reads from one or more text files and returns a bounded
PCollection containing one element for each line of the input files.
- TextIO.Write - Class in org.apache.beam.sdk.io
-
A
PTransform that writes a
PCollection to text file (or
multiple text files matching a sharding pattern), with each
element of the input collection encoded into its own line.
- TextIO.Write.Bound<T> - Class in org.apache.beam.sdk.io
-
A PTransform that writes a bounded PCollection to a text file (or
multiple text files matching a sharding pattern), with each
PCollection element being encoded into its own line.
- TextualIntegerCoder - Class in org.apache.beam.sdk.coders
-
A
Coder that encodes
Integer Integers as the ASCII bytes of
their textual, decimal, representation.
- TextualIntegerCoder() - Constructor for class org.apache.beam.sdk.coders.TextualIntegerCoder
-
- that(PCollection<T>) - Static method in class org.apache.beam.sdk.testing.PAssert
-
- thatMap(PCollection<KV<K, V>>) - Static method in class org.apache.beam.sdk.testing.PAssert
-
- thatMultimap(PCollection<KV<K, V>>) - Static method in class org.apache.beam.sdk.testing.PAssert
-
- thatSingleton(PCollection<T>) - Static method in class org.apache.beam.sdk.testing.PAssert
-
Constructs a
PAssert.SingletonAssert for the value of the provided
PCollection PCollection<T>, which must be a singleton.
- thatSingletonIterable(PCollection<? extends Iterable<T>>) - Static method in class org.apache.beam.sdk.testing.PAssert
-
- timestamp() - Method in class org.apache.beam.sdk.transforms.DoFn.ProcessContext
-
Returns the timestamp of the input element.
- timestamp() - Method in class org.apache.beam.sdk.transforms.DoFnWithContext.ProcessContext
-
Returns the timestamp of the input element.
- timestamp() - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn.AssignContext
-
Returns the timestamp of the current element.
- TIMESTAMP_MAX_VALUE - Static variable in class org.apache.beam.sdk.transforms.windowing.BoundedWindow
-
- TIMESTAMP_MIN_VALUE - Static variable in class org.apache.beam.sdk.transforms.windowing.BoundedWindow
-
- timestamped(Iterable<TimestampedValue<T>>) - Static method in class org.apache.beam.sdk.transforms.Create
-
- timestamped(TimestampedValue<T>...) - Static method in class org.apache.beam.sdk.transforms.Create
-
- timestamped(Iterable<T>, Iterable<Long>) - Static method in class org.apache.beam.sdk.transforms.Create
-
Returns a new root transform that produces a
PCollection containing
the specified elements with the specified timestamps.
- TimestampedValue<V> - Class in org.apache.beam.sdk.values
-
An immutable pair of a value and a timestamp.
- TimestampedValue(V, Instant) - Constructor for class org.apache.beam.sdk.values.TimestampedValue
-
- TimestampedValue.TimestampedValueCoder<T> - Class in org.apache.beam.sdk.values
-
- timestampLabel(String) - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
Returns a transform that's like this one but that reads message timestamps
from the given message attribute.
- timestampLabel(String) - Static method in class org.apache.beam.sdk.io.PubsubIO.Read
-
Creates and returns a transform reading from Cloud Pub/Sub where record timestamps are
expected to be provided as Pub/Sub message attributes.
- timestampLabel(String) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
Returns a new transform that's like this one but that publishes record timestamps
to a message attribute with the specified name.
- timestampLabel(String) - Static method in class org.apache.beam.sdk.io.PubsubIO.Write
-
Creates a transform that writes to Pub/Sub, adds each record's timestamp to the published
messages in an attribute with the specified name.
- timestampMappers - Variable in class org.apache.beam.sdk.transforms.windowing.AfterDelayFromFirstElement
-
A list of timestampMappers m1, m2, m3, ...
- to(String) - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns a new
PTransform that's like this one but
that writes to the file(s) with the given filename prefix.
- to(String) - Static method in class org.apache.beam.sdk.io.AvroIO.Write
-
Returns a
PTransform that writes to the file(s)
with the given prefix.
- to(String) - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
Returns a transform for writing to text files that's like this one but
that writes to the file(s) with the given filename prefix.
- to(String) - Static method in class org.apache.beam.sdk.io.TextIO.Write
-
Returns a transform for writing to text files that writes to the file(s)
with the given prefix.
- to(Sink<T>) - Static method in class org.apache.beam.sdk.io.Write
-
Creates a
Write transform that writes to the given
Sink, letting the runner
control how many different shards are produced.
- toDoFn(DoFnWithContext<InputT, OutputT>) - Method in class org.apache.beam.sdk.transforms.DoFnReflector
-
- toFilenamePrefix(String) - Method in class org.apache.beam.sdk.io.XmlSink.Bound
-
Returns an XmlSink that writes to files with the given prefix.
- Top - Class in org.apache.beam.sdk.transforms
-
PTransforms for finding the largest (or smallest) set
of elements in a PCollection, or the largest (or smallest)
set of values associated with each key in a PCollection of
KVs.
- Top.Largest<T extends Comparable<? super T>> - Class in org.apache.beam.sdk.transforms
-
A Serializable Comparator that that uses the compared elements' natural
ordering.
- Top.Smallest<T extends Comparable<? super T>> - Class in org.apache.beam.sdk.transforms
-
Serializable Comparator that that uses the reverse of the compared elements'
natural ordering.
- Top.TopCombineFn<T,ComparatorT extends Comparator<T> & Serializable> - Class in org.apache.beam.sdk.transforms
-
CombineFn for Top transforms that combines a
bunch of Ts into a single count-long
List<T>, using compareFn to choose the largest
Ts.
- TopCombineFn(int, ComparatorT) - Constructor for class org.apache.beam.sdk.transforms.Top.TopCombineFn
-
- topic(String) - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
Returns a transform that's like this one but that reads from the specified topic.
- topic(String) - Static method in class org.apache.beam.sdk.io.PubsubIO.Read
-
Creates and returns a transform for reading from a Cloud Pub/Sub topic.
- topic(String) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
Returns a new transform that's like this one but that writes to the specified
topic.
- topic(String) - Static method in class org.apache.beam.sdk.io.PubsubIO.Write
-
Creates a transform that publishes to the specified topic.
- toString() - Method in class org.apache.beam.sdk.coders.Coder.Context
-
- toString() - Method in class org.apache.beam.sdk.coders.DelegateCoder
-
- toString() - Method in class org.apache.beam.sdk.coders.StandardCoder
-
- toString() - Method in class org.apache.beam.sdk.coders.StringDelegateCoder
-
- toString() - Method in class org.apache.beam.sdk.coders.StructuralByteArray
-
- toString() - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- toString() - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
- toString() - Method in class org.apache.beam.sdk.io.range.ByteKey
-
- toString() - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
- toString() - Method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
- toString() - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- toString() - Method in class org.apache.beam.sdk.Pipeline
-
- toString() - Method in class org.apache.beam.sdk.testing.TestPipeline
-
- toString() - Method in class org.apache.beam.sdk.transforms.AppliedPTransform
-
- toString() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Identifier
-
- toString() - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
- toString() - Method in class org.apache.beam.sdk.transforms.display.DisplayData
-
- toString() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult
-
- toString() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResultSchema
-
- toString() - Method in class org.apache.beam.sdk.transforms.join.RawUnionValue
-
- toString() - Method in class org.apache.beam.sdk.transforms.PTransform
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.AfterAll
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.AfterEach
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.AfterFirst
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.AfterPane
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.AfterProcessingTime
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.FromEndOfWindow
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.Repeatedly
-
- toString() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger
-
- toString() - Method in class org.apache.beam.sdk.values.KV
-
- toString() - Method in class org.apache.beam.sdk.values.PValueBase
-
- toString() - Method in class org.apache.beam.sdk.values.TimestampedValue
-
- toString() - Method in class org.apache.beam.sdk.values.TupleTag
-
- toString() - Method in class org.apache.beam.sdk.values.TypeDescriptor
-
- TransformHierarchy - Class in org.apache.beam.sdk.runners
-
Captures information about a collection of transformations and their
associated
PValues.
- TransformHierarchy() - Constructor for class org.apache.beam.sdk.runners.TransformHierarchy
-
Create a TransformHierarchy containing a root node.
- TransformTreeNode - Class in org.apache.beam.sdk.runners
-
Provides internal tracking of transform relationships with helper methods
for initialization and ordered visitation.
- TransformTreeNode(TransformTreeNode, PTransform<?, ?>, String, PInput) - Constructor for class org.apache.beam.sdk.runners.TransformTreeNode
-
Creates a new TransformTreeNode with the given parent and transform.
- traverseTopologically(Pipeline.PipelineVisitor) - Method in class org.apache.beam.sdk.Pipeline
-
- Trigger - Class in org.apache.beam.sdk.transforms.windowing
-
Triggers control when the elements for a specific key and window are output.
- Trigger(List<Trigger>) - Constructor for class org.apache.beam.sdk.transforms.windowing.Trigger
-
- trigger() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.OnMergeContext
-
- trigger() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.TriggerContext
-
Returns the interface for accessing trigger info.
- Trigger.MergingTriggerInfo - Interface in org.apache.beam.sdk.transforms.windowing
-
Interact with properties of the trigger being executed, with extensions to deal with the
merging windows.
- Trigger.OnceTrigger - Class in org.apache.beam.sdk.transforms.windowing
-
Triggers that are guaranteed to fire at most once should extend from this, rather
than the general
Trigger class to indicate that behavior.
- Trigger.OnElementContext - Class in org.apache.beam.sdk.transforms.windowing
-
- Trigger.OnMergeContext - Class in org.apache.beam.sdk.transforms.windowing
-
- Trigger.TriggerContext - Class in org.apache.beam.sdk.transforms.windowing
-
Information accessible to all operational hooks in this Trigger.
- Trigger.TriggerInfo - Interface in org.apache.beam.sdk.transforms.windowing
-
Interface for accessing information about the trigger being executed and other triggers in the
same tree.
- TriggerContext() - Constructor for class org.apache.beam.sdk.transforms.windowing.Trigger.TriggerContext
-
- triggering(Trigger) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
Sets a non-default trigger for this Window PTransform.
- triggering(Trigger) - Static method in class org.apache.beam.sdk.transforms.windowing.Window
-
Sets a non-default trigger for this Window PTransform.
- triggering(Trigger) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Unbound
-
Sets a non-default trigger for this Window PTransform.
- tryReturnRecordAt(boolean, ByteKey) - Method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
- tryReturnRecordAt(boolean, Long) - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- tryReturnRecordAt(boolean, long) - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- tryReturnRecordAt(boolean, PositionT) - Method in interface org.apache.beam.sdk.io.range.RangeTracker
-
Atomically determines whether a record at the given position can be returned and updates
internal state.
- trySplitAtPosition(ByteKey) - Method in class org.apache.beam.sdk.io.range.ByteKeyRangeTracker
-
- trySplitAtPosition(Long) - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- trySplitAtPosition(long) - Method in class org.apache.beam.sdk.io.range.OffsetRangeTracker
-
- trySplitAtPosition(PositionT) - Method in interface org.apache.beam.sdk.io.range.RangeTracker
-
- TupleTag<V> - Class in org.apache.beam.sdk.values
-
- TupleTag() - Constructor for class org.apache.beam.sdk.values.TupleTag
-
Constructs a new TupleTag, with a fresh unique id.
- TupleTag(String) - Constructor for class org.apache.beam.sdk.values.TupleTag
-
Constructs a new TupleTag with the given id.
- TupleTagList - Class in org.apache.beam.sdk.values
-
- TypeDescriptor<T> - Class in org.apache.beam.sdk.values
-
A description of a Java type, including actual generic parameters where possible.
- TypeDescriptor() - Constructor for class org.apache.beam.sdk.values.TypeDescriptor
-
- TypeDescriptor(Object) - Constructor for class org.apache.beam.sdk.values.TypeDescriptor
-
Creates a
TypeDescriptor representing the type parameter
T, which should
resolve to a concrete type in the context of the class
clazz.
- TypeDescriptor(Class<?>) - Constructor for class org.apache.beam.sdk.values.TypeDescriptor
-
Creates a
TypeDescriptor representing the type parameter
T, which should resolve to a concrete type in the context
of the class
clazz.
- TypeDescriptors - Class in org.apache.beam.sdk.values
-
A utility class containing the Java primitives for
TypeDescriptor equivalents.
- TypeDescriptors() - Constructor for class org.apache.beam.sdk.values.TypeDescriptors
-
- TypedPValue<T> - Class in org.apache.beam.sdk.values
-
A
TypedPValue<T> is the abstract base class of things that
store some number of values of type
T.
- TypedPValue(Pipeline) - Constructor for class org.apache.beam.sdk.values.TypedPValue
-
- validate() - Method in class org.apache.beam.sdk.io.AvroSource
-
- validate() - Method in class org.apache.beam.sdk.io.CompressedSource
-
Validates that the delegate source is a valid source and that the channel factory is not null.
- validate(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSink
-
Perform pipeline-construction-time validation.
- validate() - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- validate() - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
- validate(PipelineOptions) - Method in class org.apache.beam.sdk.io.Sink
-
Ensures that the sink is valid and can be written to before the write operation begins.
- validate() - Method in class org.apache.beam.sdk.io.Source
-
Checks that this source is valid, before it can be used in a pipeline.
- validate(PipelineOptions) - Method in class org.apache.beam.sdk.io.XmlSink.Bound
-
Validates that the root element, class to bind to a JAXB context, and filenamePrefix have
been set and that the class can be bound in a JAXB context.
- validate() - Method in class org.apache.beam.sdk.io.XmlSource
-
- validate(Class<T>, PipelineOptions) - Static method in class org.apache.beam.sdk.options.PipelineOptionsValidator
-
Validates that the passed
PipelineOptions conforms to all the validation criteria from
the passed in interface.
- validate(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.GroupByKey
-
- validate(InputT) - Method in class org.apache.beam.sdk.transforms.PTransform
-
Called before invoking apply (which may be intercepted by the runner) to
verify this transform is fully specified and applicable to the specified
input.
- validate(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.View.AsIterable
-
- validate(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.View.AsList
-
- validate(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.View.AsMap
-
- validate(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.View.AsMultimap
-
- validate(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.View.AsSingleton
-
- validate(PCollection<T>) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
- validateGetOutputTimestamp(WindowFn<T, W>, long) - Static method in class org.apache.beam.sdk.testing.WindowFnTestUtils
-
Assigns the given
timestamp to windows using the specified
windowFn, and
verifies that result of
windowFn.getOutputTime for later windows
(as defined by
maxTimestamp won't prevent the watermark from passing the end of earlier
windows.
- validateGetOutputTimestamps(WindowFn<T, W>, OutputTimeFn<? super W>, List<List<Long>>) - Static method in class org.apache.beam.sdk.testing.WindowFnTestUtils
-
Verifies that later-ending merged windows from any of the timestamps hold up output of
earlier-ending windows, using the provided
WindowFn and
OutputTimeFn.
- validateNonInterferingOutputTimes(WindowFn<T, W>, long) - Static method in class org.apache.beam.sdk.testing.WindowFnTestUtils
-
Assigns the given timestamp to windows using the specified windowFn, and
verifies that result of windowFn.getOutputTimestamp for each window is within the
proper bound.
- Validation - Annotation Type in org.apache.beam.sdk.options
-
- Validation.Required - Annotation Type in org.apache.beam.sdk.options
-
This criteria specifies that the value must be not null.
- valueOf(String) - Static method in enum org.apache.beam.sdk.annotations.Experimental.Kind
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.coders.CannotProvideCoderException.ReasonCode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.io.CompressedSource.CompressionMode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation.TemporaryFileRetention
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.io.FileBasedSource.Mode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.io.TextIO.CompressionType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.options.PipelineOptions.CheckEnabled
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.PipelineResult.State
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.testing.SourceTestUtils.ExpectedSplitOutcome
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.transforms.display.DisplayData.Type
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.transforms.DoFnTester.CloningBehavior
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.transforms.windowing.PaneInfo.Timing
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.transforms.windowing.Window.ClosingBehavior
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.beam.sdk.values.PCollection.IsBounded
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum org.apache.beam.sdk.annotations.Experimental.Kind
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.coders.CannotProvideCoderException.ReasonCode
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.io.CompressedSource.CompressionMode
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperation.TemporaryFileRetention
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.io.FileBasedSource.Mode
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.io.TextIO.CompressionType
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.options.PipelineOptions.CheckEnabled
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.PipelineResult.State
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.testing.SourceTestUtils.ExpectedSplitOutcome
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.transforms.display.DisplayData.Type
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.transforms.DoFnTester.CloningBehavior
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- Values<V> - Class in org.apache.beam.sdk.transforms
-
Values<V> takes a PCollection of KV<K, V>s and
returns a PCollection<V> of the values.
- values() - Static method in enum org.apache.beam.sdk.transforms.windowing.PaneInfo.Timing
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.transforms.windowing.Window.ClosingBehavior
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.beam.sdk.values.PCollection.IsBounded
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- VarIntCoder - Class in org.apache.beam.sdk.coders
-
- VarLongCoder - Class in org.apache.beam.sdk.coders
-
A
Coder that encodes
Longs using between 1 and 10 bytes.
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.AvroCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.ByteCoder
-
- verifyDeterministic() - Method in interface org.apache.beam.sdk.coders.Coder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.CustomCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.DelegateCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.DeterministicStandardCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.DoubleCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.IterableLikeCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.KvCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.ListCoder
-
List sizes are always known, so ListIterable may be deterministic while
the general IterableLikeCoder is not.
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.MapCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.NullableCoder
-
NullableCoder is deterministic if the nested Coder is.
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.SerializableCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.SetCoder
-
- verifyDeterministic(String, Iterable<Coder<?>>) - Method in class org.apache.beam.sdk.coders.StandardCoder
-
- verifyDeterministic(String, Coder<?>...) - Method in class org.apache.beam.sdk.coders.StandardCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.StringDelegateCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.coders.TableRowJsonCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.transforms.join.UnionCoder
-
- verifyDeterministic() - Method in class org.apache.beam.sdk.values.TimestampedValue.TimestampedValueCoder
-
- via(SerializableFunction<InputT, ? extends Iterable<OutputT>>) - Static method in class org.apache.beam.sdk.transforms.FlatMapElements
-
For a
SerializableFunction<InputT, ? extends Iterable<OutputT>> fn,
returns a
PTransform that applies
fn to every element of the input
PCollection<InputT> and outputs all of the elements to the output
PCollection<OutputT>.
- via(SimpleFunction<InputT, ? extends Iterable<OutputT>>) - Static method in class org.apache.beam.sdk.transforms.FlatMapElements
-
For a
SimpleFunction<InputT, ? extends Iterable<OutputT>> fn,
return a
PTransform that applies
fn to every element of the input
PCollection<InputT> and outputs all of the elements to the output
PCollection<OutputT>.
- via(SerializableFunction<InputT, OutputT>) - Static method in class org.apache.beam.sdk.transforms.MapElements
-
For a SerializableFunction<InputT, OutputT> fn and output type descriptor,
returns a PTransform that takes an input PCollection<InputT> and returns
a PCollection<OutputT> containing fn.apply(v) for every element v in
the input.
- via(SimpleFunction<InputT, OutputT>) - Static method in class org.apache.beam.sdk.transforms.MapElements
-
For a SimpleFunction<InputT, OutputT> fn, returns a PTransform that
takes an input PCollection<InputT> and returns a PCollection<OutputT>
containing fn.apply(v) for every element v in the input.
- View - Class in org.apache.beam.sdk.transforms
-
- View.AsIterable<T> - Class in org.apache.beam.sdk.transforms
-
Not intended for direct use by pipeline authors; public only so a
PipelineRunner may
override its behavior.
- View.AsList<T> - Class in org.apache.beam.sdk.transforms
-
Not intended for direct use by pipeline authors; public only so a
PipelineRunner may
override its behavior.
- View.AsMap<K,V> - Class in org.apache.beam.sdk.transforms
-
Not intended for direct use by pipeline authors; public only so a
PipelineRunner may
override its behavior.
- View.AsMultimap<K,V> - Class in org.apache.beam.sdk.transforms
-
Not intended for direct use by pipeline authors; public only so a
PipelineRunner may
override its behavior.
- View.AsSingleton<T> - Class in org.apache.beam.sdk.transforms
-
Not intended for direct use by pipeline authors; public only so a
PipelineRunner may
override its behavior.
- View.CreatePCollectionView<ElemT,ViewT> - Class in org.apache.beam.sdk.transforms
-
- visit(Pipeline.PipelineVisitor, Set<PValue>) - Method in class org.apache.beam.sdk.runners.TransformHierarchy
-
Visits all nodes in the transform hierarchy, in transitive order.
- visit(Pipeline.PipelineVisitor, Set<PValue>) - Method in class org.apache.beam.sdk.runners.TransformTreeNode
-
Visit the transform node.
- visitPrimitiveTransform(TransformTreeNode) - Method in class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults
-
- visitPrimitiveTransform(TransformTreeNode) - Method in interface org.apache.beam.sdk.Pipeline.PipelineVisitor
-
Called for each primitive transform after all of its topological predecessors
and inputs have been visited.
- visitValue(PValue, TransformTreeNode) - Method in class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults
-
- visitValue(PValue, TransformTreeNode) - Method in interface org.apache.beam.sdk.Pipeline.PipelineVisitor
-
Called for each value after the transform that produced the value has been
visited.
- VoidCoder - Class in org.apache.beam.sdk.coders
-
- weeks(int, int) - Static method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows
-
Returns a
WindowFn that windows elements into periods measured by weeks.
- window() - Method in class org.apache.beam.sdk.transforms.DoFn.ProcessContext
-
Returns the window into which the input element has been assigned.
- window() - Method in interface org.apache.beam.sdk.transforms.DoFnWithContext.ExtraContextFactory
-
- window() - Method in class org.apache.beam.sdk.transforms.windowing.Trigger.TriggerContext
-
The window that the current context is executing in.
- Window - Class in org.apache.beam.sdk.transforms.windowing
-
Window logically divides up or groups the elements of a
PCollection into finite windows according to a
WindowFn.
- Window() - Constructor for class org.apache.beam.sdk.transforms.windowing.Window
-
- window() - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn.AssignContext
-
Returns the window of the current element prior to this
WindowFn being called.
- Window.Bound<T> - Class in org.apache.beam.sdk.transforms.windowing
-
A PTransform that windows the elements of a PCollection<T>,
into finite windows according to a user-specified WindowFn.
- Window.ClosingBehavior - Enum in org.apache.beam.sdk.transforms.windowing
-
Specifies the conditions under which a final pane will be created when a window is permanently
closed.
- Window.Unbound - Class in org.apache.beam.sdk.transforms.windowing
-
An incomplete Window transform, with unbound input/output type.
- windowCoder() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- windowCoder() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- windowCoder() - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- windowCoder() - Method in class org.apache.beam.sdk.transforms.windowing.FixedWindows
-
- windowCoder() - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindows
-
- windowCoder() - Method in class org.apache.beam.sdk.transforms.windowing.InvalidWindows
-
- windowCoder() - Method in class org.apache.beam.sdk.transforms.windowing.Sessions
-
- windowCoder() - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- windowCoder() - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn
-
Returns the
Coder used for serializing the windows used
by this windowFn.
- WindowFn<T,W extends BoundedWindow> - Class in org.apache.beam.sdk.transforms.windowing
-
The argument to the
Window transform used to assign elements into
windows and to determine how windows are merged.
- WindowFn() - Constructor for class org.apache.beam.sdk.transforms.windowing.WindowFn
-
- WindowFn.AssignContext - Class in org.apache.beam.sdk.transforms.windowing
-
- WindowFn.MergeContext - Class in org.apache.beam.sdk.transforms.windowing
-
- WindowFnTestUtils - Class in org.apache.beam.sdk.testing
-
- WindowFnTestUtils() - Constructor for class org.apache.beam.sdk.testing.WindowFnTestUtils
-
- windowingInternals() - Method in class org.apache.beam.sdk.transforms.DoFn.ProcessContext
-
Returns the process context to use for implementing windowing.
- windowingInternals() - Method in interface org.apache.beam.sdk.transforms.DoFnWithContext.ExtraContextFactory
-
Construct the
WindowingInternals to use within a
DoFnWithContext that
needs it.
- windows() - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn.MergeContext
-
Returns the current set of windows.
- with(SimpleFunction<DataT, InputT>, Combine.CombineFn<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposeCombineFnBuilder
-
- with(SimpleFunction<DataT, InputT>, CombineWithContext.CombineFnWithContext<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposeCombineFnBuilder
-
- with(SimpleFunction<DataT, InputT>, Combine.CombineFn<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- with(SimpleFunction<DataT, InputT>, CombineWithContext.CombineFnWithContext<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- with(SimpleFunction<DataT, InputT>, CombineFnBase.GlobalCombineFn<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFnWithContext
-
- with(SimpleFunction<DataT, InputT>, Combine.KeyedCombineFn<K, InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFn
-
- with(SimpleFunction<DataT, InputT>, CombineWithContext.KeyedCombineFnWithContext<K, InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFn
-
- with(SimpleFunction<DataT, InputT>, Combine.CombineFn<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFn
-
- with(SimpleFunction<DataT, InputT>, CombineWithContext.CombineFnWithContext<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFn
-
- with(SimpleFunction<DataT, InputT>, CombineFnBase.PerKeyCombineFn<K, InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFnWithContext
-
- with(SimpleFunction<DataT, InputT>, CombineFnBase.GlobalCombineFn<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedKeyedCombineFnWithContext
-
- with(SimpleFunction<DataT, InputT>, Combine.KeyedCombineFn<K, InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposeKeyedCombineFnBuilder
-
- with(SimpleFunction<DataT, InputT>, CombineWithContext.KeyedCombineFnWithContext<K, InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposeKeyedCombineFnBuilder
-
- with(SimpleFunction<DataT, InputT>, Combine.CombineFn<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposeKeyedCombineFnBuilder
-
- with(SimpleFunction<DataT, InputT>, CombineWithContext.CombineFnWithContext<InputT, ?, OutputT>, TupleTag<OutputT>) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposeKeyedCombineFnBuilder
-
- withAllowedLateness(Duration) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
Override the amount of lateness allowed for data elements in the pipeline.
- withAllowedLateness(Duration, Window.ClosingBehavior) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
Override the amount of lateness allowed for data elements in the pipeline.
- withAllowedLateness(Duration) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Unbound
-
Override the amount of lateness allowed for data elements in the pipeline.
- withAllowedLateness(Duration, Window.ClosingBehavior) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Unbound
-
Override the amount of lateness allowed for data elements in the pipeline.
- withAllowedLateness(Duration) - Static method in class org.apache.beam.sdk.transforms.windowing.Window
-
Override the amount of lateness allowed for data elements in the output
PCollection,
and downstream
PCollections until explicitly set again.
- withAllowedLateness(Duration, Window.ClosingBehavior) - Static method in class org.apache.beam.sdk.transforms.windowing.Window
-
Override the amount of lateness allowed for data elements in the output
PCollection,
and downstream
PCollections until explicitly set again.
- withAllowedTimestampSkew(Duration) - Method in class org.apache.beam.sdk.transforms.WithTimestamps
-
Return a new WithTimestamps like this one with updated allowed timestamp skew, which is the
maximum duration that timestamps can be shifted backward.
- withCoder(Coder<X>) - Method in class org.apache.beam.sdk.io.PubsubIO.Read.Bound
-
Returns a transform that's like this one but that uses the given
Coder to decode each record into a value of type
X.
- withCoder(Coder<T>) - Static method in class org.apache.beam.sdk.io.PubsubIO.Read
-
Creates and returns a transform for reading from Cloud Pub/Sub that uses the given
Coder to decode Pub/Sub messages into a value of type
T.
- withCoder(Coder<X>) - Method in class org.apache.beam.sdk.io.PubsubIO.Write.Bound
-
Returns a new transform that's like this one
but that uses the given
Coder to encode each of
the elements of the input
PCollection into an
output record.
- withCoder(Coder<T>) - Static method in class org.apache.beam.sdk.io.PubsubIO.Write
-
Creates a transform that uses the given
Coder to encode each of the
elements of the input collection into an output message.
- withCoder(Coder<X>) - Method in class org.apache.beam.sdk.io.TextIO.Read.Bound
-
Returns a new transform for reading from text files that's like this one but
that uses the given
Coder to decode each of the
lines of the file into a value of type
X.
- withCoder(Coder<T>) - Static method in class org.apache.beam.sdk.io.TextIO.Read
-
Returns a transform for reading text files that uses the given
Coder<T> to decode each of the lines of the file into a
value of type T.
- withCoder(Coder<X>) - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
Returns a transform for writing to text files that's like this one
but that uses the given
Coder to encode each of
the elements of the input
PCollection into an
output text line.
- withCoder(Coder<T>) - Static method in class org.apache.beam.sdk.io.TextIO.Write
-
Returns a transform for writing to text files that uses the given
Coder to encode each of the elements of the input
PCollection into an output text line.
- withCoder(Coder<T>) - Method in class org.apache.beam.sdk.transforms.Create.TimestampedValues
-
Returns a
Create.TimestampedValues PTransform like this one that uses the given
Coder<T> to decode each of the objects into a
value of type
T.
- withCoder(Coder<T>) - Method in class org.apache.beam.sdk.transforms.Create.Values
-
Returns a
Create.Values PTransform like this one that uses the given
Coder<T> to decode each of the objects into a
value of type
T.
- withCompressionType(TextIO.CompressionType) - Method in class org.apache.beam.sdk.io.TextIO.Read.Bound
-
Returns a new transform for reading from text files that's like this one but
reads from input sources using the specified compression type.
- withCompressionType(TextIO.CompressionType) - Static method in class org.apache.beam.sdk.io.TextIO.Read
-
Returns a transform for reading text files that decompresses all input files
using the specified compression type.
- withDecompression(CompressedSource.DecompressingChannelFactory) - Method in class org.apache.beam.sdk.io.CompressedSource
-
- withDefaultValue(T) - Method in class org.apache.beam.sdk.transforms.View.AsSingleton
-
Default value to return for windows with no value in them.
- withEarlyFirings(Trigger.OnceTrigger) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- withEarlyFirings(Trigger.OnceTrigger) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.FromEndOfWindow
-
Creates a new Trigger like the this, except that it fires repeatedly whenever
the given Trigger fires before the watermark has passed the end of the window.
- withEndKey(ByteKey) - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
Returns new
ByteKeyRange like this one, but with the specified end key.
- withEpsilon(double) - Method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
Returns an ApproximateQuantilesCombineFn that's like
this one except that it uses the specified epsilon
value.
- withExtensionsFrom(Iterable<Class<?>>) - Method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
Returns a
ProtoCoder like this one, but with the extensions from the given classes
registered.
- withExtensionsFrom(Class<?>...) - Method in class org.apache.beam.sdk.coders.protobuf.ProtoCoder
-
- withFanout(int) - Method in class org.apache.beam.sdk.transforms.Combine.Globally
-
Returns a
PTransform identical to this, but that uses an intermediate node
to combine parts of the data to reduce load on the final global combine step.
- withGapDuration(Duration) - Static method in class org.apache.beam.sdk.transforms.windowing.Sessions
-
Creates a
Sessions WindowFn with the specified gap duration.
- withHotKeyFanout(SerializableFunction<? super K, Integer>) - Method in class org.apache.beam.sdk.transforms.Combine.PerKey
-
If a single key has disproportionately many values, it may become a
bottleneck, especially in streaming mode.
- withHotKeyFanout(int) - Method in class org.apache.beam.sdk.transforms.Combine.PerKey
-
- WithKeys<K,V> - Class in org.apache.beam.sdk.transforms
-
WithKeys<K, V> takes a PCollection<V>, and either a
constant key of type K or a function from V to
K, and returns a PCollection<KV<K, V>>, where each
of the values in the input PCollection has been paired with
either the constant key or a key computed from the value.
- withKeyType(TypeDescriptor<K>) - Method in class org.apache.beam.sdk.transforms.WithKeys
-
Return a
WithKeys that is like this one with the specified key type descriptor.
- withLabel(String) - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
- withLateFirings(Trigger.OnceTrigger) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.AfterWatermarkEarlyAndLate
-
- withLateFirings(Trigger.OnceTrigger) - Method in class org.apache.beam.sdk.transforms.windowing.AfterWatermark.FromEndOfWindow
-
Creates a new Trigger like the this, except that it fires repeatedly whenever
the given Trigger fires after the watermark has passed the end of the window.
- withLinkUrl(String) - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
- withMaxInputSize(long) - Method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
Returns an ApproximateQuantilesCombineFn that's like
this one except that it uses the specified maxNumElements
value.
- withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.CountingInput.UnboundedCountingInput
-
- withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.Read.Unbounded
-
Returns a new
BoundedReadFromUnboundedSource that reads a bounded amount
of data from the given
UnboundedSource.
- withMaxParallelism(int) - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.Bound
-
- withMaxParallelism(int) - Method in class org.apache.beam.sdk.transforms.IntraBundleParallelization.Unbound
-
- withMaxParallelism(int) - Static method in class org.apache.beam.sdk.transforms.IntraBundleParallelization
-
- withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.CountingInput.UnboundedCountingInput
-
- withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.Read.Unbounded
-
Returns a new
BoundedReadFromUnboundedSource that reads a bounded amount
of data from the given
UnboundedSource.
- withMinBundleSize(long) - Method in class org.apache.beam.sdk.io.AvroSource
-
Returns an
AvroSource that's like this one but uses the supplied minimum bundle size.
- withMinBundleSize(long) - Method in class org.apache.beam.sdk.io.XmlSource
-
Sets a parameter minBundleSize for the minimum bundle size of the source.
- withNamespace(Class<?>) - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
- withNamespace(String) - Method in class org.apache.beam.sdk.transforms.display.DisplayData.Item
-
- withNumShards(int) - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns a new
PTransform that's like this one but
that uses the provided shard count.
- withNumShards(int) - Static method in class org.apache.beam.sdk.io.AvroIO.Write
-
Returns a
PTransform that uses the provided shard count.
- withNumShards(int) - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
Returns a transform for writing to text files that's like this one but
that uses the provided shard count.
- withNumShards(int) - Static method in class org.apache.beam.sdk.io.TextIO.Write
-
Returns a transform for writing to text files that uses the provided shard count.
- withNumShards(int) - Method in class org.apache.beam.sdk.io.Write.Bound
-
Returns a new
Write.Bound that will write to the current
Sink using the
specified number of shards.
- withOffset(Duration) - Method in class org.apache.beam.sdk.transforms.windowing.FixedWindows
-
Partitions the timestamp space into half-open intervals of the form
[N * size + offset, (N + 1) * size + offset),
where 0 is the epoch.
- withOffset(Duration) - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
Assigns timestamps into half-open intervals of the form
[N * period + offset, N * period + offset + size).
- withoutDefaults() - Method in class org.apache.beam.sdk.transforms.Combine.Globally
-
Returns a
PTransform identical to this, but that does not attempt to
provide a default value in the case of empty input.
- withOutputTags(TupleTag<OutputT>, TupleTagList) - Method in class org.apache.beam.sdk.transforms.ParDo.Bound
-
- withOutputTags(TupleTag<OutputT>, TupleTagList) - Method in class org.apache.beam.sdk.transforms.ParDo.Unbound
-
Returns a new multi-output
ParDo transform that's like
this transform but with the specified main and side output
tags.
- withOutputTags(TupleTag<OutputT>, TupleTagList) - Static method in class org.apache.beam.sdk.transforms.ParDo
-
Creates a multi-output
ParDo PTransform whose
output
PCollections will be referenced using the given main
output and side output tags.
- withOutputTimeFn(OutputTimeFn<?>) - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound
-
(Experimental) Override the default
OutputTimeFn, to control
the output timestamp of values output from a
GroupByKey operation.
- withOutputType(TypeDescriptor<OutputT>) - Method in class org.apache.beam.sdk.transforms.FlatMapElements.MissingOutputTypeDescriptor
-
- withOutputType(TypeDescriptor<OutputT>) - Method in class org.apache.beam.sdk.transforms.MapElements.MissingOutputTypeDescriptor
-
- withoutSharding() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns a new
PTransform that's like this one but
that forces a single file as output.
- withoutSharding() - Static method in class org.apache.beam.sdk.io.AvroIO.Write
-
Returns a
PTransform that forces a single file as
output.
- withoutSharding() - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
Returns a transform for writing to text files that's like this one but
that forces a single file as output.
- withoutSharding() - Static method in class org.apache.beam.sdk.io.TextIO.Write
-
Returns a transform for writing to text files that forces a single file as
output.
- withoutStrictParsing() - Method in class org.apache.beam.sdk.options.PipelineOptionsFactory.Builder
-
During parsing of the arguments, we will skip over improperly formatted and unknown
arguments.
- withoutValidation() - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
Returns a new
PTransform that's like this one but
that has GCS input path validation on pipeline creation disabled.
- withoutValidation() - Static method in class org.apache.beam.sdk.io.AvroIO.Read
-
Returns a
PTransform that reads Avro file(s)
that has GCS path validation on pipeline creation disabled.
- withoutValidation() - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns a new
PTransform that's like this one but
that has GCS output path validation on pipeline creation disabled.
- withoutValidation() - Static method in class org.apache.beam.sdk.io.AvroIO.Write
-
Returns a
PTransform that writes Avro file(s) that has GCS path validation on
pipeline creation disabled.
- withoutValidation() - Method in class org.apache.beam.sdk.io.TextIO.Read.Bound
-
Returns a new transform for reading from text files that's like this one but
that has GCS path validation on pipeline creation disabled.
- withoutValidation() - Static method in class org.apache.beam.sdk.io.TextIO.Read
-
Returns a transform for reading text files that has GCS path validation on
pipeline creation disabled.
- withoutValidation() - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
Returns a transform for writing to text files that's like this one but
that has GCS output path validation on pipeline creation disabled.
- withoutValidation() - Static method in class org.apache.beam.sdk.io.TextIO.Write
-
Returns a transform for writing to text files that has GCS path validation on
pipeline creation disabled.
- withRate(long, Duration) - Method in class org.apache.beam.sdk.io.CountingInput.UnboundedCountingInput
-
Returns an
CountingInput.UnboundedCountingInput like this one, but with output production limited
to an aggregate rate of no more than the number of elements per the period length.
- withRecordClass(Class<T>) - Method in class org.apache.beam.sdk.io.XmlSource
-
Sets a JAXB annotated class that can be populated using a record of the provided XML file.
- withRecordElement(String) - Method in class org.apache.beam.sdk.io.XmlSource
-
Sets name of the record element of the XML document.
- withRepresentativeType(TypeDescriptor<IdT>) - Method in class org.apache.beam.sdk.transforms.RemoveDuplicates.WithRepresentativeValues
-
Return a
WithRepresentativeValues PTransform that is like this one, but with
the specified output type descriptor.
- withRepresentativeValueFn(SerializableFunction<T, IdT>) - Static method in class org.apache.beam.sdk.transforms.RemoveDuplicates
-
Returns a RemoveDuplicates<T, IdT> PTransform.
- withRootElement(String) - Method in class org.apache.beam.sdk.io.XmlSink.Bound
-
Returns an XmlSink that writes XML files with an enclosing root element of the
supplied name.
- withRootElement(String) - Method in class org.apache.beam.sdk.io.XmlSource
-
Sets name of the root element of the XML document.
- withSchema(Class<X>) - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
Returns a new
PTransform that's like this one but
that reads Avro file(s) containing records whose type is the
specified Avro-generated class.
- withSchema(Schema) - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
Returns a new
PTransform that's like this one but
that reads Avro file(s) containing records of the specified schema.
- withSchema(String) - Method in class org.apache.beam.sdk.io.AvroIO.Read.Bound
-
Returns a new
PTransform that's like this one but
that reads Avro file(s) containing records of the specified schema
in a JSON-encoded string form.
- withSchema(Class<T>) - Static method in class org.apache.beam.sdk.io.AvroIO.Read
-
Returns a
PTransform that reads Avro file(s)
containing records whose type is the specified Avro-generated class.
- withSchema(Schema) - Static method in class org.apache.beam.sdk.io.AvroIO.Read
-
Returns a
PTransform that reads Avro file(s)
containing records of the specified schema.
- withSchema(String) - Static method in class org.apache.beam.sdk.io.AvroIO.Read
-
Returns a
PTransform that reads Avro file(s)
containing records of the specified schema in a JSON-encoded
string form.
- withSchema(Class<X>) - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns a new
PTransform that's like this one but
that writes to Avro file(s) containing records whose type is the
specified Avro-generated class.
- withSchema(Schema) - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns a new
PTransform that's like this one but
that writes to Avro file(s) containing records of the specified
schema.
- withSchema(String) - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns a new
PTransform that's like this one but
that writes to Avro file(s) containing records of the specified
schema in a JSON-encoded string form.
- withSchema(Class<T>) - Static method in class org.apache.beam.sdk.io.AvroIO.Write
-
Returns a
PTransform that writes Avro file(s)
containing records whose type is the specified Avro-generated class.
- withSchema(Schema) - Static method in class org.apache.beam.sdk.io.AvroIO.Write
-
Returns a
PTransform that writes Avro file(s)
containing records of the specified schema.
- withSchema(String) - Static method in class org.apache.beam.sdk.io.AvroIO.Write
-
Returns a
PTransform that writes Avro file(s)
containing records of the specified schema in a JSON-encoded
string form.
- withSchema(String) - Method in class org.apache.beam.sdk.io.AvroSource
-
Returns an
AvroSource that's like this one but reads files containing records that
conform to the given schema.
- withSchema(Schema) - Method in class org.apache.beam.sdk.io.AvroSource
-
Returns an
AvroSource that's like this one but reads files containing records that
conform to the given schema.
- withSchema(Class<X>) - Method in class org.apache.beam.sdk.io.AvroSource
-
Returns an
AvroSource that's like this one but reads files containing records of the
type of the given class.
- withShardNameTemplate(String) - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns a new
PTransform that's like this one but
that uses the given shard name template.
- withShardNameTemplate(String) - Static method in class org.apache.beam.sdk.io.AvroIO.Write
-
Returns a
PTransform that uses the given shard name
template.
- withShardNameTemplate(String) - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
Returns a transform for writing to text files that's like this one but
that uses the given shard name template.
- withShardNameTemplate(String) - Static method in class org.apache.beam.sdk.io.TextIO.Write
-
Returns a transform for writing to text files that uses the given shard name
template.
- withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class org.apache.beam.sdk.transforms.Combine.Globally
-
- withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class org.apache.beam.sdk.transforms.Combine.GroupedValues
-
- withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class org.apache.beam.sdk.transforms.Combine.PerKey
-
- withSideInputs(PCollectionView<?>...) - Method in class org.apache.beam.sdk.transforms.ParDo.Bound
-
- withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class org.apache.beam.sdk.transforms.ParDo.Bound
-
- withSideInputs(PCollectionView<?>...) - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class org.apache.beam.sdk.transforms.ParDo.BoundMulti
-
- withSideInputs(PCollectionView<?>...) - Method in class org.apache.beam.sdk.transforms.ParDo.Unbound
-
Returns a new
ParDo transform that's like this
transform but with the specified additional side inputs.
- withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class org.apache.beam.sdk.transforms.ParDo.Unbound
-
Returns a new
ParDo transform that is like this
transform but with the specified additional side inputs.
- withSideInputs(PCollectionView<?>...) - Method in class org.apache.beam.sdk.transforms.ParDo.UnboundMulti
-
Returns a new multi-output
ParDo transform that's like
this transform but with the specified side inputs.
- withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class org.apache.beam.sdk.transforms.ParDo.UnboundMulti
-
Returns a new multi-output
ParDo transform that's like
this transform but with the specified additional side inputs.
- withSideInputs(PCollectionView<?>...) - Static method in class org.apache.beam.sdk.transforms.ParDo
-
- withSideInputs(Iterable<? extends PCollectionView<?>>) - Static method in class org.apache.beam.sdk.transforms.ParDo
-
Creates a
ParDo with the given side inputs.
- withSingletonValues() - Method in class org.apache.beam.sdk.transforms.View.AsMap
-
- withStartingDay(int, int, int) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- withStartingMonth(int, int) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- withStartingYear(int) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- withStartKey(ByteKey) - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
Returns new
ByteKeyRange like this one, but with the specified start key.
- withSuffix(String) - Method in class org.apache.beam.sdk.io.AvroIO.Write.Bound
-
Returns a new
PTransform that's like this one but
that writes to the file(s) with the given filename suffix.
- withSuffix(String) - Static method in class org.apache.beam.sdk.io.AvroIO.Write
-
Returns a
PTransform that writes to the file(s) with the
given filename suffix.
- withSuffix(String) - Method in class org.apache.beam.sdk.io.TextIO.Write.Bound
-
Returns a transform for writing to text files that that's like this one but
that writes to the file(s) with the given filename suffix.
- withSuffix(String) - Static method in class org.apache.beam.sdk.io.TextIO.Write
-
Returns a transform for writing to text files that appends the specified suffix
to the created files.
- withTimestampFn(SerializableFunction<Long, Instant>) - Method in class org.apache.beam.sdk.io.CountingInput.UnboundedCountingInput
-
- WithTimestamps<T> - Class in org.apache.beam.sdk.transforms
-
- withTimeZone(DateTimeZone) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- withTimeZone(DateTimeZone) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- withTimeZone(DateTimeZone) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- withValidation() - Method in class org.apache.beam.sdk.options.PipelineOptionsFactory.Builder
-
After creation we will validate that
PipelineOptions conforms to all the
validation criteria from
<T>.
- withValidation() - Method in class org.apache.beam.sdk.options.PipelineOptionsFactory
-
After creation we will validate that <T> conforms to all the
validation criteria.
- write(T) - Method in class org.apache.beam.sdk.io.Sink.Writer
-
Called for each value in the bundle.
- Write() - Constructor for class org.apache.beam.sdk.io.TextIO.Write
-
- Write - Class in org.apache.beam.sdk.io
-
- Write() - Constructor for class org.apache.beam.sdk.io.Write
-
- write() - Static method in class org.apache.beam.sdk.io.XmlSink
-
Returns a builder for an XmlSink.
- write(T) - Method in class org.apache.beam.sdk.io.XmlSink.XmlWriter
-
Writes a value to the stream.
- Write.Bound<T> - Class in org.apache.beam.sdk.io
-
- writeFooter() - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriter
-
Writes footer at the end of output files.
- writeFooter() - Method in class org.apache.beam.sdk.io.XmlSink.XmlWriter
-
Writes the root element closing tag.
- writeHeader() - Method in class org.apache.beam.sdk.io.FileBasedSink.FileBasedWriter
-
Writes header at the beginning of output files.
- writeHeader() - Method in class org.apache.beam.sdk.io.XmlSink.XmlWriter
-
Writes the root element opening tag.
- writeOf(Class<T>, String, String) - Static method in class org.apache.beam.sdk.io.XmlSink
-
Returns an XmlSink that writes objects as XML entities.
- WriteOperation() - Constructor for class org.apache.beam.sdk.io.Sink.WriteOperation
-
- Writer() - Constructor for class org.apache.beam.sdk.io.Sink.Writer
-