B C D F G H K L M N O P R S T V W

B

bundleSizeDistribution - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

Distribution for generating initial split bundles.

BundleSplitter - Class in org.apache.beam.sdk.io.synthetic

Determines bundle sizes based on @{link SyntheticSourceOptions}.

BundleSplitter(SyntheticSourceOptions) - Constructor for class org.apache.beam.sdk.io.synthetic.BundleSplitter

bytesPerRecord - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The size of a single record used for size estimation in bytes.

C

cpuUtilizationInMixedDelay - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

CPU utilization when delayType is 'MIXED'.

createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

createReader(PipelineOptions, SyntheticRecordsCheckpoint) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource

createSourceForSubrange(long, long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

D

delay(Duration, double, SyntheticOptions.DelayType, Random) - Static method in class org.apache.beam.sdk.io.synthetic.delay.SyntheticDelay

Implements a mechanism to delay a thread in various fashions.

delayRecord(SyntheticSourceOptions.Record) - Method in class org.apache.beam.sdk.io.synthetic.delay.ReaderDelay

delayStart(long) - Method in class org.apache.beam.sdk.io.synthetic.delay.ReaderDelay

delayType - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

When 'delayDistribution' is configured, this indicates how the delay enforced ("SLEEP", "CPU", or "MIXED").

F

forceNumInitialBundles - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

If specified, this source will split into exactly this many bundles regardless of the hints provided by the service.

fromIntegerDistribution(IntegerDistribution) - Static method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

fromJsonString(String, Class<T>) - Static method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

fromRealDistribution(RealDistribution) - Static method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

G

genKvPair(long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

genRecord(long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

getBytesPerOffset() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

getCheckpointMarkCoder() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource

getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

getDistribution() - Method in interface org.apache.beam.sdk.io.synthetic.SyntheticOptions.Sampler

getMaxEndOffset(PipelineOptions) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

getOutputCoder() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource

H

hashFunction() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

hotKeyFraction - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The fraction of records associated with "hot" keys, which are uniformly distributed over a fixed number of hot keys.

K

keySizeBytes - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The key size in bytes.

kv - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions.Record

L

largeKeyFraction - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The fraction of keys that should be larger than others.

largeKeySizeBytes - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The size of large keys.

M

maxWorkerThroughput - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

An upper limit on throughput across the worker for this step.

N

nextDelay(long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

nextInitializeDelay(long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

Generates a random delay value for the synthetic source initialization using the distribution defined by SyntheticSourceOptions.initializeDelayDistribution.

nextProcessingTimeDelay(long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

Generates a random delay value between event and processing time using the distribution defined by SyntheticSourceOptions.processingTimeDelayDistribution.

numHotKeys - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The number of distinct "hot" keys.

numRecords - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

Total number of generated records.

O

Options() - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

org.apache.beam.sdk.io.synthetic - package org.apache.beam.sdk.io.synthetic

Transforms for performing Synthetic Operations in Apache Beam pipelines.

org.apache.beam.sdk.io.synthetic.delay - package org.apache.beam.sdk.io.synthetic.delay

Delay related classes.

outputRecordsPerInputRecord - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

Amplification/filtering ratio: the number of output records should be emitted on average for each input record.

P

perBundleDelay - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

Number of milliseconds to delay for in each bundle.

perBundleDelayType - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

Type of per bundle delay to use ("SLEEP", "CPU", "MIXED").

preservesInputKeyDistribution - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

If false, the DoFn generates a different distribution of KV pairs according to the parameters in SyntheticOptions, and input records are merely used as a “clock”; If true, the shape of the input distribution is preserved, and the DoFn only does sleeping and amplification/filtering.

processElement(DoFn<KV<byte[], byte[]>, KV<byte[], byte[]>>.ProcessContext) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticStep

progressShape - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

See SyntheticSourceOptions.ProgressShape.

R

ReaderDelay - Class in org.apache.beam.sdk.io.synthetic.delay

Imposes delays in synthetic Source.Reader classes.

ReaderDelay(SyntheticSourceOptions) - Constructor for class org.apache.beam.sdk.io.synthetic.delay.ReaderDelay

reportThrottlingMicros - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

If true, reports time spent sleeping as 'cumulativeThrottlingMicros' metric.

S

sample(long) - Method in interface org.apache.beam.sdk.io.synthetic.SyntheticOptions.Sampler

seed - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The seed is used for generating a hash function implementing the 128-bit murmur3 algorithm.

setSeed(int) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

sleepMsec - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions.Record

split(long, PipelineOptions) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

split(int, PipelineOptions) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource

splitPointFrequencyRecords - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

Only records whose index is a multiple of this will be split points.

startBundle() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticStep

SyntheticBoundedSource - Class in org.apache.beam.sdk.io.synthetic

A SyntheticBoundedSource that reads KV<byte[], byte[]>.

SyntheticBoundedSource(SyntheticSourceOptions) - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

SyntheticBoundedSource(long, long, SyntheticSourceOptions) - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

SyntheticDelay - Class in org.apache.beam.sdk.io.synthetic.delay

Utility functions used in org.apache.beam.sdk.io.synthetic.

SyntheticDelay() - Constructor for class org.apache.beam.sdk.io.synthetic.delay.SyntheticDelay

SyntheticOptions - Class in org.apache.beam.sdk.io.synthetic

This SyntheticOptions class provides common parameterizable synthetic options that are used by SyntheticBoundedSource and SyntheticUnboundedSource.

SyntheticOptions.DelayType - Enum in org.apache.beam.sdk.io.synthetic

The type of Delay that will be produced.

SyntheticOptions.Sampler - Interface in org.apache.beam.sdk.io.synthetic

Wrapper over a distribution.

SyntheticSourceOptions - Class in org.apache.beam.sdk.io.synthetic

Synthetic bounded source options.

SyntheticSourceOptions() - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

SyntheticSourceOptions.ProgressShape - Enum in org.apache.beam.sdk.io.synthetic

Shape of the progress reporting curve as a function of the current offset in the SyntheticBoundedSource.

SyntheticSourceOptions.Record - Class in org.apache.beam.sdk.io.synthetic

Record generated by SyntheticSourceOptions.genRecord(long).

SyntheticStep - Class in org.apache.beam.sdk.io.synthetic

This SyntheticStep class provides a parameterizable DoFn that consumes KV<byte[], byte[]> and emits KV<byte[], byte[]>.

SyntheticStep(SyntheticStep.Options) - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticStep

SyntheticStep.Options - Class in org.apache.beam.sdk.io.synthetic

Synthetic step options.

SyntheticUnboundedSource - Class in org.apache.beam.sdk.io.synthetic

A SyntheticUnboundedSource that reads KV<byte[], byte[]>.

SyntheticUnboundedSource(SyntheticSourceOptions) - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource

T

toString() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

toString() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

V

validate() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource

validate() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

validate() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

validate() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

validate() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource

valueOf(String) - Static method in enum org.apache.beam.sdk.io.synthetic.SyntheticOptions.DelayType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions.ProgressShape

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.beam.sdk.io.synthetic.SyntheticOptions.DelayType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions.ProgressShape

Returns an array containing the constants of this enum type, in the order they are declared.

valueSizeBytes - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The value size in bytes.

W

watermarkDriftMillis - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

Could be either positive and negative.

watermarkSearchInAdvanceCount - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticSourceOptions

Defines how many elements should the watermark function check in advance to "predict" how the record distribution will look like.

B C D F G H K L M N O P R S T V W