B C D F G H K L M N O P R S T V

B

bundleSizeDistribution - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions

Distribution for generating initial split bundles.

bytesPerRecord - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The size of a single record used for size estimation in bytes.

C

cpuUtilizationInMixedDelay - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

CPU utilization when delayType is 'MIXED'.

createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticBoundedSource

createSourceForSubrange(long, long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticBoundedSource

D

delayType - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

When 'delayDistribution' is configured, this indicates how the delay enforced ("SLEEP", "CPU", or "MIXED").

F

forceNumInitialBundles - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions

If specified, this source will split into exactly this many bundles regardless of the hints provided by the service.

fromIntegerDistribution(IntegerDistribution) - Static method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

fromRealDistribution(RealDistribution) - Static method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

G

genKvPair(long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

genRecord(long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions

getBytesPerOffset() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticBoundedSource

getDefaultOutputCoder() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticBoundedSource

getDistribution() - Method in interface org.apache.beam.sdk.io.synthetic.SyntheticOptions.Sampler

getMaxEndOffset(PipelineOptions) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticBoundedSource

H

hashFunction() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

hotKeyFraction - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The fraction of records associated with "hot" keys, which are uniformly distributed over a fixed number of hot keys.

K

keySizeBytes - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The key size in bytes.

kv - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions.Record

L

largeKeyFraction - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The fraction of keys that should be larger than others.

largeKeySizeBytes - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The size of large keys.

M

maxWorkerThroughput - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

An upper limit on throughput across the worker for this step.

N

nextDelay(long) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

numHotKeys - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The number of distinct "hot" keys.

numRecords - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions

Total number of generated records.

O

Options() - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

org.apache.beam.sdk.io.synthetic - package org.apache.beam.sdk.io.synthetic

Transforms for performing Synthetic Operations in Apache Beam pipelines.

outputRecordsPerInputRecord - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

Amplification/filtering ratio: the number of output records should be emitted on average for each input record.

P

perBundleDelay - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

Number of milliseconds to delay for in each bundle.

perBundleDelayType - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

Type of per bundle delay to use ("SLEEP", "CPU", "MIXED").

preservesInputKeyDistribution - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

If false, the DoFn generates a different distribution of KV pairs according to the parameters in SyntheticOptions, and input records are merely used as a “clock”; If true, the shape of the input distribution is preserved, and the DoFn only does sleeping and amplification/filtering.

processElement(DoFn<KV<byte[], byte[]>, KV<byte[], byte[]>>.ProcessContext) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticStep

progressShape - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions

See SyntheticBoundedIO.ProgressShape.

R

readFrom(SyntheticBoundedIO.SyntheticSourceOptions) - Static method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO

Read from the synthetic source options.

reportThrottlingMicros - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

If true, reports time spent sleeping as 'cumulativeThrottlingMicros' metric.

S

sample(long) - Method in interface org.apache.beam.sdk.io.synthetic.SyntheticOptions.Sampler

seed - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The seed is used for generating a hash function implementing the 128-bit murmur3 algorithm.

setSeed(int) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

sleepMsec - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions.Record

split(long, PipelineOptions) - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticBoundedSource

splitPointFrequencyRecords - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions

Only records whose index is a multiple of this will be split points.

startBundle() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticStep

SyntheticBoundedIO - Class in org.apache.beam.sdk.io.synthetic

This SyntheticBoundedIO class provides a parameterizable batch custom source that is deterministic.

SyntheticBoundedIO() - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO

SyntheticBoundedIO.ProgressShape - Enum in org.apache.beam.sdk.io.synthetic

Shape of the progress reporting curve as a function of the current offset in the SyntheticBoundedIO.SyntheticBoundedSource.

SyntheticBoundedIO.SyntheticBoundedSource - Class in org.apache.beam.sdk.io.synthetic

A SyntheticBoundedIO.SyntheticBoundedSource that reads KV<byte[], byte[]>.

SyntheticBoundedIO.SyntheticSourceOptions - Class in org.apache.beam.sdk.io.synthetic

Synthetic bounded source options.

SyntheticBoundedIO.SyntheticSourceOptions.Record - Class in org.apache.beam.sdk.io.synthetic

Record generated by SyntheticBoundedIO.SyntheticSourceOptions.genRecord(long).

SyntheticBoundedSource(SyntheticBoundedIO.SyntheticSourceOptions) - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticBoundedSource

SyntheticOptions - Class in org.apache.beam.sdk.io.synthetic

This SyntheticOptions class provides common parameterizable synthetic options that are used by SyntheticBoundedIO.

SyntheticOptions.DelayType - Enum in org.apache.beam.sdk.io.synthetic

The type of Delay that will be produced.

SyntheticOptions.Sampler - Interface in org.apache.beam.sdk.io.synthetic

Wrapper over a distribution.

SyntheticSourceOptions() - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions

SyntheticStep - Class in org.apache.beam.sdk.io.synthetic

This SyntheticStep class provides a parameterizable DoFn that consumes KV<byte[], byte[]> and emits KV<byte[], byte[]>.

SyntheticStep(SyntheticStep.Options) - Constructor for class org.apache.beam.sdk.io.synthetic.SyntheticStep

SyntheticStep.Options - Class in org.apache.beam.sdk.io.synthetic

Synthetic step options.

T

toString() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticBoundedSource

toString() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

V

validate() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticBoundedSource

validate() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.SyntheticSourceOptions

validate() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

validate() - Method in class org.apache.beam.sdk.io.synthetic.SyntheticStep.Options

valueOf(String) - Static method in enum org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.ProgressShape

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.beam.sdk.io.synthetic.SyntheticOptions.DelayType

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.beam.sdk.io.synthetic.SyntheticBoundedIO.ProgressShape

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.beam.sdk.io.synthetic.SyntheticOptions.DelayType

Returns an array containing the constants of this enum type, in the order they are declared.

valueSizeBytes - Variable in class org.apache.beam.sdk.io.synthetic.SyntheticOptions

The value size in bytes.

B C D F G H K L M N O P R S T V