B C E G H I L O P R S V W
All Classes All Packages

B

build() - Method in class org.apache.beam.sdk.io.sparkreceiver.ReceiverBuilder

C

createBlockGenerator(BlockGeneratorListener) - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

E

expand(PBegin) - Method in class org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO.Read

G

getCurrentRateLimit() - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

getEndOffset() - Method in interface org.apache.beam.sdk.io.sparkreceiver.HasOffset

getSparkReceiverClass() - Method in class org.apache.beam.sdk.io.sparkreceiver.ReceiverBuilder

H

HasOffset - Interface in org.apache.beam.sdk.io.sparkreceiver

Interface for any Spark Receiver that supports reading from and to some offset.

I

isReceiverStopped() - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

L

logInfo(Function0<String>) - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

O

onReceiverStart() - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

org.apache.beam.sdk.io.sparkreceiver - package org.apache.beam.sdk.io.sparkreceiver

Transforms for reading and writing from streaming CDAP plugins.

P

pushArrayBuffer(ArrayBuffer<?>, Option<Object>, Option<StreamBlockId>) - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

pushBytes(ByteBuffer, Option<Object>, Option<StreamBlockId>) - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

pushIterator(Iterator<?>, Option<Object>, Option<StreamBlockId>) - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

pushSingle(Object) - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

R

read() - Static method in class org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO

Read() - Constructor for class org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO.Read

ReceiverBuilder<X,T extends org.apache.spark.streaming.receiver.Receiver<X>> - Class in org.apache.beam.sdk.io.sparkreceiver

Class for building an instance for Receiver that uses Apache Beam mechanisms instead of Spark environment.

ReceiverBuilder(Class<T>) - Constructor for class org.apache.beam.sdk.io.sparkreceiver.ReceiverBuilder

reportError(String, Throwable) - Method in class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

S

setStartOffset(Long) - Method in interface org.apache.beam.sdk.io.sparkreceiver.HasOffset

SparkReceiverIO - Class in org.apache.beam.sdk.io.sparkreceiver

Streaming sources for Spark Receiver.

SparkReceiverIO() - Constructor for class org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO

SparkReceiverIO.Read<V> - Class in org.apache.beam.sdk.io.sparkreceiver

A PTransform to read from Spark Receiver.

V

validateTransform() - Method in class org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO.Read

W

withConstructorArgs(Object...) - Method in class org.apache.beam.sdk.io.sparkreceiver.ReceiverBuilder

Method for specifying constructor arguments for corresponding ReceiverBuilder.sparkReceiverClass.

withGetOffsetFn(SerializableFunction<V, Long>) - Method in class org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO.Read

A function to get offset in order to start Receiver from it.

withSparkReceiverBuilder(ReceiverBuilder<V, ? extends Receiver<V>>) - Method in class org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO.Read

Sets ReceiverBuilder with value and custom Spark Receiver class.

withTimestampFn(SerializableFunction<V, Instant>) - Method in class org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO.Read

A function to calculate timestamp for a record.

WrappedSupervisor - Class in org.apache.beam.sdk.io.sparkreceiver

Wrapper class for ReceiverSupervisor that doesn't use Spark Environment.

WrappedSupervisor(Receiver<?>, SparkConf, SerializableFunction<Object[], Void>) - Constructor for class org.apache.beam.sdk.io.sparkreceiver.WrappedSupervisor

B C E G H I L O P R S V W
All Classes All Packages