A C D E F G H I K M O P R S T U V W

A

apply(PBegin) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

apply(PBegin) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWithoutMetadata

apply(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

C

close() - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.CoderBasedKafkaSerializer

CoderBasedKafkaSerializer() - Constructor for class org.apache.beam.sdk.io.kafka.KafkaIO.CoderBasedKafkaSerializer

configure(Map<String, ?>, boolean) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.CoderBasedKafkaSerializer

consistentWithEquals() - Method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

consumerConfig - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

consumerFactoryFn - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

D

decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

E

encode(KafkaRecord<K, V>, OutputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

equals(Object) - Method in class org.apache.beam.sdk.io.kafka.KafkaRecord

F

finalizeCheckpoint() - Method in class org.apache.beam.sdk.io.kafka.KafkaCheckpointMark

G

getCoderArguments() - Method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

getKV() - Method in class org.apache.beam.sdk.io.kafka.KafkaRecord

getOffset() - Method in class org.apache.beam.sdk.io.kafka.KafkaCheckpointMark.PartitionMark

getOffset() - Method in class org.apache.beam.sdk.io.kafka.KafkaRecord

getPartition() - Method in class org.apache.beam.sdk.io.kafka.KafkaRecord

getPartitions() - Method in class org.apache.beam.sdk.io.kafka.KafkaCheckpointMark

getTopic() - Method in class org.apache.beam.sdk.io.kafka.KafkaRecord

getTopicPartition() - Method in class org.apache.beam.sdk.io.kafka.KafkaCheckpointMark.PartitionMark

H

hashCode() - Method in class org.apache.beam.sdk.io.kafka.KafkaRecord

I

isRegisterByteSizeObserverCheap(KafkaRecord<K, V>, Coder.Context) - Method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

K

KafkaCheckpointMark - Class in org.apache.beam.sdk.io.kafka

Checkpoint for an unbounded KafkaIO.Read.

KafkaCheckpointMark(List<KafkaCheckpointMark.PartitionMark>) - Constructor for class org.apache.beam.sdk.io.kafka.KafkaCheckpointMark

KafkaCheckpointMark.PartitionMark - Class in org.apache.beam.sdk.io.kafka

A tuple to hold topic, partition, and offset that comprise the checkpoint for a single partition.

KafkaIO - Class in org.apache.beam.sdk.io.kafka

An unbounded source and a sink for Kafka topics.

KafkaIO.CoderBasedKafkaSerializer<T> - Class in org.apache.beam.sdk.io.kafka

Implements Kafka's Serializer with a Coder.

KafkaIO.Read<K,V> - Class in org.apache.beam.sdk.io.kafka

A PTransform to read from Kafka topics.

KafkaIO.TypedRead<K,V> - Class in org.apache.beam.sdk.io.kafka

A PTransform to read from Kafka topics.

KafkaIO.TypedWithoutMetadata<K,V> - Class in org.apache.beam.sdk.io.kafka

A PTransform to read from Kafka topics.

KafkaIO.TypedWrite<K,V> - Class in org.apache.beam.sdk.io.kafka

A PTransform to write to a Kafka topic.

KafkaIO.Write<K,V> - Class in org.apache.beam.sdk.io.kafka

A PTransform to write to a Kafka topic.

KafkaRecord<K,V> - Class in org.apache.beam.sdk.io.kafka

KafkaRecord contains key and value of the record as well as metadata for the record (topic name, partition id, and offset).

KafkaRecord(String, int, long, K, V) - Constructor for class org.apache.beam.sdk.io.kafka.KafkaRecord

KafkaRecord(String, int, long, KV<K, V>) - Constructor for class org.apache.beam.sdk.io.kafka.KafkaRecord

KafkaRecordCoder<K,V> - Class in org.apache.beam.sdk.io.kafka

Coder for KafkaRecord.

KafkaRecordCoder(Coder<K>, Coder<V>) - Constructor for class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

keyCoder - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

keyCoder - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

M

maxNumRecords - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

maxReadTime - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

O

of(List<Coder<?>>) - Static method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

of(Coder<K>, Coder<V>) - Static method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

org.apache.beam.sdk.io.kafka - package org.apache.beam.sdk.io.kafka

P

PartitionMark(TopicPartition, long) - Constructor for class org.apache.beam.sdk.io.kafka.KafkaCheckpointMark.PartitionMark

producerConfig - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

producerFactoryFnOpt - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

R

read() - Static method in class org.apache.beam.sdk.io.kafka.KafkaIO

Creates an uninitialized KafkaIO.Read PTransform.

S

serialize(String, T) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.CoderBasedKafkaSerializer

structuralValue(KafkaRecord<K, V>) - Method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

T

timestampFn - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

topic - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

topicPartitions - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

topics - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

TypedWrite(String, Coder<K>, Coder<V>, Map<String, Object>, Optional<SerializableFunction<Map<String, Object>, Producer<K, V>>>) - Constructor for class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

U

updateConsumerProperties(Map<String, Object>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read

Update consumer configuration with new properties.

updateProducerProperties(Map<String, Object>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Write

V

validate(PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

valueCoder - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

valueCoder - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

values() - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

Returns a new transform that writes just the values to Kafka.

verifyDeterministic() - Method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder

W

watermarkFn - Variable in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

withBootstrapServers(String) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read

Returns a new KafkaIO.Read with Kafka consumer pointing to bootstrapServers.

withBootstrapServers(String) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Write

Returns a new KafkaIO.Write transform with Kafka producer pointing to bootstrapServers.

withConsumerFactoryFn(SerializableFunction<Map<String, Object>, Consumer<byte[], byte[]>>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read

A factory to create Kafka Consumer from consumer configuration.

withKeyCoder(Coder<KeyT>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read

Returns a new KafkaIO.Read with Coder for key bytes.

withKeyCoder(Coder<KeyT>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Write

Returns a new KafkaIO.Write with Coder for serializing key (if any) to bytes.

withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read

Similar to Read.Unbounded.withMaxNumRecords(long).

withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read

Similar to Read.Unbounded.withMaxReadTime(Duration).

withoutMetadata() - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

Returns a PTransform for PCollection of KV, dropping Kafka metatdata.

withProducerFactoryFn(SerializableFunction<Map<String, Object>, Producer<K, V>>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedWrite

Returns a new KafkaIO.Write with a custom function to create Kafka producer.

withTimestampFn(SerializableFunction<KV<K, V>, Instant>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

A function to assign a timestamp to a record.

withTimestampFn2(SerializableFunction<KafkaRecord<K, V>, Instant>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

A function to assign a timestamp to a record.

withTopic(String) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Write

Returns a new KafkaIO.Write transform that write to given topic.

withTopicPartitions(List<TopicPartition>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read

Returns a new KafkaIO.Read that reads from the partitions.

withTopics(List<String>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read

Returns a new KafkaIO.Read that reads from the topics.

withValueCoder(Coder<ValueT>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read

Returns a new KafkaIO.Read with Coder for value bytes.

withValueCoder(Coder<ValueT>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Write

Returns a new KafkaIO.Write with Coder for serializing value to bytes.

withWatermarkFn(SerializableFunction<KV<K, V>, Instant>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

A function to calculate watermark after a record.

withWatermarkFn2(SerializableFunction<KafkaRecord<K, V>, Instant>) - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.TypedRead

A function to calculate watermark after a record.

write() - Static method in class org.apache.beam.sdk.io.kafka.KafkaIO

Creates an uninitialized KafkaIO.Write PTransform.

A C D E F G H I K M O P R S T U V W