A C D E F G H I L O P R S T V Z

A

add(E) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Adds the element to the queue, or fails with an exception, if the queue is closed.

addIfOpen(E) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Tries to add an element to the queue, if the queue is still open.

C

cancel() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

ClosableBlockingQueue<E> - Class in org.apache.flink.streaming.connectors.kafka.internals

A special form of blocking queue with two additions: The queue can be closed atomically when empty.

ClosableBlockingQueue() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Creates a new empty queue.

ClosableBlockingQueue(int) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Creates a new empty queue, reserving space for at least the specified number of elements.

ClosableBlockingQueue(Collection<? extends E>) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Creates a new queue that contains the given elements.

close() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Tries to close the queue.

close() - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Closes the fetcher.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

close() - Method in interface org.apache.flink.streaming.connectors.kafka.internals.OffsetHandler

Closes the offset handler, releasing all resources.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

commit(Map<KafkaTopicPartition, Long>) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.OffsetHandler

Commits the given offset for the partitions.

commit(Map<KafkaTopicPartition, Long>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

commitOffsets(HashMap<KafkaTopicPartition, Long>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Utility method to commit offsets.

D

DEFAULT_GET_PARTITIONS_RETRIES - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Default number of retries for getting the partition info.

E

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

F

Fetcher - Interface in org.apache.flink.streaming.connectors.kafka.internals

A fetcher pulls data from Kafka, from a fix set of partitions.

FlinkKafkaConsumer08<T> - Class in org.apache.flink.streaming.connectors.kafka

The Flink Kafka Consumer is a streaming data source that pulls a parallel data stream from Apache Kafka 0.8.x.

FlinkKafkaConsumer08(String, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Creates a new Kafka streaming source consumer for Kafka 0.8.x

FlinkKafkaConsumer08(String, KeyedDeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Creates a new Kafka streaming source consumer for Kafka 0.8.x This constructor allows passing a KeyedDeserializationSchema for reading key/value pairs, offsets, and topic names from Kafka.

FlinkKafkaConsumer08(List<String>, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Creates a new Kafka streaming source consumer for Kafka 0.8.x This constructor allows passing multiple topics to the consumer.

FlinkKafkaConsumer08(List<String>, KeyedDeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Creates a new Kafka streaming source consumer for Kafka 0.8.x This constructor allows passing multiple topics and a key/value deserialization schema.

FlinkKafkaConsumer081<T> - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

FlinkKafkaConsumer081(String, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer081

Deprecated.

FlinkKafkaConsumer082<T> - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

FlinkKafkaConsumer082(String, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer082

Deprecated.

FlinkKafkaProducer<IN> - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

FlinkKafkaProducer(String, String, SerializationSchema<IN>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

FlinkKafkaProducer(String, SerializationSchema<IN>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

FlinkKafkaProducer(String, SerializationSchema<IN>, Properties, KafkaPartitioner) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

FlinkKafkaProducer(String, String, KeyedSerializationSchema<IN>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

FlinkKafkaProducer(String, KeyedSerializationSchema<IN>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

FlinkKafkaProducer(String, KeyedSerializationSchema<IN>, Properties, KafkaPartitioner) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

FlinkKafkaProducer08<IN> - Class in org.apache.flink.streaming.connectors.kafka

Flink Sink to produce data into a Kafka topic.

FlinkKafkaProducer08(String, String, SerializationSchema<IN>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer08

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer08(String, SerializationSchema<IN>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer08

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer08(String, SerializationSchema<IN>, Properties, KafkaPartitioner<IN>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer08

The main constructor for creating a FlinkKafkaProducer.

FlinkKafkaProducer08(String, String, KeyedSerializationSchema<IN>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer08

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer08(String, KeyedSerializationSchema<IN>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer08

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer08(String, KeyedSerializationSchema<IN>, Properties, KafkaPartitioner<IN>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer08

The main constructor for creating a FlinkKafkaProducer.

G

GET_PARTITIONS_RETRIES_KEY - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Configuration key for the number of retries for getting the partition info

getBatchBlocking() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Gets all the elements found in the list, or blocks until at least one element was added.

getBatchBlocking(long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Gets all the elements found in the list, or blocks until at least one element was added.

getElementBlocking() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Returns the next element in the queue.

getElementBlocking(long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Returns the next element in the queue.

getOffsetFromZooKeeper(CuratorFramework, String, String, int) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

getOffsets(List<KafkaTopicPartition>) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.OffsetHandler

Positions the given fetcher to the initial read offsets where the stream consumption will start from.

getOffsets(List<KafkaTopicPartition>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

getPartitionsForTopic(List<String>, Properties) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Send request to Kafka to get partitions for topic.

getTopics(List<LegacyFetcher.FetchPartition>) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

Returns a unique list of topics from the topic partition list

H

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

I

isEmpty() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Checks whether the queue is empty (has no elements).

isOpen() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Checks whether the queue is currently open, meaning elements can be added and polled.

L

LegacyFetcher - Class in org.apache.flink.streaming.connectors.kafka.internals

This fetcher uses Kafka's low-level API to pull data from a specific set of topics and partitions.

LegacyFetcher(Map<KafkaTopicPartition, Long>, Properties, String, ClassLoader) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

Create a LegacyFetcher instance.

O

OFFSET_NOT_SET - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Magic number to define an unset offset.

OffsetHandler - Interface in org.apache.flink.streaming.connectors.kafka.internals

The offset handler is responsible for locating the initial partition offsets where the source should start reading, as well as committing offsets from completed checkpoints.

open(Configuration) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

org.apache.flink.streaming.connectors.kafka - package org.apache.flink.streaming.connectors.kafka

org.apache.flink.streaming.connectors.kafka.internals - package org.apache.flink.streaming.connectors.kafka.internals

P

partition(Object, int) - Method in class org.apache.flink.streaming.connectors.kafka.internals.PartitionerWrapper

PartitionerWrapper - Class in org.apache.flink.streaming.connectors.kafka.internals

Hacky wrapper to send an object instance through a Properties - map.

PartitionerWrapper(VerifiableProperties) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.PartitionerWrapper

peek() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Returns the queue's next element without removing it, if the queue is non-empty.

poll() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Returns the queue's next element and removes it, the queue is non-empty.

pollBatch() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Returns all of the queue's current elements in a list, if the queue is non-empty.

R

run(SourceFunction.SourceContext<T>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

run(SourceFunction.SourceContext<T>, KeyedDeserializationSchema<T>, HashMap<KafkaTopicPartition, Long>) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Starts fetch data from Kafka and emitting it into the stream.

run(SourceFunction.SourceContext<T>, KeyedDeserializationSchema<T>, HashMap<KafkaTopicPartition, Long>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

S

SERIALIZED_WRAPPER_NAME - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.PartitionerWrapper

setOffsetInZooKeeper(CuratorFramework, String, String, int, long) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

size() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Gets the number of elements currently in the queue.

stopWithError(Throwable) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Exit run loop with given error and release all resources.

stopWithError(Throwable) - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

Reports an error from a fetch thread.

T

toString() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

V

validateZooKeeperConfig(Properties) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08

Validate the ZK configuration, checking for required parameters

Z

ZookeeperOffsetHandler - Class in org.apache.flink.streaming.connectors.kafka.internals

Handler for committing Kafka offsets to Zookeeper and to retrieve them again.

ZookeeperOffsetHandler(Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

A C D E F G H I L O P R S T V Z