org.apache.flink.streaming.connectors.kafka.internal

类 Kafka010Fetcher<T>

java.lang.Object

org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher<T,org.apache.kafka.common.TopicPartition>

org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher<T>

类型参数:

T - The type of elements produced by the fetcher.

@Internal
public class Kafka010Fetcher<T>
extends org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher<T,org.apache.kafka.common.TopicPartition>

A fetcher that fetches data from Kafka brokers via the Kafka 0.10 consumer API.

This fetcher re-uses basically all functionality of the 0.9 fetcher. It only additionally takes the KafkaRecord-attached timestamp and attaches it to the Flink records.

字段概要

从类继承的字段 org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

checkpointLock, sourceContext, unassignedPartitionsQueue, watermarkOutput

构造器概要

构造器

构造器和说明

Kafka010Fetcher(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext, Map<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets, org.apache.flink.util.SerializedValue<org.apache.flink.api.common.eventtime.WatermarkStrategy<T>> watermarkStrategy, org.apache.flink.streaming.runtime.tasks.ProcessingTimeService processingTimeProvider, long autoWatermarkInterval, ClassLoader userCodeClassLoader, String taskNameWithSubtasks, org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema<T> deserializer, Properties kafkaProperties, long pollTimeout, org.apache.flink.metrics.MetricGroup subtaskMetricGroup, org.apache.flink.metrics.MetricGroup consumerMetricGroup, boolean useMetrics, org.apache.flink.api.common.io.ratelimiting.FlinkConnectorRateLimiter rateLimiter)

方法概要

限定符和类型	方法和说明
void	cancel()
org.apache.kafka.common.TopicPartition	createKafkaPartitionHandle(org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition partition)
protected void	doCommitInternalOffsetsToKafka(Map<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition,Long> offsets, org.apache.flink.streaming.connectors.kafka.internals.KafkaCommitCallback commitCallback)
void	runFetchLoop()

从类继承的方法 org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

addDiscoveredPartitions, commitInternalOffsetsToKafka, emitRecordsWithTimestamps, snapshotCurrentState, subscribedPartitionStates

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

Kafka010Fetcher

public Kafka010Fetcher(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
                       Map<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
                       org.apache.flink.util.SerializedValue<org.apache.flink.api.common.eventtime.WatermarkStrategy<T>> watermarkStrategy,
                       org.apache.flink.streaming.runtime.tasks.ProcessingTimeService processingTimeProvider,
                       long autoWatermarkInterval,
                       ClassLoader userCodeClassLoader,
                       String taskNameWithSubtasks,
                       org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema<T> deserializer,
                       Properties kafkaProperties,
                       long pollTimeout,
                       org.apache.flink.metrics.MetricGroup subtaskMetricGroup,
                       org.apache.flink.metrics.MetricGroup consumerMetricGroup,
                       boolean useMetrics,
                       org.apache.flink.api.common.io.ratelimiting.FlinkConnectorRateLimiter rateLimiter)
                throws Exception

抛出:

Exception

方法详细资料

runFetchLoop

public void runFetchLoop()
                  throws Exception

指定者:

runFetchLoop 在类中 org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher<T,org.apache.kafka.common.TopicPartition>

抛出:

Exception

cancel

public void cancel()

指定者:

cancel 在类中 org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher<T,org.apache.kafka.common.TopicPartition>

createKafkaPartitionHandle

public org.apache.kafka.common.TopicPartition createKafkaPartitionHandle(org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition partition)

指定者:

createKafkaPartitionHandle 在类中 org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher<T,org.apache.kafka.common.TopicPartition>

doCommitInternalOffsetsToKafka

protected void doCommitInternalOffsetsToKafka(Map<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition,Long> offsets,
                                              @Nonnull
                                              org.apache.flink.streaming.connectors.kafka.internals.KafkaCommitCallback commitCallback)
                                       throws Exception

指定者:

doCommitInternalOffsetsToKafka 在类中 org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher<T,org.apache.kafka.common.TopicPartition>

抛出:

Exception