public class IncrementalPublishingKafkaIndexTaskRunner extends SeekableStreamIndexTaskRunner<Integer,Long>
SeekableStreamIndexTaskRunner.StatusisAwaitingRetry, pauseRequested, pollRetryLock, stopRequested| Constructor and Description |
|---|
IncrementalPublishingKafkaIndexTaskRunner(KafkaIndexTask task,
InputRowParser<ByteBuffer> parser,
org.apache.druid.server.security.AuthorizerMapper authorizerMapper,
com.google.common.base.Optional<org.apache.druid.segment.realtime.firehose.ChatHandlerProvider> chatHandlerProvider,
CircularBuffer<Throwable> savedParseExceptions,
RowIngestionMetersFactory rowIngestionMetersFactory) |
getAppenderator, getCheckpointsHTTP, getCurrentOffsets, getCurrentOffsets, getEndOffsets, getEndOffsetsHTTP, getRowIngestionMeters, getRowStats, getSequences, getStartTime, getStatus, getStatusHTTP, getUnparseableEvents, initializeSequences, pause, pauseHTTP, resume, resumeHTTP, run, sendResetRequestAndWait, setEndOffsets, setEndOffsetsHTTP, setToolbox, stop, stopGracefullypublic IncrementalPublishingKafkaIndexTaskRunner(KafkaIndexTask task, InputRowParser<ByteBuffer> parser, org.apache.druid.server.security.AuthorizerMapper authorizerMapper, com.google.common.base.Optional<org.apache.druid.segment.realtime.firehose.ChatHandlerProvider> chatHandlerProvider, CircularBuffer<Throwable> savedParseExceptions, RowIngestionMetersFactory rowIngestionMetersFactory)
protected Long getNextStartOffset(@NotNull Long sequenceNumber)
getNextStartOffset in class SeekableStreamIndexTaskRunner<Integer,Long>@Nonnull protected List<OrderedPartitionableRecord<Integer,Long>> getRecords(RecordSupplier<Integer,Long> recordSupplier, TaskToolbox toolbox) throws Exception
getRecords in class SeekableStreamIndexTaskRunner<Integer,Long>Exceptionprotected SeekableStreamEndSequenceNumbers<Integer,Long> deserializePartitionsFromMetadata(com.fasterxml.jackson.databind.ObjectMapper mapper, Object object)
deserializePartitionsFromMetadata in class SeekableStreamIndexTaskRunner<Integer,Long>protected SeekableStreamDataSourceMetadata<Integer,Long> createDataSourceMetadata(SeekableStreamSequenceNumbers<Integer,Long> partitions)
createDataSourceMetadata in class SeekableStreamIndexTaskRunner<Integer,Long>protected OrderedSequenceNumber<Long> createSequenceNumber(Long sequenceNumber)
createSequenceNumber in class SeekableStreamIndexTaskRunner<Integer,Long>protected void possiblyResetDataSourceMetadata(TaskToolbox toolbox, RecordSupplier<Integer,Long> recordSupplier, Set<StreamPartition<Integer>> assignment)
possiblyResetDataSourceMetadata in class SeekableStreamIndexTaskRunner<Integer,Long>protected boolean isEndOffsetExclusive()
isEndOffsetExclusive in class SeekableStreamIndexTaskRunner<Integer,Long>protected boolean isEndOfShard(Long seqNum)
isEndOfShard in class SeekableStreamIndexTaskRunner<Integer,Long>public com.fasterxml.jackson.core.type.TypeReference<List<SequenceMetadata<Integer,Long>>> getSequenceMetadataTypeReference()
getSequenceMetadataTypeReference in class SeekableStreamIndexTaskRunner<Integer,Long>@Nullable protected TreeMap<Integer,Map<Integer,Long>> getCheckPointsFromContext(TaskToolbox toolbox, String checkpointsString) throws IOException
getCheckPointsFromContext in class SeekableStreamIndexTaskRunner<Integer,Long>IOExceptionCopyright © 2011–2019 The Apache Software Foundation. All rights reserved.