org.apache.hadoop.hive.druid.json

Class KafkaSupervisorTuningConfig

java.lang.Object

org.apache.hadoop.hive.druid.json.SeekableStreamIndexTaskTuningConfig

org.apache.hadoop.hive.druid.json.KafkaIndexTaskTuningConfig

org.apache.hadoop.hive.druid.json.KafkaSupervisorTuningConfig

All Implemented Interfaces:

org.apache.druid.segment.indexing.TuningConfig, org.apache.druid.segment.realtime.appenderator.AppenderatorConfig, SeekableStreamSupervisorTuningConfig

public class KafkaSupervisorTuningConfig
extends KafkaIndexTaskTuningConfig
implements SeekableStreamSupervisorTuningConfig

This class is copied from druid source code in order to avoid adding additional dependencies on druid-indexing-service.

Field Summary

Fields inherited from interface org.apache.hadoop.hive.druid.json.SeekableStreamSupervisorTuningConfig

DEFAULT_CHAT_RETRIES, DEFAULT_HTTP_TIMEOUT, DEFAULT_REPARTITION_TRANSITION_DURATION, DEFAULT_SHUTDOWN_TIMEOUT

Fields inherited from interface org.apache.druid.segment.indexing.TuningConfig

DEFAULT_LOG_PARSE_EXCEPTIONS, DEFAULT_MAX_BYTES_IN_MEMORY, DEFAULT_MAX_PARSE_EXCEPTIONS, DEFAULT_MAX_ROWS_IN_MEMORY, DEFAULT_MAX_SAVED_PARSE_EXCEPTIONS

Constructor Summary

Constructors

Constructor and Description

KafkaSupervisorTuningConfig(Integer maxRowsInMemory, Long maxBytesInMemory, Integer maxRowsPerSegment, Long maxTotalRows, org.joda.time.Period intermediatePersistPeriod, File basePersistDirectory, Integer maxPendingPersists, org.apache.druid.segment.IndexSpec indexSpec, org.apache.druid.segment.IndexSpec indexSpecForIntermediatePersists, Boolean buildV9Directly, Boolean reportParseExceptions, Long handoffConditionTimeout, Boolean resetOffsetAutomatically, org.apache.druid.segment.writeout.SegmentWriteOutMediumFactory segmentWriteOutMediumFactory, Integer workerThreads, Integer chatThreads, Long chatRetries, org.joda.time.Period httpTimeout, org.joda.time.Period shutdownTimeout, org.joda.time.Period offsetFetchPeriod, org.joda.time.Period intermediateHandoffPeriod, Boolean logParseExceptions, Integer maxParseExceptions, Integer maxSavedParseExceptions)

Method Summary

Modifier and Type	Method and Description
KafkaIndexTaskTuningConfig	convertToTaskTuningConfig()
static KafkaSupervisorTuningConfig	defaultConfig()
Long	getChatRetries()
Integer	getChatThreads()
org.joda.time.Duration	getHttpTimeout()
org.joda.time.Duration	getOffsetFetchPeriod()
org.joda.time.Duration	getRepartitionTransitionDuration()
org.joda.time.Duration	getShutdownTimeout()
Integer	getWorkerThreads()
String	toString()

Methods inherited from class org.apache.hadoop.hive.druid.json.KafkaIndexTaskTuningConfig

withBasePersistDirectory

Methods inherited from class org.apache.hadoop.hive.druid.json.SeekableStreamIndexTaskTuningConfig

equals, getBasePersistDirectory, getBuildV9Directly, getHandoffConditionTimeout, getIndexSpec, getIndexSpecForIntermediatePersists, getIntermediateHandoffPeriod, getIntermediatePersistPeriod, getMaxBytesInMemory, getMaxParseExceptions, getMaxPendingPersists, getMaxRowsInMemory, getMaxRowsPerSegment, getMaxSavedParseExceptions, getMaxTotalRows, getPartitionsSpec, getSegmentWriteOutMediumFactory, hashCode, isLogParseExceptions, isReportParseExceptions, isResetOffsetAutomatically, isSkipSequenceNumberAvailabilityCheck

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.druid.json.SeekableStreamSupervisorTuningConfig

defaultDuration

Constructor Detail

KafkaSupervisorTuningConfig

public KafkaSupervisorTuningConfig(Integer maxRowsInMemory,
                                   Long maxBytesInMemory,
                                   Integer maxRowsPerSegment,
                                   Long maxTotalRows,
                                   org.joda.time.Period intermediatePersistPeriod,
                                   File basePersistDirectory,
                                   Integer maxPendingPersists,
                                   org.apache.druid.segment.IndexSpec indexSpec,
                                   @Nullable
                                   org.apache.druid.segment.IndexSpec indexSpecForIntermediatePersists,
                                   Boolean buildV9Directly,
                                   Boolean reportParseExceptions,
                                   Long handoffConditionTimeout,
                                   Boolean resetOffsetAutomatically,
                                   @Nullable
                                   org.apache.druid.segment.writeout.SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
                                   Integer workerThreads,
                                   Integer chatThreads,
                                   Long chatRetries,
                                   org.joda.time.Period httpTimeout,
                                   org.joda.time.Period shutdownTimeout,
                                   org.joda.time.Period offsetFetchPeriod,
                                   org.joda.time.Period intermediateHandoffPeriod,
                                   @Nullable
                                   Boolean logParseExceptions,
                                   @Nullable
                                   Integer maxParseExceptions,
                                   @Nullable
                                   Integer maxSavedParseExceptions)

Method Detail

defaultConfig

public static KafkaSupervisorTuningConfig defaultConfig()

getWorkerThreads

public Integer getWorkerThreads()

Specified by:

getWorkerThreads in interface SeekableStreamSupervisorTuningConfig

getChatThreads

public Integer getChatThreads()

Specified by:

getChatThreads in interface SeekableStreamSupervisorTuningConfig

getChatRetries

public Long getChatRetries()

Specified by:

getChatRetries in interface SeekableStreamSupervisorTuningConfig

getHttpTimeout

public org.joda.time.Duration getHttpTimeout()

Specified by:

getHttpTimeout in interface SeekableStreamSupervisorTuningConfig

getShutdownTimeout

public org.joda.time.Duration getShutdownTimeout()

Specified by:

getShutdownTimeout in interface SeekableStreamSupervisorTuningConfig

getRepartitionTransitionDuration

public org.joda.time.Duration getRepartitionTransitionDuration()

Specified by:

getRepartitionTransitionDuration in interface SeekableStreamSupervisorTuningConfig

getOffsetFetchPeriod

public org.joda.time.Duration getOffsetFetchPeriod()

toString

public String toString()

Overrides:

toString in class KafkaIndexTaskTuningConfig

convertToTaskTuningConfig

public KafkaIndexTaskTuningConfig convertToTaskTuningConfig()

Specified by:

convertToTaskTuningConfig in interface SeekableStreamSupervisorTuningConfig