Package org.apache.druid.server.coordinator.duty

Class KillUnusedSegments

java.lang.Object

org.apache.druid.server.coordinator.duty.KillUnusedSegments

All Implemented Interfaces:

CoordinatorDuty

public class KillUnusedSegments
extends Object
implements CoordinatorDuty

Completely removes information about unused segments who have an interval end that comes before now - durationToRetain from the metadata store. durationToRetain can be a positive or negative duration, negative meaning the interval end target will be in the future. Also, durationToRetain can be ignored if ignoreDurationToRetain is enabled, meaning that there is no upper bound to the end interval of segments that will be killed. The umbrella interval of the unused segments per datasource to be killed is determined by findIntervalForKill(String, DateTime, CoordinatorRunStats), which takes into account the configured bufferPeriod. However, the kill task needs to check again for max bufferPeriod for the unused segments in the widened interval as there can be multiple unused segments with different used_status_last_updated time.

The datasources to be killed during each cycle are selected from datasourceCircularKillList. This state is refreshed in a run if the set of datasources to be killed changes. Consecutive duplicate datasources are avoided across runs, provided there are other datasources to be killed.

See Also:

• for details of the actual kill task and UnusedSegmentKiller to run embedded kill tasks on the Overlord.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	KILL_TASK_TYPE
static final String	TASK_ID_PREFIX

Constructor Summary

Constructors

Constructor	Description
KillUnusedSegments(IndexerMetadataStorageCoordinator storageCoordinator, OverlordClient overlordClient, KillUnusedSegmentsConfig killConfig)

Method Summary

Modifier and Type	Method	Description
DruidCoordinatorRuntimeParams	run(DruidCoordinatorRuntimeParams params)	Implementations of this method run various activities performed by the coordinator.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

KILL_TASK_TYPE

public static final String KILL_TASK_TYPE

See Also:

• Constant Field Values

TASK_ID_PREFIX

public static final String TASK_ID_PREFIX

See Also:

• Constant Field Values

Constructor Details

KillUnusedSegments

public KillUnusedSegments(IndexerMetadataStorageCoordinator storageCoordinator,
 OverlordClient overlordClient,
 KillUnusedSegmentsConfig killConfig)

Method Details

run

public DruidCoordinatorRuntimeParams run(DruidCoordinatorRuntimeParams params)

Description copied from interface: CoordinatorDuty

Implementations of this method run various activities performed by the coordinator. Input params can be used and modified. The returned DruidCoordinatorRuntimeParams is passed to the next duty.

Specified by:

run in interface CoordinatorDuty

Returns:

same as input or a modified value to be used by next duty. Null return values will prevent subsequent CoordinatorDuty objects (see the order in the lists passed into the constructor of DruidCoordinator.DutiesRunnable) from running until the next cycle.