org.apache.flink.runtime.scheduler

Class DefaultScheduler

java.lang.Object

org.apache.flink.runtime.scheduler.SchedulerBase

org.apache.flink.runtime.scheduler.DefaultScheduler

All Implemented Interfaces:

SchedulerNG, SchedulerOperations

public class DefaultScheduler
extends SchedulerBase
implements SchedulerOperations

The future default scheduler.

Field Summary

Fields inherited from class org.apache.flink.runtime.scheduler.SchedulerBase

executionVertexVersioner

Constructor Summary

Constructors

Constructor and Description

DefaultScheduler(org.slf4j.Logger log, JobGraph jobGraph, BackPressureStatsTracker backPressureStatsTracker, Executor ioExecutor, org.apache.flink.configuration.Configuration jobMasterConfiguration, SlotProvider slotProvider, ScheduledExecutorService futureExecutor, ScheduledExecutor delayExecutor, ClassLoader userCodeLoader, CheckpointRecoveryFactory checkpointRecoveryFactory, org.apache.flink.api.common.time.Time rpcTimeout, BlobWriter blobWriter, JobManagerJobMetricGroup jobManagerJobMetricGroup, org.apache.flink.api.common.time.Time slotRequestTimeout, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, SchedulingStrategyFactory schedulingStrategyFactory, FailoverStrategy.Factory failoverStrategyFactory, RestartBackoffTimeStrategy restartBackoffTimeStrategy, org.apache.flink.runtime.scheduler.ExecutionVertexOperations executionVertexOperations, ExecutionVertexVersioner executionVertexVersioner, ExecutionSlotAllocatorFactory executionSlotAllocatorFactory)

Method Summary

Modifier and Type	Method and Description
void	allocateSlotsAndDeploy(List<ExecutionVertexDeploymentOption> executionVertexDeploymentOptions) Allocate slots and deploy the vertex when slots are returned.
protected long	getNumberOfRestarts()
void	handleGlobalFailure(Throwable error)
protected void	scheduleOrUpdateConsumersInternal(ExecutionVertexID producerVertexId, ResultPartitionID partitionId)
protected void	startSchedulingInternal()
protected void	updateTaskExecutionStateInternal(ExecutionVertexID executionVertexId, TaskExecutionState taskExecutionState)

Methods inherited from class org.apache.flink.runtime.scheduler.SchedulerBase

acknowledgeCheckpoint, cancel, declineCheckpoint, failJob, getExecutionGraph, getExecutionVertex, getExecutionVertexId, getExecutionVertexIdOrThrow, getFailoverTopology, getInputsLocationsRetriever, getJobGraph, getMainThreadExecutor, getResultPartitionAvailabilityChecker, getSchedulingTopology, getTerminationFuture, notifyKvStateRegistered, notifyKvStateUnregistered, prepareExecutionGraphForNgScheduling, registerJobStatusListener, requestJob, requestJobDetails, requestJobStatus, requestKvStateLocation, requestNextInputSplit, requestOperatorBackPressureStats, requestPartitionState, resetForNewExecutions, restoreState, scheduleOrUpdateConsumers, setGlobalFailureCause, setMainThreadExecutor, startScheduling, stopWithSavepoint, suspend, transitionExecutionGraphState, transitionToScheduled, triggerSavepoint, updateAccumulators, updateTaskExecutionState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultScheduler

public DefaultScheduler(org.slf4j.Logger log,
                        JobGraph jobGraph,
                        BackPressureStatsTracker backPressureStatsTracker,
                        Executor ioExecutor,
                        org.apache.flink.configuration.Configuration jobMasterConfiguration,
                        SlotProvider slotProvider,
                        ScheduledExecutorService futureExecutor,
                        ScheduledExecutor delayExecutor,
                        ClassLoader userCodeLoader,
                        CheckpointRecoveryFactory checkpointRecoveryFactory,
                        org.apache.flink.api.common.time.Time rpcTimeout,
                        BlobWriter blobWriter,
                        JobManagerJobMetricGroup jobManagerJobMetricGroup,
                        org.apache.flink.api.common.time.Time slotRequestTimeout,
                        ShuffleMaster<?> shuffleMaster,
                        JobMasterPartitionTracker partitionTracker,
                        SchedulingStrategyFactory schedulingStrategyFactory,
                        FailoverStrategy.Factory failoverStrategyFactory,
                        RestartBackoffTimeStrategy restartBackoffTimeStrategy,
                        org.apache.flink.runtime.scheduler.ExecutionVertexOperations executionVertexOperations,
                        ExecutionVertexVersioner executionVertexVersioner,
                        ExecutionSlotAllocatorFactory executionSlotAllocatorFactory)
                 throws Exception

Throws:

Exception

Method Detail

getNumberOfRestarts

protected long getNumberOfRestarts()

Specified by:

getNumberOfRestarts in class SchedulerBase

startSchedulingInternal

protected void startSchedulingInternal()

Specified by:

startSchedulingInternal in class SchedulerBase

updateTaskExecutionStateInternal

protected void updateTaskExecutionStateInternal(ExecutionVertexID executionVertexId,
                                                TaskExecutionState taskExecutionState)

Overrides:

updateTaskExecutionStateInternal in class SchedulerBase

handleGlobalFailure

public void handleGlobalFailure(Throwable error)

Specified by:

handleGlobalFailure in interface SchedulerNG

scheduleOrUpdateConsumersInternal

protected void scheduleOrUpdateConsumersInternal(ExecutionVertexID producerVertexId,
                                                 ResultPartitionID partitionId)

Overrides:

scheduleOrUpdateConsumersInternal in class SchedulerBase

allocateSlotsAndDeploy

public void allocateSlotsAndDeploy(List<ExecutionVertexDeploymentOption> executionVertexDeploymentOptions)

Description copied from interface: SchedulerOperations

Allocate slots and deploy the vertex when slots are returned. The given order will be respected, i.e. tasks with smaller indices will be deployed earlier. Only vertices in CREATED state will be accepted. Errors will happen if scheduling Non-CREATED vertices.

Specified by:

allocateSlotsAndDeploy in interface SchedulerOperations

Parameters:

executionVertexDeploymentOptions - The deployment options of tasks to be deployed