接口的使用
org.apache.flink.runtime.shuffle.ShuffleMaster

使用ShuffleMaster的程序包

程序包	说明
org.apache.flink.runtime.executiongraph
org.apache.flink.runtime.io.network.partition
org.apache.flink.runtime.jobmaster
org.apache.flink.runtime.scheduler
org.apache.flink.runtime.scheduler.adaptive
org.apache.flink.runtime.shuffle

org.apache.flink.runtime.executiongraph中ShuffleMaster的使用

返回ShuffleMaster的org.apache.flink.runtime.executiongraph中的方法

限定符和类型	方法和说明
ShuffleMaster<?>	DefaultExecutionGraph.getShuffleMaster()
ShuffleMaster<?>	InternalExecutionGraphAccessor.getShuffleMaster()

参数类型为ShuffleMaster的org.apache.flink.runtime.executiongraph中的方法

限定符和类型

方法和说明

static DefaultExecutionGraph

DefaultExecutionGraphBuilder.buildGraph(JobGraph jobGraph, org.apache.flink.configuration.Configuration jobManagerConfig, ScheduledExecutorService futureExecutor, Executor ioExecutor, ClassLoader classLoader, CompletedCheckpointStore completedCheckpointStore, CheckpointsCleaner checkpointsCleaner, CheckpointIDCounter checkpointIdCounter, org.apache.flink.api.common.time.Time rpcTimeout, org.apache.flink.metrics.MetricGroup metrics, BlobWriter blobWriter, org.slf4j.Logger log, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionLocationConstraint, ExecutionDeploymentListener executionDeploymentListener, ExecutionStateUpdateListener executionStateUpdateListener, long initializationTimestamp, VertexAttemptNumberStore vertexAttemptNumberStore, VertexParallelismStore vertexParallelismStore)

参数类型为ShuffleMaster的org.apache.flink.runtime.executiongraph中的构造器

构造器和说明

DefaultExecutionGraph(JobInformation jobInformation, ScheduledExecutorService futureExecutor, Executor ioExecutor, org.apache.flink.api.common.time.Time rpcTimeout, int maxPriorAttemptsHistoryLength, ClassLoader userClassLoader, BlobWriter blobWriter, PartitionGroupReleaseStrategy.Factory partitionGroupReleaseStrategyFactory, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionLocationConstraint, ExecutionDeploymentListener executionDeploymentListener, ExecutionStateUpdateListener executionStateUpdateListener, long initializationTimestamp, VertexAttemptNumberStore initialAttemptCounts, VertexParallelismStore vertexParallelismStore)

org.apache.flink.runtime.io.network.partition中ShuffleMaster的使用

参数类型为ShuffleMaster的org.apache.flink.runtime.io.network.partition中的构造器

构造器和说明
JobMasterPartitionTrackerImpl(org.apache.flink.api.common.JobID jobId, ShuffleMaster<?> shuffleMaster, PartitionTrackerFactory.TaskExecutorGatewayLookup taskExecutorGatewayLookup)

org.apache.flink.runtime.jobmaster中ShuffleMaster的使用

返回ShuffleMaster的org.apache.flink.runtime.jobmaster中的方法

限定符和类型	方法和说明
ShuffleMaster<?>	JobManagerSharedServices.getShuffleMaster()

参数类型为ShuffleMaster的org.apache.flink.runtime.jobmaster中的方法

限定符和类型	方法和说明
SchedulerNG	DefaultSlotPoolServiceSchedulerFactory.createScheduler(org.slf4j.Logger log, JobGraph jobGraph, Executor ioExecutor, org.apache.flink.configuration.Configuration configuration, SlotPoolService slotPoolService, ScheduledExecutorService futureExecutor, ClassLoader userCodeLoader, CheckpointRecoveryFactory checkpointRecoveryFactory, org.apache.flink.api.common.time.Time rpcTimeout, BlobWriter blobWriter, JobManagerJobMetricGroup jobManagerJobMetricGroup, org.apache.flink.api.common.time.Time slotRequestTimeout, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, ExecutionDeploymentTracker executionDeploymentTracker, long initializationTimestamp, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler, JobStatusListener jobStatusListener)
SchedulerNG	SlotPoolServiceSchedulerFactory.createScheduler(org.slf4j.Logger log, JobGraph jobGraph, Executor ioExecutor, org.apache.flink.configuration.Configuration configuration, SlotPoolService slotPoolService, ScheduledExecutorService futureExecutor, ClassLoader userCodeLoader, CheckpointRecoveryFactory checkpointRecoveryFactory, org.apache.flink.api.common.time.Time rpcTimeout, BlobWriter blobWriter, JobManagerJobMetricGroup jobManagerJobMetricGroup, org.apache.flink.api.common.time.Time slotRequestTimeout, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, ExecutionDeploymentTracker executionDeploymentTracker, long initializationTimestamp, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler, JobStatusListener jobStatusListener) Creates a SchedulerNG.

参数类型为ShuffleMaster的org.apache.flink.runtime.jobmaster中的构造器

构造器和说明
JobManagerSharedServices(ScheduledExecutorService futureExecutor, ExecutorService ioExecutor, LibraryCacheManager libraryCacheManager, ShuffleMaster<?> shuffleMaster, BlobWriter blobWriter)
JobMaster(org.apache.flink.runtime.rpc.RpcService rpcService, JobMasterId jobMasterId, JobMasterConfiguration jobMasterConfiguration, ResourceID resourceId, JobGraph jobGraph, HighAvailabilityServices highAvailabilityService, SlotPoolServiceSchedulerFactory slotPoolServiceSchedulerFactory, JobManagerSharedServices jobManagerSharedServices, HeartbeatServices heartbeatServices, JobManagerJobMetricGroupFactory jobMetricGroupFactory, OnCompletionActions jobCompletionActions, org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler, ClassLoader userCodeLoader, ShuffleMaster<?> shuffleMaster, PartitionTrackerFactory partitionTrackerFactory, ExecutionDeploymentTracker executionDeploymentTracker, ExecutionDeploymentReconciler.Factory executionDeploymentReconcilerFactory, long initializationTimestamp)

org.apache.flink.runtime.scheduler中ShuffleMaster的使用

参数类型为ShuffleMaster的org.apache.flink.runtime.scheduler中的方法

限定符和类型	方法和说明
SchedulerNG	DefaultSchedulerFactory.createInstance(org.slf4j.Logger log, JobGraph jobGraph, Executor ioExecutor, org.apache.flink.configuration.Configuration jobMasterConfiguration, SlotPoolService slotPoolService, ScheduledExecutorService futureExecutor, ClassLoader userCodeLoader, CheckpointRecoveryFactory checkpointRecoveryFactory, org.apache.flink.api.common.time.Time rpcTimeout, BlobWriter blobWriter, JobManagerJobMetricGroup jobManagerJobMetricGroup, org.apache.flink.api.common.time.Time slotRequestTimeout, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, ExecutionDeploymentTracker executionDeploymentTracker, long initializationTimestamp, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler, JobStatusListener jobStatusListener)
SchedulerNG	SchedulerNGFactory.createInstance(org.slf4j.Logger log, JobGraph jobGraph, Executor ioExecutor, org.apache.flink.configuration.Configuration jobMasterConfiguration, SlotPoolService slotPoolService, ScheduledExecutorService futureExecutor, ClassLoader userCodeLoader, CheckpointRecoveryFactory checkpointRecoveryFactory, org.apache.flink.api.common.time.Time rpcTimeout, BlobWriter blobWriter, JobManagerJobMetricGroup jobManagerJobMetricGroup, org.apache.flink.api.common.time.Time slotRequestTimeout, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, ExecutionDeploymentTracker executionDeploymentTracker, long initializationTimestamp, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler, JobStatusListener jobStatusListener)

参数类型为ShuffleMaster的org.apache.flink.runtime.scheduler中的构造器

构造器和说明

DefaultExecutionGraphFactory(org.apache.flink.configuration.Configuration configuration, ClassLoader userCodeClassLoader, ExecutionDeploymentTracker executionDeploymentTracker, ScheduledExecutorService futureExecutor, Executor ioExecutor, org.apache.flink.api.common.time.Time rpcTimeout, JobManagerJobMetricGroup jobManagerJobMetricGroup, BlobWriter blobWriter, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker jobMasterPartitionTracker)

org.apache.flink.runtime.scheduler.adaptive中ShuffleMaster的使用

参数类型为ShuffleMaster的org.apache.flink.runtime.scheduler.adaptive中的方法

限定符和类型

方法和说明

SchedulerNG

AdaptiveSchedulerFactory.createInstance(org.slf4j.Logger log, JobGraph jobGraph, Executor ioExecutor, org.apache.flink.configuration.Configuration jobMasterConfiguration, SlotPoolService slotPoolService, ScheduledExecutorService futureExecutor, ClassLoader userCodeLoader, CheckpointRecoveryFactory checkpointRecoveryFactory, org.apache.flink.api.common.time.Time rpcTimeout, BlobWriter blobWriter, JobManagerJobMetricGroup jobManagerJobMetricGroup, org.apache.flink.api.common.time.Time slotRequestTimeout, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, ExecutionDeploymentTracker executionDeploymentTracker, long initializationTimestamp, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler, JobStatusListener jobStatusListener)

org.apache.flink.runtime.shuffle中ShuffleMaster的使用

实现ShuffleMaster的org.apache.flink.runtime.shuffle中的类

限定符和类型	类和说明
class	NettyShuffleMaster Default ShuffleMaster for netty and local file based shuffle implementation.

返回ShuffleMaster的org.apache.flink.runtime.shuffle中的方法

限定符和类型	方法和说明
ShuffleMaster<SD>	ShuffleServiceFactory.createShuffleMaster(ShuffleMasterContext shuffleMasterContext) Factory method to create a specific ShuffleMaster implementation.