Type Members

1.  type DataFrame = Dataset[Row]
2.  trait FinalRebalanceStageHelper extends AdaptiveSparkPlanHelper
3.  case class FinalStageResourceManager(session: SparkSession) extends Rule[SparkPlan] with FinalRebalanceStageHelper with Product with Serializable

   This rule assumes the final write stage has less cores requirement than previous, otherwise this rule would take no effect.

   This rule assumes the final write stage has less cores requirement than previous, otherwise this rule would take no effect.

   It provide a feature: 1. Kill redundant executors before running final write stage

4.  case class InjectCustomResourceProfile(session: SparkSession) extends Rule[SparkPlan] with FinalRebalanceStageHelper with Product with Serializable

   Inject custom resource profile for final write stage, so we can specify custom executor resource configs.

5.  trait PruneFileSourcePartitionHelper extends PredicateHelper
6.  type Strategy = SparkStrategy

   Annotations

   @DeveloperApi() @Unstable()