Packages

package watchdog

Type Members

  1. trait ForcedMaxOutputRowsBase extends Rule[LogicalPlan]
  2. case class ForcedMaxOutputRowsRule(sparkSession: SparkSession) extends Rule[LogicalPlan] with ForcedMaxOutputRowsBase with Product with Serializable
  3. final class MaxFileSizeExceedException extends KyuubiSQLExtensionException
  4. final class MaxPartitionExceedException extends KyuubiSQLExtensionException
  5. case class MaxScanStrategy(session: SparkSession) extends Strategy with SQLConfHelper with PruneFileSourcePartitionHelper with Product with Serializable

    Add MaxScanStrategy to avoid scan excessive partitions or files 1.

    Add MaxScanStrategy to avoid scan excessive partitions or files 1. Check if scan exceed maxPartition of partitioned table 2. Check if scan exceed maxFileSize (calculated by hive table and partition statistics) This Strategy Add Planner Strategy after LogicalOptimizer

Ungrouped