package sql
- Alphabetic
- Public
- All
Type Members
- case class DropIgnoreNonexistent(session: SparkSession) extends Rule[LogicalPlan] with Product with Serializable
- class KyuubiSparkSQLCommonExtension extends (SparkSessionExtensions) ⇒ Unit
-
class
KyuubiSparkSQLExtension extends (SparkSessionExtensions) ⇒ Unit
Depend on Spark SQL Extension framework, we can use this extension follow steps
Depend on Spark SQL Extension framework, we can use this extension follow steps
- move this jar into $SPARK_HOME/jars
2. add config into
spark-defaults.conf:spark.sql.extensions=org.apache.kyuubi.sql.KyuubiSparkSQLExtension
- move this jar into $SPARK_HOME/jars
2. add config into
- abstract class KyuubiSparkSQLParserBase extends ParserInterface
-
case class
RebalanceBeforeWritingDatasource(session: SparkSession) extends RepartitionBeforeWritingDatasourceBase with RepartitionBuilderWithRebalance with Product with Serializable
For datasource table, there two commands can write data to table 1.
For datasource table, there two commands can write data to table 1. InsertIntoHadoopFsRelationCommand 2. CreateDataSourceTableAsSelectCommand This rule add a RebalancePartitions node between write and query
-
case class
RebalanceBeforeWritingHive(session: SparkSession) extends RepartitionBeforeWritingHiveBase with RepartitionBuilderWithRebalance with Product with Serializable
For Hive table, there two commands can write data to table 1.
For Hive table, there two commands can write data to table 1. InsertIntoHiveTable 2. CreateHiveTableAsSelectCommand This rule add a RebalancePartitions node between write and query
- trait RepartitionBuilderWithRebalance extends Rule[LogicalPlan] with RepartitionBuilder
- class SparkKyuubiSparkSQLParser extends KyuubiSparkSQLParserBase
- class UpperCaseCharStream extends CharStream
Value Members
-
object
InsertShuffleNodeBeforeJoin extends Rule[SparkPlan]
Insert shuffle node before join if it doesn't exist to make
OptimizeSkewedJoinworks. - object KyuubiSparkSQLCommonExtension