package sql
Ordering
- Alphabetic
Visibility
- Public
- All
Type Members
- case class DropIgnoreNonexistent(session: SparkSession) extends Rule[LogicalPlan] with Product with Serializable
- class KyuubiSparkSQLCommonExtension extends (SparkSessionExtensions) ⇒ Unit
-
class
KyuubiSparkSQLExtension extends (SparkSessionExtensions) ⇒ Unit
Depend on Spark SQL Extension framework, we can use this extension follow steps
Depend on Spark SQL Extension framework, we can use this extension follow steps
- move this jar into $SPARK_HOME/jars
2. add config into
spark-defaults.conf:spark.sql.extensions=org.apache.kyuubi.sql.KyuubiSparkSQLExtension
- move this jar into $SPARK_HOME/jars
2. add config into
- abstract class KyuubiSparkSQLParserBase extends ParserInterface with SQLConfHelper
-
case class
RepartitionBeforeWritingDatasource(session: SparkSession) extends RepartitionBeforeWritingDatasourceBase with RepartitionBuilderWithRepartitionByExpression with Product with Serializable
For datasource table, there two commands can write data to table 1.
For datasource table, there two commands can write data to table 1. InsertIntoHadoopFsRelationCommand 2. CreateDataSourceTableAsSelectCommand This rule add a repartition node between write and query
-
case class
RepartitionBeforeWritingHive(session: SparkSession) extends RepartitionBeforeWritingHiveBase with RepartitionBuilderWithRepartitionByExpression with Product with Serializable
For Hive table, there two commands can write data to table 1.
For Hive table, there two commands can write data to table 1. InsertIntoHiveTable 2. CreateHiveTableAsSelectCommand This rule add a repartition node between write and query
- trait RepartitionBuilderWithRepartitionByExpression extends Rule[LogicalPlan] with RepartitionBuilder
- class SparkKyuubiSparkSQLParser extends KyuubiSparkSQLParserBase
- class UpperCaseCharStream extends CharStream
Value Members
-
object
InsertShuffleNodeBeforeJoin extends Rule[SparkPlan]
Insert shuffle node before join if it doesn't exist to make
OptimizeSkewedJoinworks. - object KyuubiSparkSQLCommonExtension