org.apache.hudi.table.catalog

Class HiveSchemaUtils

java.lang.Object

org.apache.hudi.table.catalog.HiveSchemaUtils

public class HiveSchemaUtils
extends Object

Utilities for Hive field schema.

Constructor Summary

Constructors

Constructor and Description
HiveSchemaUtils()

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.table.api.Schema	convertTableSchema(org.apache.hadoop.hive.metastore.api.Table hiveTable)
static List<org.apache.hadoop.hive.metastore.api.FieldSchema>	createHiveColumns(org.apache.flink.table.api.TableSchema schema) Create Hive columns from Flink TableSchema.
static List<String>	getFieldNames(List<org.apache.hadoop.hive.metastore.api.FieldSchema> fieldSchemas) Get field names from field schemas.
static Pair<List<org.apache.hadoop.hive.metastore.api.FieldSchema>,List<org.apache.hadoop.hive.metastore.api.FieldSchema>>	splitSchemaByPartitionKeys(List<org.apache.hadoop.hive.metastore.api.FieldSchema> fieldSchemas, List<String> partitionKeys) Split the field schemas by given partition keys.
static org.apache.flink.table.types.DataType	toFlinkType(org.apache.hadoop.hive.serde2.typeinfo.TypeInfo hiveType) Convert Hive data type to a Flink data type.
static org.apache.hadoop.hive.serde2.typeinfo.TypeInfo	toHiveTypeInfo(org.apache.flink.table.types.DataType dataType) Convert Flink DataType to Hive TypeInfo.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveSchemaUtils

public HiveSchemaUtils()

Method Detail

getFieldNames

public static List<String> getFieldNames(List<org.apache.hadoop.hive.metastore.api.FieldSchema> fieldSchemas)

Get field names from field schemas.

convertTableSchema

public static org.apache.flink.table.api.Schema convertTableSchema(org.apache.hadoop.hive.metastore.api.Table hiveTable)

toFlinkType

public static org.apache.flink.table.types.DataType toFlinkType(org.apache.hadoop.hive.serde2.typeinfo.TypeInfo hiveType)

Convert Hive data type to a Flink data type.

Parameters:

hiveType - a Hive data type

Returns:

the corresponding Flink data type

createHiveColumns

public static List<org.apache.hadoop.hive.metastore.api.FieldSchema> createHiveColumns(org.apache.flink.table.api.TableSchema schema)

Create Hive columns from Flink TableSchema.

toHiveTypeInfo

public static org.apache.hadoop.hive.serde2.typeinfo.TypeInfo toHiveTypeInfo(org.apache.flink.table.types.DataType dataType)

Convert Flink DataType to Hive TypeInfo. For types with a precision parameter, e.g. timestamp, the supported precisions in Hive and Flink can be different. Therefore the conversion will fail for those types if the precision is not supported by Hive and checkPrecision is true.

Parameters:

dataType - a Flink DataType

Returns:

the corresponding Hive data type

splitSchemaByPartitionKeys

public static Pair<List<org.apache.hadoop.hive.metastore.api.FieldSchema>,List<org.apache.hadoop.hive.metastore.api.FieldSchema>> splitSchemaByPartitionKeys(List<org.apache.hadoop.hive.metastore.api.FieldSchema> fieldSchemas,
                                                                                                                                                             List<String> partitionKeys)

Split the field schemas by given partition keys.

Parameters:

fieldSchemas - The Hive field schemas.

partitionKeys - The partition keys.

Returns:

The pair of (regular columns, partition columns) schema fields