org.apache.hudi.util

Class AvroSchemaConverter

java.lang.Object

org.apache.hudi.util.AvroSchemaConverter

public class AvroSchemaConverter
extends Object

Converts an Avro schema into Flink's type information. It uses org.apache.flink.api.java.typeutils.RowTypeInfo for representing objects and converts Avro types into types that are compatible with Flink's Table & SQL API.

Note: Changes in this class need to be kept in sync with the corresponding runtime classes org.apache.flink.formats.avro.AvroRowDeserializationSchema and org.apache.flink.formats.avro.AvroRowSerializationSchema.

NOTE: reference from Flink release 1.12.0, should remove when Flink version upgrade to that.

Constructor Summary

Constructors

Constructor and Description
AvroSchemaConverter()

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.table.types.DataType	convertToDataType(org.apache.avro.Schema schema) Converts an Avro schema schema into a nested row structure with deterministic field order and data types that are compatible with Flink's Table & SQL API.
static org.apache.avro.Schema	convertToSchema(org.apache.flink.table.types.logical.LogicalType schema) Converts Flink SQL LogicalType (can be nested) into an Avro schema.
static org.apache.avro.Schema	convertToSchema(org.apache.flink.table.types.logical.LogicalType logicalType, String rowName) Converts Flink SQL LogicalType (can be nested) into an Avro schema.
static org.apache.flink.table.types.logical.LogicalType	extractValueTypeToAvroMap(org.apache.flink.table.types.logical.LogicalType type)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroSchemaConverter

public AvroSchemaConverter()

Method Detail

convertToDataType

public static org.apache.flink.table.types.DataType convertToDataType(org.apache.avro.Schema schema)

Converts an Avro schema schema into a nested row structure with deterministic field order and data types that are compatible with Flink's Table & SQL API.

Parameters:

schema - Avro schema definition

Returns:

data type matching the schema

convertToSchema

public static org.apache.avro.Schema convertToSchema(org.apache.flink.table.types.logical.LogicalType schema)

Converts Flink SQL LogicalType (can be nested) into an Avro schema.

Use "record" as the type name.

Parameters:

schema - the schema type, usually it should be the top level record type, e.g. not a nested type

Returns:

Avro's Schema matching this logical type.

convertToSchema

public static org.apache.avro.Schema convertToSchema(org.apache.flink.table.types.logical.LogicalType logicalType,
                                                     String rowName)

Converts Flink SQL LogicalType (can be nested) into an Avro schema.

The "{rowName}." is used as the nested row type name prefix in order to generate the right schema. Nested record type that only differs with type name is still compatible.

Parameters:

logicalType - logical type

rowName - the record name

Returns:

Avro's Schema matching this logical type.

extractValueTypeToAvroMap

public static org.apache.flink.table.types.logical.LogicalType extractValueTypeToAvroMap(org.apache.flink.table.types.logical.LogicalType type)