org.apache.hadoop.hive.druid.serde

Class DruidSerDe

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.druid.serde.DruidSerDe

All Implemented Interfaces:

org.apache.hadoop.hive.serde2.Deserializer, org.apache.hadoop.hive.serde2.SerDe, org.apache.hadoop.hive.serde2.Serializer

public class DruidSerDe
extends org.apache.hadoop.hive.serde2.AbstractSerDe

DruidSerDe that is used to deserialize objects from a Druid data source.

Field Summary

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configuration, log, partitionProperties, properties, tableProperties

Constructor Summary

Constructors

Constructor and Description
DruidSerDe()

Method Summary

Modifier and Type	Method and Description
Object	deserialize(org.apache.hadoop.io.Writable writable)
void	deserializeAsPrimitive(org.apache.hadoop.io.Writable writable, Object[] rowBoat) Function to convert Druid Primitive values to Hive Primitives.
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector	getObjectInspector()
Class<? extends org.apache.hadoop.io.Writable>	getSerializedClass()
void	initialize(org.apache.hadoop.conf.Configuration configuration, Properties tableProperties, Properties partitionProperties)
org.apache.hadoop.io.Writable	serialize(Object o, org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector objectInspector)
boolean	shouldStoreFieldsInMetastore(Map<String,String> tableParams)
protected org.apache.druid.query.metadata.metadata.SegmentAnalysis	submitMetadataRequest(String address, org.apache.druid.query.metadata.metadata.SegmentMetadataQuery query)

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getColumnComments, getColumnNames, getColumnTypes, getConfiguration, getPartitionColumnComments, getPartitionColumnNames, getPartitionColumnTypes, getSerDeStats, parseColumnComments, parseColumnNames, parseColumnNames, parseColumnTypes, parseColumnTypes, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.serde2.SerDe

handleJobLevelConfiguration

Constructor Detail

DruidSerDe

public DruidSerDe()

Method Detail

initialize

public void initialize(org.apache.hadoop.conf.Configuration configuration,
                       Properties tableProperties,
                       Properties partitionProperties)
                throws org.apache.hadoop.hive.serde2.SerDeException

Overrides:

initialize in class org.apache.hadoop.hive.serde2.AbstractSerDe

Throws:

org.apache.hadoop.hive.serde2.SerDeException

submitMetadataRequest

protected org.apache.druid.query.metadata.metadata.SegmentAnalysis submitMetadataRequest(String address,
                                                                                         org.apache.druid.query.metadata.metadata.SegmentMetadataQuery query)
                                                                                  throws org.apache.hadoop.hive.serde2.SerDeException,
                                                                                         IOException

Throws:

org.apache.hadoop.hive.serde2.SerDeException

IOException

getSerializedClass

public Class<? extends org.apache.hadoop.io.Writable> getSerializedClass()

Specified by:

getSerializedClass in interface org.apache.hadoop.hive.serde2.Serializer

Specified by:

getSerializedClass in class org.apache.hadoop.hive.serde2.AbstractSerDe

serialize

public org.apache.hadoop.io.Writable serialize(Object o,
                                               org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector objectInspector)
                                        throws org.apache.hadoop.hive.serde2.SerDeException

Specified by:

serialize in interface org.apache.hadoop.hive.serde2.Serializer

Overrides:

serialize in class org.apache.hadoop.hive.serde2.AbstractSerDe

Throws:

org.apache.hadoop.hive.serde2.SerDeException

deserialize

public Object deserialize(org.apache.hadoop.io.Writable writable)
                   throws org.apache.hadoop.hive.serde2.SerDeException

Specified by:

deserialize in interface org.apache.hadoop.hive.serde2.Deserializer

Overrides:

deserialize in class org.apache.hadoop.hive.serde2.AbstractSerDe

Parameters:

writable - Druid Writable to be deserialized.

Returns:

List of Hive Writables.

Throws:

org.apache.hadoop.hive.serde2.SerDeException - if there is Serde issues.

deserializeAsPrimitive

public void deserializeAsPrimitive(org.apache.hadoop.io.Writable writable,
                                   Object[] rowBoat)
                            throws org.apache.hadoop.hive.serde2.SerDeException

Function to convert Druid Primitive values to Hive Primitives. Main usage of this is to pipe data to VectorRow. This has the exact same logic as deserialize(Writable), any modification here should be done there as well. Reason to have 2 function is that no vectorized path expects writables.

Parameters:

writable - Druid Writable.

rowBoat - Rowboat used to carry columns values.

Throws:

org.apache.hadoop.hive.serde2.SerDeException - in case of deserialization errors.

getObjectInspector

public org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector getObjectInspector()

shouldStoreFieldsInMetastore

public boolean shouldStoreFieldsInMetastore(Map<String,String> tableParams)

Overrides:

shouldStoreFieldsInMetastore in class org.apache.hadoop.hive.serde2.AbstractSerDe