org.apache.nifi.util.hive

Class HiveJdbcCommon

java.lang.Object

org.apache.nifi.util.hive.HiveJdbcCommon

public class HiveJdbcCommon
extends Object

JDBC / HiveQL common functions.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	HiveJdbcCommon.ResultSetRowCallback An interface for callback methods which allows processing of a row during the convertToXYZStream() processing.

Constructor Summary

Constructors

Constructor and Description
HiveJdbcCommon()

Method Summary

Modifier and Type	Method and Description
static long	convertToAvroStream(ResultSet rs, OutputStream outStream)
static long	convertToAvroStream(ResultSet rs, OutputStream outStream, String recordName, HiveJdbcCommon.ResultSetRowCallback callback)
static long	convertToCsvStream(ResultSet rs, OutputStream outStream)
static long	convertToCsvStream(ResultSet rs, OutputStream outStream, String recordName, HiveJdbcCommon.ResultSetRowCallback callback)
static org.apache.avro.Schema	createSchema(ResultSet rs)
static org.apache.avro.Schema	createSchema(ResultSet rs, String recordName) Creates an Avro schema from a result set.
static org.apache.hadoop.conf.Configuration	getConfigurationFromFiles(String configFiles)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveJdbcCommon

public HiveJdbcCommon()

Method Detail

convertToAvroStream

public static long convertToAvroStream(ResultSet rs,
                                       OutputStream outStream)
                                throws SQLException,
                                       IOException

Throws:

SQLException

IOException

convertToAvroStream

public static long convertToAvroStream(ResultSet rs,
                                       OutputStream outStream,
                                       String recordName,
                                       HiveJdbcCommon.ResultSetRowCallback callback)
                                throws SQLException,
                                       IOException

Throws:

SQLException

IOException

createSchema

public static org.apache.avro.Schema createSchema(ResultSet rs)
                                           throws SQLException

Throws:

SQLException

createSchema

public static org.apache.avro.Schema createSchema(ResultSet rs,
                                                  String recordName)
                                           throws SQLException

Creates an Avro schema from a result set. If the table/record name is known a priori and provided, use that as a fallback for the record name if it cannot be retrieved from the result set, and finally fall back to a default value.

Parameters:

rs - The result set to convert to Avro

recordName - The a priori record name to use if it cannot be determined from the result set.

Returns:

A Schema object representing the result set converted to an Avro record

Throws:

SQLException - if any error occurs during conversion

convertToCsvStream

public static long convertToCsvStream(ResultSet rs,
                                      OutputStream outStream)
                               throws SQLException,
                                      IOException

Throws:

SQLException

IOException

convertToCsvStream

public static long convertToCsvStream(ResultSet rs,
                                      OutputStream outStream,
                                      String recordName,
                                      HiveJdbcCommon.ResultSetRowCallback callback)
                               throws SQLException,
                                      IOException

Throws:

SQLException

IOException

getConfigurationFromFiles

public static org.apache.hadoop.conf.Configuration getConfigurationFromFiles(String configFiles)