org.apache.nifi.processors.hive

Class AbstractHiveQLProcessor

java.lang.Object

org.apache.nifi.components.AbstractConfigurableComponent

org.apache.nifi.processor.AbstractSessionFactoryProcessor

org.apache.nifi.processors.hive.AbstractHiveQLProcessor

All Implemented Interfaces:

ConfigurableComponent, Processor

Direct Known Subclasses:

PutHiveQL, SelectHiveQL

public abstract class AbstractHiveQLProcessor
extends AbstractSessionFactoryProcessor

An abstract base class for HiveQL processors to share common data, methods, etc.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private class	AbstractHiveQLProcessor.ParameterHolder
protected static class	AbstractHiveQLProcessor.TableName

Field Summary

Fields

Modifier and Type	Field and Description
(package private) static String	ATTR_INPUT_TABLES
(package private) static String	ATTR_OUTPUT_TABLES
static PropertyDescriptor	CHARSET
static PropertyDescriptor	HIVE_DBCP_SERVICE
protected static Pattern	HIVEQL_TYPE_ATTRIBUTE_PATTERN
protected static Pattern	NUMBER_PATTERN

Constructor Summary

Constructors

Constructor and Description
AbstractHiveQLProcessor()

Method Summary

Modifier and Type	Method and Description
private void	findTableNames(Object obj, Set<AbstractHiveQLProcessor.TableName> tableNames)
protected Set<AbstractHiveQLProcessor.TableName>	findTableNames(String query)
protected String	getHiveQL(ProcessSession session, FlowFile flowFile, Charset charset) Determines the HiveQL statement that should be executed for the given FlowFile
private String	normalize(String query) Normalize query.
protected void	setParameter(PreparedStatement stmt, String attrName, int parameterIndex, String parameterValue, int jdbcType) Determines how to map the given value to the appropriate JDBC data jdbcType and sets the parameter on the provided PreparedStatement
protected int	setParameters(int base, PreparedStatement stmt, int paramCount, Map<String,String> attributes) Sets all of the appropriate parameters on the given PreparedStatement, based on the given FlowFile attributes.
protected Map<String,String>	toQueryTableAttributes(Set<AbstractHiveQLProcessor.TableName> tableNames)

Methods inherited from class org.apache.nifi.processor.AbstractSessionFactoryProcessor

getControllerServiceLookup, getIdentifier, getLogger, getNodeTypeProvider, getRelationships, init, initialize, isConfigurationRestored, isScheduled, toString, updateConfiguredRestoredTrue, updateScheduledFalse, updateScheduledTrue

Methods inherited from class org.apache.nifi.components.AbstractConfigurableComponent

customValidate, equals, getPropertyDescriptor, getPropertyDescriptors, getSupportedDynamicPropertyDescriptor, getSupportedPropertyDescriptors, hashCode, onPropertyModified, validate

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.nifi.processor.Processor

isStateful, onTrigger

Methods inherited from interface org.apache.nifi.components.ConfigurableComponent

getPropertyDescriptor, getPropertyDescriptors, onPropertyModified, validate

Field Detail

HIVEQL_TYPE_ATTRIBUTE_PATTERN

protected static final Pattern HIVEQL_TYPE_ATTRIBUTE_PATTERN

NUMBER_PATTERN

protected static final Pattern NUMBER_PATTERN

ATTR_INPUT_TABLES

static String ATTR_INPUT_TABLES

ATTR_OUTPUT_TABLES

static String ATTR_OUTPUT_TABLES

HIVE_DBCP_SERVICE

public static final PropertyDescriptor HIVE_DBCP_SERVICE

CHARSET

public static final PropertyDescriptor CHARSET

Constructor Detail

AbstractHiveQLProcessor

public AbstractHiveQLProcessor()

Method Detail

getHiveQL

protected String getHiveQL(ProcessSession session,
                           FlowFile flowFile,
                           Charset charset)

Determines the HiveQL statement that should be executed for the given FlowFile

Parameters:

session - the session that can be used to access the given FlowFile

flowFile - the FlowFile whose HiveQL statement should be executed

Returns:

the HiveQL that is associated with the given FlowFile

setParameters

protected int setParameters(int base,
                            PreparedStatement stmt,
                            int paramCount,
                            Map<String,String> attributes)
                     throws SQLException

Sets all of the appropriate parameters on the given PreparedStatement, based on the given FlowFile attributes.

Parameters:

stmt - the statement to set the parameters on

attributes - the attributes from which to derive parameter indices, values, and types

Throws:

SQLException - if the PreparedStatement throws a SQLException when the appropriate setter is called

setParameter

protected void setParameter(PreparedStatement stmt,
                            String attrName,
                            int parameterIndex,
                            String parameterValue,
                            int jdbcType)
                     throws SQLException

Determines how to map the given value to the appropriate JDBC data jdbcType and sets the parameter on the provided PreparedStatement

Parameters:

stmt - the PreparedStatement to set the parameter on

attrName - the name of the attribute that the parameter is coming from - for logging purposes

parameterIndex - the index of the HiveQL parameter to set

parameterValue - the value of the HiveQL parameter to set

jdbcType - the JDBC Type of the HiveQL parameter to set

Throws:

SQLException - if the PreparedStatement throws a SQLException when calling the appropriate setter

findTableNames

protected Set<AbstractHiveQLProcessor.TableName> findTableNames(String query)

normalize

private String normalize(String query)

Normalize query. Hive resolves prepared statement parameters before executing a query, see HivePreparedStatement.updateSql(String, HashMap) for detail. HiveParser does not expect '?' to be in a query string, and throws an Exception if there is one. In this normalize method, '?' is replaced to 'x' to avoid that.

findTableNames

private void findTableNames(Object obj,
                            Set<AbstractHiveQLProcessor.TableName> tableNames)

toQueryTableAttributes

protected Map<String,String> toQueryTableAttributes(Set<AbstractHiveQLProcessor.TableName> tableNames)