org.apache.gobblin.service.modules.flowgraph.datanodes.hive

Class HiveDataNode

java.lang.Object

org.apache.gobblin.service.modules.flowgraph.BaseDataNode

org.apache.gobblin.service.modules.flowgraph.datanodes.hive.HiveDataNode

All Implemented Interfaces:

DataNode

@Alpha
public class HiveDataNode
extends BaseDataNode

An HiveDataNode implementation. In addition to the required properties of a BaseDataNode, an HiveDataNode must have a metastore URI specified.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.gobblin.service.modules.flowgraph.DataNode

DataNode.DataNodeCreationException

Field Summary

Fields

Modifier and Type	Field and Description
static String	METASTORE_URI_KEY
static String	PLATFORM

Constructor Summary

Constructors

Constructor and Description
HiveDataNode(com.typesafe.config.Config nodeProps) Constructor.

Method Summary

Modifier and Type	Method and Description
String	getDefaultDatasetDescriptorClass()
String	getDefaultDatasetDescriptorPlatform()
boolean	isMetastoreUriValid(URI metastoreUri)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.gobblin.service.modules.flowgraph.DataNode

getId, getRawConfig, isActive

Field Detail

METASTORE_URI_KEY

public static final String METASTORE_URI_KEY

See Also:

Constant Field Values

PLATFORM

public static final String PLATFORM

See Also:

Constant Field Values

Constructor Detail

HiveDataNode

public HiveDataNode(com.typesafe.config.Config nodeProps)
             throws DataNode.DataNodeCreationException

Constructor. A HiveDataNode must have hive.metastore.uri property specified in addition to a node Id and fs.uri.

Throws:

DataNode.DataNodeCreationException

Method Detail

isMetastoreUriValid

public boolean isMetastoreUriValid(URI metastoreUri)

Parameters:

metastoreUri - hive metastore URI

Returns:

true if the scheme is "thrift" and authority is not empty.

getDefaultDatasetDescriptorClass

public String getDefaultDatasetDescriptorClass()

Specified by:

getDefaultDatasetDescriptorClass in interface DataNode

Overrides:

getDefaultDatasetDescriptorClass in class BaseDataNode

Returns:

a default dataset descriptor class for this DataNode, or null if a default should not be used.

getDefaultDatasetDescriptorPlatform

public String getDefaultDatasetDescriptorPlatform()

Specified by:

getDefaultDatasetDescriptorPlatform in interface DataNode

Overrides:

getDefaultDatasetDescriptorPlatform in class BaseDataNode

Returns:

a default dataset descriptor platform for this DataNode, or null if a default should not be used.