org.apache.gobblin.service.modules.flowgraph

Interface DataNode

All Known Implementing Classes:

AdlsDataNode, BaseDataNode, FileSystemDataNode, HdfsDataNode, HiveDataNode, HttpDataNode, LocalFSDataNode, SftpDataNode, SqlDataNode

@Alpha
public interface DataNode

Representation of a node in the FlowGraph. Each node is identified by a unique identifier.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	DataNode.DataNodeCreationException

Method Summary

Modifier and Type	Method and Description
String	getDefaultDatasetDescriptorClass()
String	getDefaultDatasetDescriptorPlatform()
String	getId()
com.typesafe.config.Config	getRawConfig()
boolean	isActive()

Method Detail

getId

String getId()

Returns:

the identifier of a DataNode.

getRawConfig

com.typesafe.config.Config getRawConfig()

Returns:

the attributes of a DataNode. It also includes properties for resolving a JobTemplate e.g. "source.fs.uri" for an HDFS node, "jdbc.publisher.url" for JDBC node.

getDefaultDatasetDescriptorClass

String getDefaultDatasetDescriptorClass()

Returns:

a default dataset descriptor class for this DataNode, or null if a default should not be used.

getDefaultDatasetDescriptorPlatform

String getDefaultDatasetDescriptorPlatform()

Returns:

a default dataset descriptor platform for this DataNode, or null if a default should not be used.

isActive

boolean isActive()

Returns:

true if the DataNode is active