org.apache.gobblin.service.modules.flowgraph.datanodes.fs

Class AdlsDataNode

java.lang.Object

org.apache.gobblin.service.modules.flowgraph.BaseDataNode

org.apache.gobblin.service.modules.flowgraph.datanodes.fs.FileSystemDataNode

org.apache.gobblin.service.modules.flowgraph.datanodes.fs.AdlsDataNode

All Implemented Interfaces:

DataNode

public class AdlsDataNode
extends FileSystemDataNode

An implementation of an ADL (Azure Data Lake) DataNode.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.gobblin.service.modules.flowgraph.DataNode

DataNode.DataNodeCreationException

Field Summary

Fields

Modifier and Type	Field and Description
static String	ABFS_SCHEME
static String	ADLS_SCHEME

Fields inherited from class org.apache.gobblin.service.modules.flowgraph.datanodes.fs.FileSystemDataNode

FS_URI_KEY

Constructor Summary

Constructors

Constructor and Description
AdlsDataNode(com.typesafe.config.Config nodeProps)

Method Summary

Modifier and Type	Method and Description
String	getDefaultDatasetDescriptorPlatform()
boolean	isUriValid(URI fsUri)

Methods inherited from class org.apache.gobblin.service.modules.flowgraph.datanodes.fs.FileSystemDataNode

getDefaultDatasetDescriptorClass

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.gobblin.service.modules.flowgraph.DataNode

getId, getRawConfig, isActive

Field Detail

ADLS_SCHEME

public static final String ADLS_SCHEME

See Also:

Constant Field Values

ABFS_SCHEME

public static final String ABFS_SCHEME

See Also:

Constant Field Values

Constructor Detail

AdlsDataNode

public AdlsDataNode(com.typesafe.config.Config nodeProps)
             throws DataNode.DataNodeCreationException

Throws:

DataNode.DataNodeCreationException

Method Detail

isUriValid

public boolean isUriValid(URI fsUri)

Specified by:

isUriValid in class FileSystemDataNode

Parameters:

fsUri - FileSystem URI

Returns:

true if the scheme is "adl" and authority is not empty.

getDefaultDatasetDescriptorPlatform

public String getDefaultDatasetDescriptorPlatform()

Specified by:

getDefaultDatasetDescriptorPlatform in interface DataNode

Overrides:

getDefaultDatasetDescriptorPlatform in class BaseDataNode

Returns:

a default dataset descriptor platform for this DataNode, or null if a default should not be used.