org.apache.gobblin.service.modules.dataset

Class FSDatasetDescriptor

java.lang.Object

org.apache.gobblin.service.modules.dataset.BaseDatasetDescriptor

org.apache.gobblin.service.modules.dataset.FSDatasetDescriptor

All Implemented Interfaces:

DatasetDescriptor

@Alpha
public class FSDatasetDescriptor
extends BaseDatasetDescriptor
implements DatasetDescriptor

An implementation of DatasetDescriptor with FS-based storage.

Constructor Summary

Constructors

Constructor and Description
FSDatasetDescriptor(com.typesafe.config.Config config)

Method Summary

Modifier and Type	Method and Description
boolean	contains(DatasetDescriptor o)
protected boolean	isPathContaining(DatasetDescriptor other) If other descriptor has subpaths, this method checks that each concatenation of path + subpath is matched by this path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.gobblin.service.modules.dataset.DatasetDescriptor

getDescription, getFormatConfig, getPath, getPlatform, getRawConfig, isRetentionApplied

Constructor Detail

FSDatasetDescriptor

public FSDatasetDescriptor(com.typesafe.config.Config config)
                    throws IOException

Throws:

IOException

Method Detail

isPathContaining

protected boolean isPathContaining(DatasetDescriptor other)

If other descriptor has subpaths, this method checks that each concatenation of path + subpath is matched by this path. Otherwise, it just checks the path.

Specified by:

isPathContaining in class BaseDatasetDescriptor

Parameters:

other - descriptor whose path/subpaths to check

Returns:

true if all subpaths are matched by this DatasetDescriptor's path, or if subpaths is null and the other's path matches this path.

contains

public boolean contains(DatasetDescriptor o)

Specified by:

contains in interface DatasetDescriptor

Overrides:

contains in class BaseDatasetDescriptor

Returns:

true if this DatasetDescriptor contains the other DatasetDescriptor i.e. the datasets described by this DatasetDescriptor is a subset of the datasets described by the other DatasetDescriptor. This operation is non-commutative.