org.apache.nifi.atlas.provenance.analyzer

Class AwsS3Directory

java.lang.Object

org.apache.nifi.atlas.provenance.AbstractNiFiProvenanceEventAnalyzer

org.apache.nifi.atlas.provenance.analyzer.AbstractDirectoryAnalyzer

org.apache.nifi.atlas.provenance.analyzer.AwsS3Directory

All Implemented Interfaces:

NiFiProvenanceEventAnalyzer

public class AwsS3Directory
extends AbstractDirectoryAnalyzer

Analyze a transit URI as an AWS S3 directory (skipping the object name). The analyzer outputs a v1 or v2 AWS S3 directory entity depending on the 'AWS S3 Model Version' property configured on the reporting task.

Atlas entity hierarchy v1: aws_s3_pseudo_dir -> aws_s3_bucket

aws_s3_pseudo_dir

• qualifiedName=s3a://bucket/path@namespace (example: s3a://mybucket/mydir1/mydir2@ns1)
• name=/path (example: /mydir1/mydir2)

aws_s3_bucket

• qualifiedName=s3a://bucket@namespace (example: s3a://mybucket@ns1)
• name=bucket (example: mybucket)

Atlas entity hierarchy v2: aws_s3_v2_directory -> aws_s3_v2_directory -> ... -> aws_s3_v2_bucket

aws_s3_v2_directory

• qualifiedName=s3a://bucket/path/@namespace (example: s3a://mybucket/mydir1/mydir2/@ns1)
• name=directory (example: mydir2)

aws_s3_v2_bucket

• qualifiedName=s3a://bucket@namespace (example: s3a://mybucket@ns1)
• name=bucket (example: mybucket)

Field Summary

Fields

Modifier and Type	Field and Description
static String	ATTR_BUCKET_V1
static String	ATTR_CONTAINER_V2
static String	ATTR_OBJECT_PREFIX_V1
static String	ATTR_OBJECT_PREFIX_V2
static String	TYPE_BUCKET_V1
static String	TYPE_BUCKET_V2
static String	TYPE_DIRECTORY_V1
static String	TYPE_DIRECTORY_V2

Constructor Summary

Constructors

Constructor and Description
AwsS3Directory()

Method Summary

Modifier and Type	Method and Description
protected org.apache.atlas.v1.model.instance.Referenceable	convertToReferenceable(org.apache.atlas.model.instance.AtlasEntity entity, Map<String,org.apache.atlas.model.instance.AtlasEntity> knownEntities)
private org.apache.atlas.v1.model.instance.Referenceable	createReferenceable(org.apache.atlas.model.instance.AtlasEntity entity)
String	targetTransitUriPattern() Returns target transit URI pattern that this Analyzer supports.

Methods inherited from class org.apache.nifi.atlas.provenance.analyzer.AbstractDirectoryAnalyzer

analyze

Methods inherited from class org.apache.nifi.atlas.provenance.AbstractNiFiProvenanceEventAnalyzer

parseUri, parseUrl, singleDataSetRef, splitHostNames

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.nifi.atlas.provenance.NiFiProvenanceEventAnalyzer

targetComponentTypePattern, targetProvenanceEventType

Field Detail

TYPE_DIRECTORY_V1

public static final String TYPE_DIRECTORY_V1

See Also:

Constant Field Values

TYPE_BUCKET_V1

public static final String TYPE_BUCKET_V1

See Also:

Constant Field Values

ATTR_BUCKET_V1

public static final String ATTR_BUCKET_V1

See Also:

Constant Field Values

ATTR_OBJECT_PREFIX_V1

public static final String ATTR_OBJECT_PREFIX_V1

See Also:

Constant Field Values

TYPE_DIRECTORY_V2

public static final String TYPE_DIRECTORY_V2

See Also:

Constant Field Values

TYPE_BUCKET_V2

public static final String TYPE_BUCKET_V2

See Also:

Constant Field Values

ATTR_CONTAINER_V2

public static final String ATTR_CONTAINER_V2

See Also:

Constant Field Values

ATTR_OBJECT_PREFIX_V2

public static final String ATTR_OBJECT_PREFIX_V2

See Also:

Constant Field Values

Constructor Detail

AwsS3Directory

public AwsS3Directory()

Method Detail

targetTransitUriPattern

public String targetTransitUriPattern()

Description copied from interface: NiFiProvenanceEventAnalyzer

Returns target transit URI pattern that this Analyzer supports.

Returns:

A RegularExpression to match with a transit URI of a provenance event.

convertToReferenceable

protected org.apache.atlas.v1.model.instance.Referenceable convertToReferenceable(org.apache.atlas.model.instance.AtlasEntity entity,
                                                                                  Map<String,org.apache.atlas.model.instance.AtlasEntity> knownEntities)

Specified by:

convertToReferenceable in class AbstractDirectoryAnalyzer

createReferenceable

private org.apache.atlas.v1.model.instance.Referenceable createReferenceable(org.apache.atlas.model.instance.AtlasEntity entity)