org.apache.nifi.atlas.provenance.lineage

Class CompleteFlowPathLineage

java.lang.Object

org.apache.nifi.atlas.provenance.lineage.AbstractLineageStrategy

org.apache.nifi.atlas.provenance.lineage.CompleteFlowPathLineage

All Implemented Interfaces:

LineageStrategy

public class CompleteFlowPathLineage
extends AbstractLineageStrategy

Field Summary

Fields inherited from class org.apache.nifi.atlas.provenance.lineage.AbstractLineageStrategy

logger

Constructor Summary

Constructors

Constructor and Description
CompleteFlowPathLineage()

Method Summary

Modifier and Type	Method and Description
private void	analyzeLineagePath(AnalysisContext analysisContext, LineagePath lineagePath)
private void	analyzeLineageTree(org.apache.nifi.provenance.lineage.ComputeLineageResult lineage, Map<String,List<org.apache.nifi.provenance.lineage.LineageNode>> lineageTree)
private void	createCompleteFlowPath(NiFiFlow nifiFlow, LineagePath lineagePath, List<Tuple<NiFiFlowPath,DataSetRefs>> createdFlowPaths) Create a new FlowPath from a LineagePath.
private void	extractLineagePaths(AnalysisContext context, Map<String,List<org.apache.nifi.provenance.lineage.LineageNode>> lineageTree, LineagePath lineagePath, ProvenanceEventRecord lastEvent)
private List<org.apache.nifi.provenance.lineage.LineageNode>	findParentEvents(Map<String,List<org.apache.nifi.provenance.lineage.LineageNode>> lineageTree, ProvenanceEventRecord event)
ProvenanceEventType[]	getTargetEventTypes()
void	processEvent(AnalysisContext analysisContext, NiFiFlow nifiFlow, ProvenanceEventRecord event)

Methods inherited from class org.apache.nifi.atlas.provenance.lineage.AbstractLineageStrategy

addDataSetRefs, addDataSetRefs, addDataSetRefs, addDataSetRefs, createEntity, executeAnalyzer, setLineageContext, toReferenceable

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CompleteFlowPathLineage

public CompleteFlowPathLineage()

Method Detail

getTargetEventTypes

public ProvenanceEventType[] getTargetEventTypes()

processEvent

public void processEvent(AnalysisContext analysisContext,
                         NiFiFlow nifiFlow,
                         ProvenanceEventRecord event)

findParentEvents

private List<org.apache.nifi.provenance.lineage.LineageNode> findParentEvents(Map<String,List<org.apache.nifi.provenance.lineage.LineageNode>> lineageTree,
                                                                              ProvenanceEventRecord event)

extractLineagePaths

private void extractLineagePaths(AnalysisContext context,
                                 Map<String,List<org.apache.nifi.provenance.lineage.LineageNode>> lineageTree,
                                 LineagePath lineagePath,
                                 ProvenanceEventRecord lastEvent)

analyzeLineagePath

private void analyzeLineagePath(AnalysisContext analysisContext,
                                LineagePath lineagePath)

analyzeLineageTree

private void analyzeLineageTree(org.apache.nifi.provenance.lineage.ComputeLineageResult lineage,
                                Map<String,List<org.apache.nifi.provenance.lineage.LineageNode>> lineageTree)

createCompleteFlowPath

private void createCompleteFlowPath(NiFiFlow nifiFlow,
                                    LineagePath lineagePath,
                                    List<Tuple<NiFiFlowPath,DataSetRefs>> createdFlowPaths)

Create a new FlowPath from a LineagePath. FlowPaths created by this method will have a hash in its qualified name.

This method processes parents first to generate a hash, as parent LineagePath hashes contribute child hash in order to distinguish FlowPaths based on the complete path for a given FlowFile. For example, even if two lineagePaths have identical componentIds/inputs/outputs, if those parents have different inputs, those should be treated as different paths.

Parameters:

nifiFlow - A reference to current NiFiFlow

lineagePath - LineagePath from which NiFiFlowPath and DataSet refs are created and added to the createdFlowPaths.

createdFlowPaths - A list to buffer created NiFiFlowPaths, in order to defer sending notification to Kafka until all parent FlowPath get analyzed.