org.apache.gobblin.service.modules.core

Class GitFlowGraphMonitor

java.lang.Object

com.google.common.util.concurrent.AbstractIdleService

org.apache.gobblin.service.modules.core.GitMonitoringService

org.apache.gobblin.service.modules.core.GitFlowGraphMonitor

All Implemented Interfaces:

com.google.common.util.concurrent.Service

public class GitFlowGraphMonitor
extends GitMonitoringService

Service that monitors for changes to FlowGraph from a git repository. The git repository must have an inital commit that has no files since that is used as a base for getting the change list. The DataNodes and FlowEdges in FlowGraph need to be organized with the following directory structure on git: //.properties ///.properties

Nested Class Summary

Nested classes/interfaces inherited from interface com.google.common.util.concurrent.Service

com.google.common.util.concurrent.Service.Listener, com.google.common.util.concurrent.Service.State

Field Summary

Fields

Modifier and Type	Field and Description
static String	GIT_FLOWGRAPH_MONITOR_PREFIX

Fields inherited from class org.apache.gobblin.service.modules.core.GitMonitoringService

isActive

Constructor Summary

Constructors

Constructor and Description
GitFlowGraphMonitor(com.typesafe.config.Config config, com.google.common.base.Optional<? extends FSFlowTemplateCatalog> flowTemplateCatalog, FlowGraph graph, Map<URI,TopologySpec> topologySpecMap, CountDownLatch initComplete)

Method Summary

Modifier and Type	Method and Description
void	addChange(org.eclipse.jgit.diff.DiffEntry change) Add an element (i.e., a DataNode, or a FlowEdge to the FlowGraph for an added, updated or modified node or edge file.
void	removeChange(org.eclipse.jgit.diff.DiffEntry change) Remove an element (i.e.
boolean	shouldPollGit() Determine if the service should poll Git.

Methods inherited from class org.apache.gobblin.service.modules.core.GitMonitoringService

setActive, shutDown, startUp

Methods inherited from class com.google.common.util.concurrent.AbstractIdleService

addListener, awaitRunning, awaitRunning, awaitTerminated, awaitTerminated, executor, failureCause, isRunning, serviceName, start, startAndWait, startAsync, state, stop, stopAndWait, stopAsync, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

GIT_FLOWGRAPH_MONITOR_PREFIX

public static final String GIT_FLOWGRAPH_MONITOR_PREFIX

See Also:

Constant Field Values

Constructor Detail

GitFlowGraphMonitor

public GitFlowGraphMonitor(com.typesafe.config.Config config,
                           com.google.common.base.Optional<? extends FSFlowTemplateCatalog> flowTemplateCatalog,
                           FlowGraph graph,
                           Map<URI,TopologySpec> topologySpecMap,
                           CountDownLatch initComplete)

Method Detail

shouldPollGit

public boolean shouldPollGit()

Determine if the service should poll Git. Current behavior is both master and slave(s) will poll Git for changes to FlowGraph.

Specified by:

shouldPollGit in class GitMonitoringService

addChange

public void addChange(org.eclipse.jgit.diff.DiffEntry change)

Add an element (i.e., a DataNode, or a FlowEdge to the FlowGraph for an added, updated or modified node or edge file.

Specified by:

addChange in class GitMonitoringService

Parameters:

change -

removeChange

public void removeChange(org.eclipse.jgit.diff.DiffEntry change)

Remove an element (i.e. either a DataNode or a FlowEdge from the FlowGraph for a renamed or deleted DataNode or FlowEdge file.

Specified by:

removeChange in class GitMonitoringService

Parameters:

change -