org.apache.gobblin.service.modules.orchestration

Class Orchestrator

java.lang.Object

org.apache.gobblin.service.modules.orchestration.Orchestrator

All Implemented Interfaces:

Instrumentable, SpecCatalogListener

@Alpha
public class Orchestrator
extends Object
implements SpecCatalogListener, Instrumentable

Orchestrator that is a SpecCatalogListener. It listens to changes to TopologyCatalog and updates SpecCompiler state.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.gobblin.runtime.api.SpecCatalogListener

SpecCatalogListener.AddSpecCallback, SpecCatalogListener.DeleteSpecCallback, SpecCatalogListener.UpdateSpecCallback

Field Summary

Fields

Modifier and Type	Field and Description
protected org.slf4j.Logger	_log
protected com.google.common.base.Optional<DagManager>	dagManager
protected com.google.common.base.Optional<org.apache.gobblin.metrics.event.EventSubmitter>	eventSubmitter
protected org.apache.gobblin.metrics.MetricContext	metricContext
protected SpecCompiler	specCompiler
protected com.google.common.base.Optional<TopologyCatalog>	topologyCatalog

Constructor Summary

Constructors

Constructor and Description
Orchestrator(com.typesafe.config.Config config)
Orchestrator(com.typesafe.config.Config config, org.slf4j.Logger log)
Orchestrator(com.typesafe.config.Config config, com.google.common.base.Optional<TopologyCatalog> topologyCatalog) Constructor with no logging
Orchestrator(com.typesafe.config.Config config, com.google.common.base.Optional<TopologyCatalog> topologyCatalog, com.google.common.base.Optional<DagManager> dagManager, org.slf4j.Logger log)
Orchestrator(com.typesafe.config.Config config, com.google.common.base.Optional<TopologyCatalog> topologyCatalog, com.google.common.base.Optional<DagManager> dagManager, com.google.common.base.Optional<org.slf4j.Logger> log)
Orchestrator(com.typesafe.config.Config config, com.google.common.base.Optional<TopologyCatalog> topologyCatalog, com.google.common.base.Optional<DagManager> dagManager, com.google.common.base.Optional<org.slf4j.Logger> log, boolean instrumentationEnabled)

Method Summary

Modifier and Type	Method and Description
List<org.apache.gobblin.metrics.Tag<?>>	generateTags(State state)
org.apache.gobblin.metrics.MetricContext	getMetricContext()
SpecCompiler	getSpecCompiler()
boolean	isInstrumentationEnabled()
AddSpecResponse	onAddSpec(Spec addedSpec)
void	onDeleteSpec(URI deletedSpecURI, String deletedSpecVersion)
void	onDeleteSpec(URI deletedSpecURI, String deletedSpecVersion, Properties headers)
void	onUpdateSpec(Spec updatedSpec)
void	orchestrate(Spec spec)
void	remove(Spec spec, Properties headers)
void	switchMetricContext(List<org.apache.gobblin.metrics.Tag<?>> tags)
void	switchMetricContext(org.apache.gobblin.metrics.MetricContext context)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.gobblin.runtime.api.SpecCatalogListener

getName

Field Detail

_log

protected final org.slf4j.Logger _log

specCompiler

protected final SpecCompiler specCompiler

topologyCatalog

protected final com.google.common.base.Optional<TopologyCatalog> topologyCatalog

dagManager

protected final com.google.common.base.Optional<DagManager> dagManager

metricContext

protected final org.apache.gobblin.metrics.MetricContext metricContext

eventSubmitter

protected final com.google.common.base.Optional<org.apache.gobblin.metrics.event.EventSubmitter> eventSubmitter

Constructor Detail

Orchestrator

public Orchestrator(com.typesafe.config.Config config,
                    com.google.common.base.Optional<TopologyCatalog> topologyCatalog,
                    com.google.common.base.Optional<DagManager> dagManager,
                    com.google.common.base.Optional<org.slf4j.Logger> log,
                    boolean instrumentationEnabled)

Orchestrator

public Orchestrator(com.typesafe.config.Config config,
                    com.google.common.base.Optional<TopologyCatalog> topologyCatalog,
                    com.google.common.base.Optional<DagManager> dagManager,
                    com.google.common.base.Optional<org.slf4j.Logger> log)

Orchestrator

public Orchestrator(com.typesafe.config.Config config,
                    com.google.common.base.Optional<TopologyCatalog> topologyCatalog,
                    com.google.common.base.Optional<DagManager> dagManager,
                    org.slf4j.Logger log)

Orchestrator

public Orchestrator(com.typesafe.config.Config config,
                    org.slf4j.Logger log)

Orchestrator

public Orchestrator(com.typesafe.config.Config config,
                    com.google.common.base.Optional<TopologyCatalog> topologyCatalog)

Constructor with no logging

Orchestrator

public Orchestrator(com.typesafe.config.Config config)

Method Detail

getSpecCompiler

public SpecCompiler getSpecCompiler()

onAddSpec

public AddSpecResponse onAddSpec(Spec addedSpec)

Specified by:

onAddSpec in interface SpecCatalogListener

onDeleteSpec

public void onDeleteSpec(URI deletedSpecURI,
                         String deletedSpecVersion)

onDeleteSpec

public void onDeleteSpec(URI deletedSpecURI,
                         String deletedSpecVersion,
                         Properties headers)

Specified by:

onDeleteSpec in interface SpecCatalogListener

onUpdateSpec

public void onUpdateSpec(Spec updatedSpec)

Specified by:

onUpdateSpec in interface SpecCatalogListener

orchestrate

public void orchestrate(Spec spec)
                 throws Exception

Throws:

Exception

remove

public void remove(Spec spec,
                   Properties headers)
            throws IOException

Throws:

IOException

getMetricContext

@Nonnull
public org.apache.gobblin.metrics.MetricContext getMetricContext()

Specified by:

getMetricContext in interface Instrumentable

isInstrumentationEnabled

public boolean isInstrumentationEnabled()

Specified by:

isInstrumentationEnabled in interface Instrumentable

generateTags

public List<org.apache.gobblin.metrics.Tag<?>> generateTags(State state)

Specified by:

generateTags in interface Instrumentable

switchMetricContext

public void switchMetricContext(List<org.apache.gobblin.metrics.Tag<?>> tags)

Specified by:

switchMetricContext in interface Instrumentable

switchMetricContext

public void switchMetricContext(org.apache.gobblin.metrics.MetricContext context)

Specified by:

switchMetricContext in interface Instrumentable