org.apache.gobblin.service.modules.flow

Class MockedSpecCompiler

java.lang.Object

org.apache.gobblin.service.modules.flow.BaseFlowToJobSpecCompiler

org.apache.gobblin.service.modules.flow.IdentityFlowToJobSpecCompiler

org.apache.gobblin.service.modules.flow.MockedSpecCompiler

All Implemented Interfaces:

Instrumentable, SpecCatalogListener, SpecCompiler

public class MockedSpecCompiler
extends IdentityFlowToJobSpecCompiler

This mocked SpecCompiler class creates 3 dummy job specs to emulate flow spec compiler. It can also be used to compile in a certain way or not to compile at all to write negative test cases. It uses InMemorySpecExecutor for these dummy specs.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.gobblin.runtime.api.SpecCatalogListener

SpecCatalogListener.AddSpecCallback, SpecCatalogListener.DeleteSpecCallback, SpecCatalogListener.UpdateSpecCallback

Field Summary

Fields

Modifier and Type	Field and Description
static String	UNCOMPILABLE_FLOW

Fields inherited from class org.apache.gobblin.service.modules.flow.BaseFlowToJobSpecCompiler

active, config, dataAuthorizationTimer, flowCompilationFailedMeter, flowCompilationSuccessFulMeter, flowCompilationTimer, log, metricContext, templateCatalog, topologySpecMap

Constructor Summary

Constructors

Constructor and Description
MockedSpecCompiler(com.typesafe.config.Config config)

Method Summary

Modifier and Type	Method and Description
Dag<JobExecutionPlan>	compileFlow(Spec spec) Take in a logical Spec and compile corresponding materialized Specs and the mapping to SpecExecutor that they can be run on.

Methods inherited from class org.apache.gobblin.service.modules.flow.BaseFlowToJobSpecCompiler

awaitHealthy, generateTags, getMetricContext, getTopologySpecMap, isInstrumentationEnabled, jobSpecGenerator, jobSpecTemplateURIGenerator, jobSpecURIGenerator, onAddSpec, onDeleteSpec, onDeleteSpec, onUpdateSpec, switchMetricContext, switchMetricContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.gobblin.service.modules.flow.SpecCompiler

setActive

Methods inherited from interface org.apache.gobblin.runtime.api.SpecCatalogListener

getName

Field Detail

UNCOMPILABLE_FLOW

public static final String UNCOMPILABLE_FLOW

See Also:

Constant Field Values

Constructor Detail

MockedSpecCompiler

public MockedSpecCompiler(com.typesafe.config.Config config)

Method Detail

compileFlow

public Dag<JobExecutionPlan> compileFlow(Spec spec)

Description copied from interface: SpecCompiler

Take in a logical Spec and compile corresponding materialized Specs and the mapping to SpecExecutor that they can be run on. All the specs generated from the compileFlow must have a "flow.executionId"

Specified by:

compileFlow in interface SpecCompiler

Overrides:

compileFlow in class IdentityFlowToJobSpecCompiler

Parameters:

spec - Spec to compile.

Returns:

Map of materialized physical Spec and SpecExecutor.