public abstract class SparkRunner extends Object
| Modifier and Type | Field and Description |
|---|---|
protected String |
dataLevel |
protected org.apache.spark.sql.SparkSession |
sparkSession |
| Constructor and Description |
|---|
SparkRunner() |
| Modifier and Type | Method and Description |
|---|---|
protected abstract List<PipelineStep> |
buildDefaultPipeline() |
void |
configurePipelineSteps() |
protected abstract void |
initialize(String[] arguments) |
protected abstract org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
loadInitialDataset() |
void |
run(String[] arguments) |
protected org.apache.spark.sql.SparkSession sparkSession
protected String dataLevel
protected abstract void initialize(String[] arguments)
protected abstract List<PipelineStep> buildDefaultPipeline()
protected abstract org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> loadInitialDataset()
public void run(String[] arguments) throws FaultyConfigurationException
FaultyConfigurationExceptionpublic void configurePipelineSteps()
throws FaultyConfigurationException
FaultyConfigurationExceptionCopyright © 2018 viadee Unternehmensberatung AG. All rights reserved.