public class KafkaProcessingRunner extends SparkRunner
SparkRunner.RUNNING_MODEsparkRunnerConfig, sparkSession| Constructor and Description |
|---|
KafkaProcessingRunner() |
KafkaProcessingRunner(SparkRunnerConfig config) |
| Modifier and Type | Method and Description |
|---|---|
protected List<PipelineStep> |
buildDefaultPipeline() |
protected void |
initialize(String[] arguments) |
protected org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
loadInitialDataset() |
buildMinimalPipeline, configurePipelineSteps, overwritePipelineSteps, run, runpublic KafkaProcessingRunner()
public KafkaProcessingRunner(SparkRunnerConfig config)
protected void initialize(String[] arguments)
initialize in class SparkRunnerprotected List<PipelineStep> buildDefaultPipeline()
buildDefaultPipeline in class SparkRunnerprotected org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> loadInitialDataset()
loadInitialDataset in class SparkRunnerCopyright © 2018–2019 viadee Unternehmensberatung AG. All rights reserved.