Uses of Class
de.viadee.bpmnai.core.runner.config.SparkRunnerConfig

Packages that use SparkRunnerConfig

Package	Description
de.viadee.bpmnai.core.configuration.util
de.viadee.bpmnai.core.processing
de.viadee.bpmnai.core.processing.interfaces
de.viadee.bpmnai.core.processing.steps.dataprocessing
de.viadee.bpmnai.core.processing.steps.importing
de.viadee.bpmnai.core.processing.steps.output
de.viadee.bpmnai.core.processing.steps.userconfig
de.viadee.bpmnai.core.runner
de.viadee.bpmnai.core.runner.impl
de.viadee.bpmnai.core.util
de.viadee.bpmnai.core.util.arguments

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.configuration.util

Methods in de.viadee.bpmnai.core.configuration.util with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
void	ConfigurationUtils.createEmptyConfig(SparkRunnerConfig config)
Configuration	ConfigurationUtils.getConfiguration(boolean reload, SparkRunnerConfig config)
Configuration	ConfigurationUtils.getConfiguration(SparkRunnerConfig config)
String	ConfigurationUtils.getConfigurationFileName(SparkRunnerConfig config)
String	ConfigurationUtils.getConfigurationFilePath(SparkRunnerConfig config)
void	ConfigurationUtils.validateConfigurationFileVsSparkRunnerConfig(SparkRunnerConfig config)
void	ConfigurationUtils.writeConfigurationToFile(SparkRunnerConfig config)

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.processing

Methods in de.viadee.bpmnai.core.processing with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	PreprocessingRunner.run(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, SparkRunnerConfig config)

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.processing.interfaces

Methods in de.viadee.bpmnai.core.processing.interfaces with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	PreprocessingStepInterface.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataSet, Map<String,Object> parameters, SparkRunnerConfig config) Defines one processing step and what to do with the data

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.processing.steps.dataprocessing

Methods in de.viadee.bpmnai.core.processing.steps.dataprocessing with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	AggregateActivityInstancesStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	ColumnHashStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataSet, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	AddVariableColumnsStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	CreateColumnsFromJsonStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	TypeCastStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	ColumnRemoveStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataSet, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	ReduceColumnsStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	FillActivityInstancesHistoryStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	DetermineProcessVariablesStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	AggregateProcessInstancesStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	AddReducedColumnsToDatasetStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	DataFilterStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.processing.steps.importing

Methods in de.viadee.bpmnai.core.processing.steps.importing with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	ColumnsPreparationStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	InitialCleanupStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.processing.steps.output

Methods in de.viadee.bpmnai.core.processing.steps.output with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	WriteToDataSinkStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	WriteToDiscStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, Map<String,Object> parameters, SparkRunnerConfig config)

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.processing.steps.userconfig

Methods in de.viadee.bpmnai.core.processing.steps.userconfig with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	DataFilterOnActivityStep.runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataSet, Map<String,Object> parameters, SparkRunnerConfig config)

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.runner

Fields in de.viadee.bpmnai.core.runner declared as SparkRunnerConfig

Modifier and Type	Field and Description
protected SparkRunnerConfig	SparkPredictionServiceRunner.sparkRunnerConfig
protected SparkRunnerConfig	SparkRunner.sparkRunnerConfig

Methods in de.viadee.bpmnai.core.runner with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
void	SparkPredictionServiceRunner.setup(SparkRunnerConfig sparkRunnerConfig)

Constructors in de.viadee.bpmnai.core.runner with parameters of type SparkRunnerConfig

Constructor and Description
SparkRunner(SparkRunnerConfig config)

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.runner.impl

Constructors in de.viadee.bpmnai.core.runner.impl with parameters of type SparkRunnerConfig

Constructor and Description
CSVImportAndProcessingRunner(SparkRunnerConfig config)
KafkaImportRunner(SparkRunnerConfig config)
KafkaProcessingRunner(SparkRunnerConfig config)

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.util

Methods in de.viadee.bpmnai.core.util with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
void	BpmnaiUtils.writeDatasetToCSV(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataSet, String subDirectory, SparkRunnerConfig config)
void	BpmnaiUtils.writeDatasetToJson(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, String targetfolder, SparkRunnerConfig config)
void	BpmnaiUtils.writeDatasetToParquet(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataSet, String subDirectory, SparkRunnerConfig config)

Uses of SparkRunnerConfig in de.viadee.bpmnai.core.util.arguments

Methods in de.viadee.bpmnai.core.util.arguments with parameters of type SparkRunnerConfig

Modifier and Type	Method and Description
void	KafkaProcessingArguments.createOrUpdateSparkRunnerConfig(SparkRunnerConfig config)
void	AbstractArguments.createOrUpdateSparkRunnerConfig(SparkRunnerConfig config)
void	CSVImportAndProcessingArguments.createOrUpdateSparkRunnerConfig(SparkRunnerConfig config)
void	KafkaImportArguments.createOrUpdateSparkRunnerConfig(SparkRunnerConfig config)
protected void	AbstractArguments.validateConfig(SparkRunnerConfig config)
protected void	CSVImportAndProcessingArguments.validateConfig(SparkRunnerConfig config)