public class DataFilterOnActivityStep extends Object implements PreprocessingStepInterface
| Constructor and Description |
|---|
DataFilterOnActivityStep() |
| Modifier and Type | Method and Description |
|---|---|
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataSet,
Map<String,Object> parameters,
SparkRunnerConfig config)
Defines one processing step and what to do with the data
|
public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> runPreprocessingStep(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataSet,
Map<String,Object> parameters,
SparkRunnerConfig config)
PreprocessingStepInterfacerunPreprocessingStep in interface PreprocessingStepInterfacedataSet - the incoming dataset for this processing stepparameters - config - the SparkRunnerConfig for this runCopyright © 2018–2019 viadee Unternehmensberatung AG. All rights reserved.