org.apache.hudi.sink.clustering

Class FlinkClusteringConfig

java.lang.Object

org.apache.flink.api.common.ExecutionConfig.GlobalJobParameters

org.apache.flink.configuration.Configuration

org.apache.hudi.sink.clustering.FlinkClusteringConfig

All Implemented Interfaces:

Serializable, Cloneable, org.apache.flink.configuration.ReadableConfig, org.apache.flink.configuration.WritableConfig, org.apache.flink.core.io.IOReadableWritable

public class FlinkClusteringConfig
extends org.apache.flink.configuration.Configuration

Configurations for Hoodie Flink clustering.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
Integer	archiveMaxCommits
Integer	archiveMinCommits
Boolean	cleanAsyncEnable
Integer	cleanRetainCommits
Integer	clusteringDeltaCommits
String	clusteringInstantTime
String	clusteringSeq
Integer	clusteringTasks
Integer	compactionMaxMemory
List<String>	configs
Boolean	help
Integer	maxNumGroups
Integer	minClusteringIntervalSeconds
String	path
String	planPartitionFilterMode
String	planStrategyClass
String	propsFilePath
Boolean	schedule
static String	SEQ_FIFO
static String	SEQ_LIFO
Boolean	serviceMode
Integer	skipFromLatestPartitions
Long	smallFileLimit
String	sortColumns
Long	targetFileMaxBytes
Integer	targetPartitions

Fields inherited from class org.apache.flink.configuration.Configuration

confData

Constructor Summary

Constructors

Constructor and Description
FlinkClusteringConfig()

Method Summary

Modifier and Type	Method and Description
static TypedProperties	buildProperties(List<String> props)
static TypedProperties	getProps(FlinkClusteringConfig cfg)
static org.apache.flink.configuration.Configuration	toFlinkConfig(FlinkClusteringConfig config) Transforms a FlinkClusteringConfig.config into Configuration.

Methods inherited from class org.apache.flink.configuration.Configuration

addAll, addAll, addAllToProperties, clone, contains, containsKey, equals, fromMap, get, getBoolean, getBoolean, getBoolean, getBytes, getClass, getDouble, getDouble, getDouble, getEnum, getFloat, getFloat, getFloat, getInteger, getInteger, getInteger, getLong, getLong, getLong, getOptional, getString, getString, getString, getValue, hashCode, keySet, read, removeConfig, set, setBoolean, setBoolean, setBytes, setClass, setDouble, setDouble, setFloat, setFloat, setInteger, setInteger, setLong, setLong, setString, setString, toMap, toString, write

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

help

public Boolean help

path

public String path

clusteringDeltaCommits

public Integer clusteringDeltaCommits

clusteringTasks

public Integer clusteringTasks

compactionMaxMemory

public Integer compactionMaxMemory

cleanRetainCommits

public Integer cleanRetainCommits

archiveMinCommits

public Integer archiveMinCommits

archiveMaxCommits

public Integer archiveMaxCommits

schedule

public Boolean schedule

clusteringInstantTime

public String clusteringInstantTime

cleanAsyncEnable

public Boolean cleanAsyncEnable

planStrategyClass

public String planStrategyClass

planPartitionFilterMode

public String planPartitionFilterMode

targetFileMaxBytes

public Long targetFileMaxBytes

smallFileLimit

public Long smallFileLimit

skipFromLatestPartitions

public Integer skipFromLatestPartitions

sortColumns

public String sortColumns

maxNumGroups

public Integer maxNumGroups

targetPartitions

public Integer targetPartitions

SEQ_FIFO

public static final String SEQ_FIFO

See Also:

Constant Field Values

SEQ_LIFO

public static final String SEQ_LIFO

See Also:

Constant Field Values

clusteringSeq

public String clusteringSeq

serviceMode

public Boolean serviceMode

minClusteringIntervalSeconds

public Integer minClusteringIntervalSeconds

configs

public List<String> configs

propsFilePath

public String propsFilePath

Constructor Detail

FlinkClusteringConfig

public FlinkClusteringConfig()

Method Detail

buildProperties

public static TypedProperties buildProperties(List<String> props)

getProps

public static TypedProperties getProps(FlinkClusteringConfig cfg)

toFlinkConfig

public static org.apache.flink.configuration.Configuration toFlinkConfig(FlinkClusteringConfig config)

Transforms a FlinkClusteringConfig.config into Configuration. The latter is more suitable for the table APIs. It reads all the properties in the properties file (set by `--props` option) and cmd line options (set by `--hoodie-conf` option).