org.apache.hudi.sink.compact

Class FlinkCompactionConfig

java.lang.Object

org.apache.flink.api.common.ExecutionConfig.GlobalJobParameters

org.apache.flink.configuration.Configuration

org.apache.hudi.sink.compact.FlinkCompactionConfig

All Implemented Interfaces:

Serializable, Cloneable, org.apache.flink.configuration.ReadableConfig, org.apache.flink.configuration.WritableConfig, org.apache.flink.core.io.IOReadableWritable

public class FlinkCompactionConfig
extends org.apache.flink.configuration.Configuration

Configurations for Hoodie Flink compaction.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
Integer	archiveMaxCommits
Integer	archiveMinCommits
Boolean	cleanAsyncEnable
Integer	cleanRetainCommits
Integer	compactionDeltaCommits
Integer	compactionDeltaSeconds
Integer	compactionMaxMemory
String	compactionPlanInstant
String	compactionPlanSelectStrategy
String	compactionSeq
Long	compactionTargetIo
Integer	compactionTasks
String	compactionTriggerStrategy
Boolean	help
Integer	maxNumCompactionPlans
Integer	minCompactionIntervalSeconds
static String	NUM_AND_TIME
static String	NUM_COMMITS
static String	NUM_OR_TIME
String	path
Boolean	schedule
static String	SEQ_FIFO
static String	SEQ_LIFO
Boolean	serviceMode
String	spillableMapPath
static String	TIME_ELAPSED

Fields inherited from class org.apache.flink.configuration.Configuration

confData

Constructor Summary

Constructors

Constructor and Description
FlinkCompactionConfig()

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.configuration.Configuration	toFlinkConfig(FlinkCompactionConfig config) Transforms a HoodieFlinkCompaction.config into Configuration.

Methods inherited from class org.apache.flink.configuration.Configuration

addAll, addAll, addAllToProperties, clone, contains, containsKey, equals, fromMap, get, getBoolean, getBoolean, getBoolean, getBytes, getClass, getDouble, getDouble, getDouble, getEnum, getFloat, getFloat, getFloat, getInteger, getInteger, getInteger, getLong, getLong, getLong, getOptional, getString, getString, getString, getValue, hashCode, keySet, read, removeConfig, set, setBoolean, setBoolean, setBytes, setClass, setDouble, setDouble, setFloat, setFloat, setInteger, setInteger, setLong, setLong, setString, setString, toMap, toString, write

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

help

public Boolean help

path

public String path

NUM_COMMITS

public static final String NUM_COMMITS

See Also:

Constant Field Values

TIME_ELAPSED

public static final String TIME_ELAPSED

See Also:

Constant Field Values

NUM_AND_TIME

public static final String NUM_AND_TIME

See Also:

Constant Field Values

NUM_OR_TIME

public static final String NUM_OR_TIME

See Also:

Constant Field Values

compactionTriggerStrategy

public String compactionTriggerStrategy

compactionDeltaCommits

public Integer compactionDeltaCommits

compactionDeltaSeconds

public Integer compactionDeltaSeconds

cleanAsyncEnable

public Boolean cleanAsyncEnable

cleanRetainCommits

public Integer cleanRetainCommits

archiveMinCommits

public Integer archiveMinCommits

archiveMaxCommits

public Integer archiveMaxCommits

compactionMaxMemory

public Integer compactionMaxMemory

compactionTargetIo

public Long compactionTargetIo

compactionTasks

public Integer compactionTasks

schedule

public Boolean schedule

SEQ_FIFO

public static final String SEQ_FIFO

See Also:

Constant Field Values

SEQ_LIFO

public static final String SEQ_LIFO

See Also:

Constant Field Values

compactionSeq

public String compactionSeq

serviceMode

public Boolean serviceMode

minCompactionIntervalSeconds

public Integer minCompactionIntervalSeconds

compactionPlanSelectStrategy

public String compactionPlanSelectStrategy

maxNumCompactionPlans

public Integer maxNumCompactionPlans

compactionPlanInstant

public String compactionPlanInstant

spillableMapPath

public String spillableMapPath

Constructor Detail

FlinkCompactionConfig

public FlinkCompactionConfig()

Method Detail

toFlinkConfig

public static org.apache.flink.configuration.Configuration toFlinkConfig(FlinkCompactionConfig config)

Transforms a HoodieFlinkCompaction.config into Configuration. The latter is more suitable for the table APIs. It reads all the properties in the properties file (set by `--props` option) and cmd line options (set by `--hoodie-conf` option).