org.apache.hudi.config

Class HoodieCompactionConfig

java.lang.Object

org.apache.hudi.common.config.HoodieConfig

org.apache.hudi.config.HoodieCompactionConfig

All Implemented Interfaces:

Serializable

@Immutable
public class HoodieCompactionConfig
extends HoodieConfig

Compaction related config.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HoodieCompactionConfig.Builder

Field Summary

Fields

Modifier and Type	Field and Description
static String	COMPACTION_LAZY_BLOCK_READ_ENABLED_PROP Deprecated. Use HoodieReaderConfig.COMPACTION_LAZY_BLOCK_READ_ENABLE and its methods instead
static ConfigProperty<Long>	COMPACTION_LOG_FILE_NUM_THRESHOLD
static ConfigProperty<Long>	COMPACTION_LOG_FILE_SIZE_THRESHOLD
static String	COMPACTION_REVERSE_LOG_READ_ENABLED_PROP Deprecated. Use HoodieReaderConfig.COMPACTION_REVERSE_LOG_READ_ENABLE and its methods instead
static ConfigProperty<String>	COMPACTION_SPECIFY_PARTITION_PATH_REGEX
static ConfigProperty<String>	COMPACTION_STRATEGY
static String	COMPACTION_STRATEGY_PROP Deprecated. Use COMPACTION_STRATEGY and its methods instead
static ConfigProperty<String>	COPY_ON_WRITE_AUTO_SPLIT_INSERTS
static ConfigProperty<String>	COPY_ON_WRITE_INSERT_SPLIT_SIZE Configs related to specific table types.
static ConfigProperty<String>	COPY_ON_WRITE_RECORD_SIZE_ESTIMATE
static String	COPY_ON_WRITE_TABLE_AUTO_SPLIT_INSERTS Deprecated. Use COPY_ON_WRITE_AUTO_SPLIT_INSERTS and its methods instead
static String	COPY_ON_WRITE_TABLE_INSERT_SPLIT_SIZE Deprecated. Use COPY_ON_WRITE_INSERT_SPLIT_SIZE and its methods instead
static String	COPY_ON_WRITE_TABLE_RECORD_SIZE_ESTIMATE Deprecated. Use COPY_ON_WRITE_RECORD_SIZE_ESTIMATE and its methods instead
static String	DEFAULT_COMPACTION_LAZY_BLOCK_READ_ENABLED Deprecated. Use HoodieReaderConfig.COMPACTION_LAZY_BLOCK_READ_ENABLE and its methods instead
static String	DEFAULT_COMPACTION_REVERSE_LOG_READ_ENABLED Deprecated. Use HoodieReaderConfig.COMPACTION_REVERSE_LOG_READ_ENABLE and its methods instead
static String	DEFAULT_COMPACTION_STRATEGY Deprecated. Use COMPACTION_STRATEGY and its methods instead
static String	DEFAULT_COPY_ON_WRITE_TABLE_AUTO_SPLIT_INSERTS Deprecated. Use COPY_ON_WRITE_AUTO_SPLIT_INSERTS and its methods instead
static String	DEFAULT_COPY_ON_WRITE_TABLE_INSERT_SPLIT_SIZE Deprecated. Use COPY_ON_WRITE_INSERT_SPLIT_SIZE and its methods instead
static String	DEFAULT_COPY_ON_WRITE_TABLE_RECORD_SIZE_ESTIMATE Deprecated. Use COPY_ON_WRITE_RECORD_SIZE_ESTIMATE and its methods instead
static String	DEFAULT_PARQUET_SMALL_FILE_LIMIT_BYTES Deprecated. Use PARQUET_SMALL_FILE_LIMIT and its methods instead
static String	DEFAULT_RECORD_SIZE_ESTIMATION_THRESHOLD Deprecated. Use RECORD_SIZE_ESTIMATION_THRESHOLD and its methods instead
static String	DEFAULT_TARGET_IO_PER_COMPACTION_IN_MB Deprecated. Use TARGET_IO_PER_COMPACTION_IN_MB and its methods instead
static String	DEFAULT_TARGET_PARTITIONS_PER_DAYBASED_COMPACTION Deprecated. Use TARGET_PARTITIONS_PER_DAYBASED_COMPACTION and its methods instead
static ConfigProperty<String>	ENABLE_LOG_COMPACTION
static ConfigProperty<String>	INLINE_COMPACT
static ConfigProperty<String>	INLINE_COMPACT_NUM_DELTA_COMMITS
static String	INLINE_COMPACT_NUM_DELTA_COMMITS_PROP Deprecated. Use INLINE_COMPACT_NUM_DELTA_COMMITS and its methods instead
static String	INLINE_COMPACT_PROP Deprecated. Use INLINE_COMPACT and its methods instead
static ConfigProperty<String>	INLINE_COMPACT_TIME_DELTA_SECONDS
static String	INLINE_COMPACT_TIME_DELTA_SECONDS_PROP Deprecated. Use INLINE_COMPACT_TIME_DELTA_SECONDS and its methods instead
static ConfigProperty<String>	INLINE_COMPACT_TRIGGER_STRATEGY
static String	INLINE_COMPACT_TRIGGER_STRATEGY_PROP Deprecated. Use INLINE_COMPACT_TRIGGER_STRATEGY and its methods instead
static ConfigProperty<String>	INLINE_LOG_COMPACT
static ConfigProperty<String>	LOG_COMPACTION_BLOCKS_THRESHOLD
static ConfigProperty<String>	PARQUET_SMALL_FILE_LIMIT
static String	PARQUET_SMALL_FILE_LIMIT_BYTES Deprecated. Use PARQUET_SMALL_FILE_LIMIT and its methods instead
static ConfigProperty<String>	RECORD_SIZE_ESTIMATION_THRESHOLD
static String	RECORD_SIZE_ESTIMATION_THRESHOLD_PROP Deprecated. Use RECORD_SIZE_ESTIMATION_THRESHOLD and its methods instead
static ConfigProperty<String>	SCHEDULE_INLINE_COMPACT
static ConfigProperty<String>	TARGET_IO_PER_COMPACTION_IN_MB
static String	TARGET_IO_PER_COMPACTION_IN_MB_PROP Deprecated. Use TARGET_IO_PER_COMPACTION_IN_MB and its methods instead
static ConfigProperty<String>	TARGET_PARTITIONS_PER_DAYBASED_COMPACTION
static String	TARGET_PARTITIONS_PER_DAYBASED_COMPACTION_PROP Deprecated. Use TARGET_PARTITIONS_PER_DAYBASED_COMPACTION and its methods instead

Fields inherited from class org.apache.hudi.common.config.HoodieConfig

CONFIG_VALUES_DELIMITER, MAX_READ_RETRIES, props, READ_RETRY_DELAY_MSEC

Method Summary

Modifier and Type	Method and Description
static HoodieCompactionConfig.Builder	newBuilder()

Methods inherited from class org.apache.hudi.common.config.HoodieConfig

clearValue, contains, contains, contains, getBoolean, getBooleanOrDefault, getBooleanOrDefault, getBooleanOrDefault, getDouble, getDoubleOrDefault, getFloat, getFloatOrDefault, getInt, getIntOrDefault, getLong, getLongOrDefault, getProps, getProps, getSplitStrings, getSplitStrings, getString, getString, getStringOrDefault, getStringOrDefault, getStringOrThrow, setAll, setDefault, setDefaultOnCondition, setDefaults, setDefaultValue, setDefaultValue, setValue, setValue

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

INLINE_COMPACT

public static final ConfigProperty<String> INLINE_COMPACT

SCHEDULE_INLINE_COMPACT

public static final ConfigProperty<String> SCHEDULE_INLINE_COMPACT

ENABLE_LOG_COMPACTION

public static final ConfigProperty<String> ENABLE_LOG_COMPACTION

INLINE_LOG_COMPACT

public static final ConfigProperty<String> INLINE_LOG_COMPACT

INLINE_COMPACT_NUM_DELTA_COMMITS

public static final ConfigProperty<String> INLINE_COMPACT_NUM_DELTA_COMMITS

INLINE_COMPACT_TIME_DELTA_SECONDS

public static final ConfigProperty<String> INLINE_COMPACT_TIME_DELTA_SECONDS

INLINE_COMPACT_TRIGGER_STRATEGY

public static final ConfigProperty<String> INLINE_COMPACT_TRIGGER_STRATEGY

PARQUET_SMALL_FILE_LIMIT

public static final ConfigProperty<String> PARQUET_SMALL_FILE_LIMIT

RECORD_SIZE_ESTIMATION_THRESHOLD

public static final ConfigProperty<String> RECORD_SIZE_ESTIMATION_THRESHOLD

TARGET_IO_PER_COMPACTION_IN_MB

public static final ConfigProperty<String> TARGET_IO_PER_COMPACTION_IN_MB

COMPACTION_LOG_FILE_SIZE_THRESHOLD

public static final ConfigProperty<Long> COMPACTION_LOG_FILE_SIZE_THRESHOLD

COMPACTION_LOG_FILE_NUM_THRESHOLD

public static final ConfigProperty<Long> COMPACTION_LOG_FILE_NUM_THRESHOLD

COMPACTION_STRATEGY

public static final ConfigProperty<String> COMPACTION_STRATEGY

TARGET_PARTITIONS_PER_DAYBASED_COMPACTION

public static final ConfigProperty<String> TARGET_PARTITIONS_PER_DAYBASED_COMPACTION

COMPACTION_SPECIFY_PARTITION_PATH_REGEX

public static final ConfigProperty<String> COMPACTION_SPECIFY_PARTITION_PATH_REGEX

COPY_ON_WRITE_INSERT_SPLIT_SIZE

public static final ConfigProperty<String> COPY_ON_WRITE_INSERT_SPLIT_SIZE

Configs related to specific table types.

COPY_ON_WRITE_AUTO_SPLIT_INSERTS

public static final ConfigProperty<String> COPY_ON_WRITE_AUTO_SPLIT_INSERTS

COPY_ON_WRITE_RECORD_SIZE_ESTIMATE

public static final ConfigProperty<String> COPY_ON_WRITE_RECORD_SIZE_ESTIMATE

LOG_COMPACTION_BLOCKS_THRESHOLD

public static final ConfigProperty<String> LOG_COMPACTION_BLOCKS_THRESHOLD

INLINE_COMPACT_PROP

@Deprecated
public static final String INLINE_COMPACT_PROP

Deprecated. Use INLINE_COMPACT and its methods instead

INLINE_COMPACT_NUM_DELTA_COMMITS_PROP

@Deprecated
public static final String INLINE_COMPACT_NUM_DELTA_COMMITS_PROP

Deprecated. Use INLINE_COMPACT_NUM_DELTA_COMMITS and its methods instead

INLINE_COMPACT_TIME_DELTA_SECONDS_PROP

@Deprecated
public static final String INLINE_COMPACT_TIME_DELTA_SECONDS_PROP

Deprecated. Use INLINE_COMPACT_TIME_DELTA_SECONDS and its methods instead

INLINE_COMPACT_TRIGGER_STRATEGY_PROP

@Deprecated
public static final String INLINE_COMPACT_TRIGGER_STRATEGY_PROP

Deprecated. Use INLINE_COMPACT_TRIGGER_STRATEGY and its methods instead

PARQUET_SMALL_FILE_LIMIT_BYTES

@Deprecated
public static final String PARQUET_SMALL_FILE_LIMIT_BYTES

Deprecated. Use PARQUET_SMALL_FILE_LIMIT and its methods instead

DEFAULT_PARQUET_SMALL_FILE_LIMIT_BYTES

@Deprecated
public static final String DEFAULT_PARQUET_SMALL_FILE_LIMIT_BYTES

Deprecated. Use PARQUET_SMALL_FILE_LIMIT and its methods instead

RECORD_SIZE_ESTIMATION_THRESHOLD_PROP

@Deprecated
public static final String RECORD_SIZE_ESTIMATION_THRESHOLD_PROP

Deprecated. Use RECORD_SIZE_ESTIMATION_THRESHOLD and its methods instead

DEFAULT_RECORD_SIZE_ESTIMATION_THRESHOLD

@Deprecated
public static final String DEFAULT_RECORD_SIZE_ESTIMATION_THRESHOLD

Deprecated. Use RECORD_SIZE_ESTIMATION_THRESHOLD and its methods instead

COPY_ON_WRITE_TABLE_INSERT_SPLIT_SIZE

@Deprecated
public static final String COPY_ON_WRITE_TABLE_INSERT_SPLIT_SIZE

Deprecated. Use COPY_ON_WRITE_INSERT_SPLIT_SIZE and its methods instead

DEFAULT_COPY_ON_WRITE_TABLE_INSERT_SPLIT_SIZE

@Deprecated
public static final String DEFAULT_COPY_ON_WRITE_TABLE_INSERT_SPLIT_SIZE

Deprecated. Use COPY_ON_WRITE_INSERT_SPLIT_SIZE and its methods instead

COPY_ON_WRITE_TABLE_AUTO_SPLIT_INSERTS

@Deprecated
public static final String COPY_ON_WRITE_TABLE_AUTO_SPLIT_INSERTS

Deprecated. Use COPY_ON_WRITE_AUTO_SPLIT_INSERTS and its methods instead

DEFAULT_COPY_ON_WRITE_TABLE_AUTO_SPLIT_INSERTS

@Deprecated
public static final String DEFAULT_COPY_ON_WRITE_TABLE_AUTO_SPLIT_INSERTS

Deprecated. Use COPY_ON_WRITE_AUTO_SPLIT_INSERTS and its methods instead

COPY_ON_WRITE_TABLE_RECORD_SIZE_ESTIMATE

@Deprecated
public static final String COPY_ON_WRITE_TABLE_RECORD_SIZE_ESTIMATE

Deprecated. Use COPY_ON_WRITE_RECORD_SIZE_ESTIMATE and its methods instead

DEFAULT_COPY_ON_WRITE_TABLE_RECORD_SIZE_ESTIMATE

@Deprecated
public static final String DEFAULT_COPY_ON_WRITE_TABLE_RECORD_SIZE_ESTIMATE

Deprecated. Use COPY_ON_WRITE_RECORD_SIZE_ESTIMATE and its methods instead

TARGET_IO_PER_COMPACTION_IN_MB_PROP

@Deprecated
public static final String TARGET_IO_PER_COMPACTION_IN_MB_PROP

Deprecated. Use TARGET_IO_PER_COMPACTION_IN_MB and its methods instead

DEFAULT_TARGET_IO_PER_COMPACTION_IN_MB

@Deprecated
public static final String DEFAULT_TARGET_IO_PER_COMPACTION_IN_MB

Deprecated. Use TARGET_IO_PER_COMPACTION_IN_MB and its methods instead

COMPACTION_STRATEGY_PROP

@Deprecated
public static final String COMPACTION_STRATEGY_PROP

Deprecated. Use COMPACTION_STRATEGY and its methods instead

DEFAULT_COMPACTION_STRATEGY

@Deprecated
public static final String DEFAULT_COMPACTION_STRATEGY

Deprecated. Use COMPACTION_STRATEGY and its methods instead

COMPACTION_LAZY_BLOCK_READ_ENABLED_PROP

@Deprecated
public static final String COMPACTION_LAZY_BLOCK_READ_ENABLED_PROP

Deprecated. Use HoodieReaderConfig.COMPACTION_LAZY_BLOCK_READ_ENABLE and its methods instead

DEFAULT_COMPACTION_LAZY_BLOCK_READ_ENABLED

@Deprecated
public static final String DEFAULT_COMPACTION_LAZY_BLOCK_READ_ENABLED

Deprecated. Use HoodieReaderConfig.COMPACTION_LAZY_BLOCK_READ_ENABLE and its methods instead

COMPACTION_REVERSE_LOG_READ_ENABLED_PROP

@Deprecated
public static final String COMPACTION_REVERSE_LOG_READ_ENABLED_PROP

Deprecated. Use HoodieReaderConfig.COMPACTION_REVERSE_LOG_READ_ENABLE and its methods instead

DEFAULT_COMPACTION_REVERSE_LOG_READ_ENABLED

@Deprecated
public static final String DEFAULT_COMPACTION_REVERSE_LOG_READ_ENABLED

Deprecated. Use HoodieReaderConfig.COMPACTION_REVERSE_LOG_READ_ENABLE and its methods instead

TARGET_PARTITIONS_PER_DAYBASED_COMPACTION_PROP

@Deprecated
public static final String TARGET_PARTITIONS_PER_DAYBASED_COMPACTION_PROP

Deprecated. Use TARGET_PARTITIONS_PER_DAYBASED_COMPACTION and its methods instead

DEFAULT_TARGET_PARTITIONS_PER_DAYBASED_COMPACTION

@Deprecated
public static final String DEFAULT_TARGET_PARTITIONS_PER_DAYBASED_COMPACTION

Deprecated. Use TARGET_PARTITIONS_PER_DAYBASED_COMPACTION and its methods instead

Method Detail

newBuilder

public static HoodieCompactionConfig.Builder newBuilder()