org.apache.hudi.common.config

Class HoodieStorageConfig

java.lang.Object

org.apache.hudi.common.config.HoodieConfig

org.apache.hudi.common.config.HoodieStorageConfig

All Implemented Interfaces:

Serializable

@Immutable
public class HoodieStorageConfig
extends HoodieConfig

Storage related config.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HoodieStorageConfig.Builder

Field Summary

Fields

Modifier and Type	Field and Description
static ConfigProperty<String>	BLOOM_FILTER_DYNAMIC_MAX_ENTRIES
static ConfigProperty<String>	BLOOM_FILTER_FPP_VALUE
static ConfigProperty<String>	BLOOM_FILTER_NUM_ENTRIES_VALUE
static ConfigProperty<String>	BLOOM_FILTER_TYPE
static String	DEFAULT_HFILE_BLOCK_SIZE_BYTES Deprecated. Use HFILE_BLOCK_SIZE and its methods instead
static String	DEFAULT_HFILE_COMPRESSION_ALGORITHM Deprecated. Use HFILE_COMPRESSION_ALGORITHM_NAME and its methods instead
static String	DEFAULT_HFILE_FILE_MAX_BYTES Deprecated. Use HFILE_MAX_FILE_SIZE and its methods instead
static String	DEFAULT_LOGFILE_DATA_BLOCK_SIZE_MAX_BYTES Deprecated. Use LOGFILE_DATA_BLOCK_MAX_SIZE and its methods instead
static String	DEFAULT_LOGFILE_SIZE_MAX_BYTES Deprecated. Use LOGFILE_MAX_SIZE and its methods instead
static String	DEFAULT_LOGFILE_TO_PARQUET_COMPRESSION_RATIO Deprecated. Use LOGFILE_TO_PARQUET_COMPRESSION_RATIO_FRACTION and its methods instead
static String	DEFAULT_PARQUET_BLOCK_SIZE_BYTES Deprecated. Use PARQUET_BLOCK_SIZE and its methods instead
static String	DEFAULT_PARQUET_COMPRESSION_CODEC Deprecated. Use PARQUET_COMPRESSION_CODEC_NAME and its methods instead
static String	DEFAULT_PARQUET_FILE_MAX_BYTES Deprecated. Use PARQUET_MAX_FILE_SIZE and its methods instead
static String	DEFAULT_PARQUET_PAGE_SIZE_BYTES Deprecated. Use PARQUET_PAGE_SIZE and its methods instead
static String	DEFAULT_STREAM_COMPRESSION_RATIO Deprecated. Use PARQUET_COMPRESSION_RATIO_FRACTION and its methods instead
static ConfigProperty<String>	HFILE_BLOCK_SIZE
static String	HFILE_BLOCK_SIZE_BYTES Deprecated. Use HFILE_BLOCK_SIZE and its methods instead
static String	HFILE_COMPRESSION_ALGORITHM Deprecated. Use HFILE_COMPRESSION_ALGORITHM_NAME and its methods instead
static ConfigProperty<String>	HFILE_COMPRESSION_ALGORITHM_NAME
static String	HFILE_FILE_MAX_BYTES Deprecated. Use HFILE_MAX_FILE_SIZE and its methods instead
static ConfigProperty<String>	HFILE_MAX_FILE_SIZE
static ConfigProperty<String>	HOODIE_AVRO_WRITE_SUPPORT_CLASS
static ConfigProperty<String>	HOODIE_IO_FACTORY_CLASS
static ConfigProperty<String>	HOODIE_PARQUET_SPARK_ROW_WRITE_SUPPORT_CLASS
static ConfigProperty<String>	HOODIE_STORAGE_CLASS
static ConfigProperty<String>	LOGFILE_DATA_BLOCK_FORMAT
static ConfigProperty<String>	LOGFILE_DATA_BLOCK_MAX_SIZE
static String	LOGFILE_DATA_BLOCK_SIZE_MAX_BYTES Deprecated. Use LOGFILE_DATA_BLOCK_MAX_SIZE and its methods instead
static ConfigProperty<String>	LOGFILE_MAX_SIZE
static String	LOGFILE_SIZE_MAX_BYTES Deprecated. Use LOGFILE_MAX_SIZE and its methods instead
static String	LOGFILE_TO_PARQUET_COMPRESSION_RATIO Deprecated. Use LOGFILE_TO_PARQUET_COMPRESSION_RATIO_FRACTION and its methods instead
static ConfigProperty<String>	LOGFILE_TO_PARQUET_COMPRESSION_RATIO_FRACTION
static ConfigProperty<String>	ORC_BLOCK_SIZE
static ConfigProperty<String>	ORC_COMPRESSION_CODEC_NAME
static ConfigProperty<String>	ORC_FILE_MAX_SIZE
static ConfigProperty<String>	ORC_STRIPE_SIZE
static ConfigProperty<String>	PARQUET_BLOCK_SIZE
static String	PARQUET_BLOCK_SIZE_BYTES Deprecated. Use PARQUET_BLOCK_SIZE and its methods instead
static String	PARQUET_COMPRESSION_CODEC Deprecated. Use PARQUET_COMPRESSION_CODEC_NAME and its methods instead
static ConfigProperty<String>	PARQUET_COMPRESSION_CODEC_NAME
static String	PARQUET_COMPRESSION_RATIO Deprecated. Use PARQUET_COMPRESSION_RATIO_FRACTION and its methods instead
static ConfigProperty<String>	PARQUET_COMPRESSION_RATIO_FRACTION
static ConfigProperty<Boolean>	PARQUET_DICTIONARY_ENABLED
static ConfigProperty<String>	PARQUET_FIELD_ID_WRITE_ENABLED
static String	PARQUET_FILE_MAX_BYTES Deprecated. Use PARQUET_MAX_FILE_SIZE and its methods instead
static ConfigProperty<String>	PARQUET_MAX_FILE_SIZE
static ConfigProperty<String>	PARQUET_OUTPUT_TIMESTAMP_TYPE
static ConfigProperty<String>	PARQUET_PAGE_SIZE
static String	PARQUET_PAGE_SIZE_BYTES Deprecated. Use PARQUET_PAGE_SIZE and its methods instead
static ConfigProperty<Boolean>	PARQUET_WITH_BLOOM_FILTER_ENABLED
static ConfigProperty<String>	PARQUET_WRITE_LEGACY_FORMAT_ENABLED

Fields inherited from class org.apache.hudi.common.config.HoodieConfig

CONFIG_VALUES_DELIMITER, MAX_READ_RETRIES, props, READ_RETRY_DELAY_MSEC

Method Summary

Modifier and Type	Method and Description
static HoodieStorageConfig.Builder	newBuilder()

Methods inherited from class org.apache.hudi.common.config.HoodieConfig

contains, contains, getBoolean, getBooleanOrDefault, getBooleanOrDefault, getBooleanOrDefault, getDouble, getDoubleOrDefault, getFloat, getFloatOrDefault, getInt, getIntOrDefault, getLong, getLongOrDefault, getProps, getProps, getSplitStrings, getSplitStrings, getString, getString, getStringOrDefault, getStringOrDefault, getStringOrThrow, setAll, setDefault, setDefaultOnCondition, setDefaults, setDefaultValue, setDefaultValue, setValue, setValue

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PARQUET_MAX_FILE_SIZE

public static final ConfigProperty<String> PARQUET_MAX_FILE_SIZE

PARQUET_BLOCK_SIZE

public static final ConfigProperty<String> PARQUET_BLOCK_SIZE

PARQUET_PAGE_SIZE

public static final ConfigProperty<String> PARQUET_PAGE_SIZE

ORC_FILE_MAX_SIZE

public static final ConfigProperty<String> ORC_FILE_MAX_SIZE

ORC_STRIPE_SIZE

public static final ConfigProperty<String> ORC_STRIPE_SIZE

ORC_BLOCK_SIZE

public static final ConfigProperty<String> ORC_BLOCK_SIZE

HFILE_MAX_FILE_SIZE

public static final ConfigProperty<String> HFILE_MAX_FILE_SIZE

HFILE_BLOCK_SIZE

public static final ConfigProperty<String> HFILE_BLOCK_SIZE

LOGFILE_DATA_BLOCK_FORMAT

public static final ConfigProperty<String> LOGFILE_DATA_BLOCK_FORMAT

LOGFILE_MAX_SIZE

public static final ConfigProperty<String> LOGFILE_MAX_SIZE

LOGFILE_DATA_BLOCK_MAX_SIZE

public static final ConfigProperty<String> LOGFILE_DATA_BLOCK_MAX_SIZE

PARQUET_COMPRESSION_RATIO_FRACTION

public static final ConfigProperty<String> PARQUET_COMPRESSION_RATIO_FRACTION

PARQUET_COMPRESSION_CODEC_NAME

public static final ConfigProperty<String> PARQUET_COMPRESSION_CODEC_NAME

PARQUET_DICTIONARY_ENABLED

public static final ConfigProperty<Boolean> PARQUET_DICTIONARY_ENABLED

PARQUET_WRITE_LEGACY_FORMAT_ENABLED

public static final ConfigProperty<String> PARQUET_WRITE_LEGACY_FORMAT_ENABLED

PARQUET_OUTPUT_TIMESTAMP_TYPE

public static final ConfigProperty<String> PARQUET_OUTPUT_TIMESTAMP_TYPE

PARQUET_FIELD_ID_WRITE_ENABLED

public static final ConfigProperty<String> PARQUET_FIELD_ID_WRITE_ENABLED

PARQUET_WITH_BLOOM_FILTER_ENABLED

public static final ConfigProperty<Boolean> PARQUET_WITH_BLOOM_FILTER_ENABLED

HFILE_COMPRESSION_ALGORITHM_NAME

public static final ConfigProperty<String> HFILE_COMPRESSION_ALGORITHM_NAME

ORC_COMPRESSION_CODEC_NAME

public static final ConfigProperty<String> ORC_COMPRESSION_CODEC_NAME

LOGFILE_TO_PARQUET_COMPRESSION_RATIO_FRACTION

public static final ConfigProperty<String> LOGFILE_TO_PARQUET_COMPRESSION_RATIO_FRACTION

BLOOM_FILTER_TYPE

public static final ConfigProperty<String> BLOOM_FILTER_TYPE

BLOOM_FILTER_NUM_ENTRIES_VALUE

public static final ConfigProperty<String> BLOOM_FILTER_NUM_ENTRIES_VALUE

BLOOM_FILTER_FPP_VALUE

public static final ConfigProperty<String> BLOOM_FILTER_FPP_VALUE

BLOOM_FILTER_DYNAMIC_MAX_ENTRIES

public static final ConfigProperty<String> BLOOM_FILTER_DYNAMIC_MAX_ENTRIES

HOODIE_AVRO_WRITE_SUPPORT_CLASS

public static final ConfigProperty<String> HOODIE_AVRO_WRITE_SUPPORT_CLASS

HOODIE_PARQUET_SPARK_ROW_WRITE_SUPPORT_CLASS

public static final ConfigProperty<String> HOODIE_PARQUET_SPARK_ROW_WRITE_SUPPORT_CLASS

HOODIE_STORAGE_CLASS

public static final ConfigProperty<String> HOODIE_STORAGE_CLASS

HOODIE_IO_FACTORY_CLASS

public static final ConfigProperty<String> HOODIE_IO_FACTORY_CLASS

PARQUET_FILE_MAX_BYTES

@Deprecated
public static final String PARQUET_FILE_MAX_BYTES

Deprecated. Use PARQUET_MAX_FILE_SIZE and its methods instead

DEFAULT_PARQUET_FILE_MAX_BYTES

@Deprecated
public static final String DEFAULT_PARQUET_FILE_MAX_BYTES

Deprecated. Use PARQUET_MAX_FILE_SIZE and its methods instead

PARQUET_BLOCK_SIZE_BYTES

@Deprecated
public static final String PARQUET_BLOCK_SIZE_BYTES

Deprecated. Use PARQUET_BLOCK_SIZE and its methods instead

DEFAULT_PARQUET_BLOCK_SIZE_BYTES

@Deprecated
public static final String DEFAULT_PARQUET_BLOCK_SIZE_BYTES

Deprecated. Use PARQUET_BLOCK_SIZE and its methods instead

PARQUET_PAGE_SIZE_BYTES

@Deprecated
public static final String PARQUET_PAGE_SIZE_BYTES

Deprecated. Use PARQUET_PAGE_SIZE and its methods instead

DEFAULT_PARQUET_PAGE_SIZE_BYTES

@Deprecated
public static final String DEFAULT_PARQUET_PAGE_SIZE_BYTES

Deprecated. Use PARQUET_PAGE_SIZE and its methods instead

HFILE_FILE_MAX_BYTES

@Deprecated
public static final String HFILE_FILE_MAX_BYTES

Deprecated. Use HFILE_MAX_FILE_SIZE and its methods instead

DEFAULT_HFILE_FILE_MAX_BYTES

@Deprecated
public static final String DEFAULT_HFILE_FILE_MAX_BYTES

Deprecated. Use HFILE_MAX_FILE_SIZE and its methods instead

HFILE_BLOCK_SIZE_BYTES

@Deprecated
public static final String HFILE_BLOCK_SIZE_BYTES

Deprecated. Use HFILE_BLOCK_SIZE and its methods instead

DEFAULT_HFILE_BLOCK_SIZE_BYTES

@Deprecated
public static final String DEFAULT_HFILE_BLOCK_SIZE_BYTES

Deprecated. Use HFILE_BLOCK_SIZE and its methods instead

LOGFILE_SIZE_MAX_BYTES

@Deprecated
public static final String LOGFILE_SIZE_MAX_BYTES

Deprecated. Use LOGFILE_MAX_SIZE and its methods instead

DEFAULT_LOGFILE_SIZE_MAX_BYTES

@Deprecated
public static final String DEFAULT_LOGFILE_SIZE_MAX_BYTES

Deprecated. Use LOGFILE_MAX_SIZE and its methods instead

LOGFILE_DATA_BLOCK_SIZE_MAX_BYTES

@Deprecated
public static final String LOGFILE_DATA_BLOCK_SIZE_MAX_BYTES

Deprecated. Use LOGFILE_DATA_BLOCK_MAX_SIZE and its methods instead

DEFAULT_LOGFILE_DATA_BLOCK_SIZE_MAX_BYTES

@Deprecated
public static final String DEFAULT_LOGFILE_DATA_BLOCK_SIZE_MAX_BYTES

Deprecated. Use LOGFILE_DATA_BLOCK_MAX_SIZE and its methods instead

PARQUET_COMPRESSION_RATIO

@Deprecated
public static final String PARQUET_COMPRESSION_RATIO

Deprecated. Use PARQUET_COMPRESSION_RATIO_FRACTION and its methods instead

DEFAULT_STREAM_COMPRESSION_RATIO

@Deprecated
public static final String DEFAULT_STREAM_COMPRESSION_RATIO

Deprecated. Use PARQUET_COMPRESSION_RATIO_FRACTION and its methods instead

PARQUET_COMPRESSION_CODEC

@Deprecated
public static final String PARQUET_COMPRESSION_CODEC

Deprecated. Use PARQUET_COMPRESSION_CODEC_NAME and its methods instead

HFILE_COMPRESSION_ALGORITHM

@Deprecated
public static final String HFILE_COMPRESSION_ALGORITHM

Deprecated. Use HFILE_COMPRESSION_ALGORITHM_NAME and its methods instead

DEFAULT_PARQUET_COMPRESSION_CODEC

@Deprecated
public static final String DEFAULT_PARQUET_COMPRESSION_CODEC

Deprecated. Use PARQUET_COMPRESSION_CODEC_NAME and its methods instead

DEFAULT_HFILE_COMPRESSION_ALGORITHM

@Deprecated
public static final String DEFAULT_HFILE_COMPRESSION_ALGORITHM

Deprecated. Use HFILE_COMPRESSION_ALGORITHM_NAME and its methods instead

LOGFILE_TO_PARQUET_COMPRESSION_RATIO

@Deprecated
public static final String LOGFILE_TO_PARQUET_COMPRESSION_RATIO

Deprecated. Use LOGFILE_TO_PARQUET_COMPRESSION_RATIO_FRACTION and its methods instead

DEFAULT_LOGFILE_TO_PARQUET_COMPRESSION_RATIO

@Deprecated
public static final String DEFAULT_LOGFILE_TO_PARQUET_COMPRESSION_RATIO

Deprecated. Use LOGFILE_TO_PARQUET_COMPRESSION_RATIO_FRACTION and its methods instead

Method Detail

newBuilder

public static HoodieStorageConfig.Builder newBuilder()