org.apache.hudi.common.config

Class HoodieMemoryConfig

java.lang.Object

org.apache.hudi.common.config.HoodieConfig

org.apache.hudi.common.config.HoodieMemoryConfig

All Implemented Interfaces:

Serializable

@Immutable
public class HoodieMemoryConfig
extends HoodieConfig

Memory related config.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HoodieMemoryConfig.Builder

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULT_MAX_DFS_STREAM_BUFFER_SIZE Deprecated. Use MAX_DFS_STREAM_BUFFER_SIZE and its methods instead
static long	DEFAULT_MAX_MEMORY_FOR_SPILLABLE_MAP_IN_BYTES
static String	DEFAULT_MAX_MEMORY_FRACTION_FOR_COMPACTION Deprecated. Use MAX_MEMORY_FRACTION_FOR_COMPACTION and its methods instead
static String	DEFAULT_MAX_MEMORY_FRACTION_FOR_MERGE Deprecated. Use MAX_MEMORY_FRACTION_FOR_MERGE and its methods instead
static long	DEFAULT_MIN_MEMORY_FOR_SPILLABLE_MAP_IN_BYTES
static String	DEFAULT_MR_COMPACTION_MEMORY_FRACTION
static int	DEFAULT_MR_MAX_DFS_STREAM_BUFFER_SIZE
static String	DEFAULT_SPILLABLE_MAP_BASE_PATH Deprecated. Use getDefaultSpillableMapBasePath() instead
static double	DEFAULT_WRITESTATUS_FAILURE_FRACTION Deprecated. Use WRITESTATUS_FAILURE_FRACTION and its methods instead
static ConfigProperty<Integer>	MAX_DFS_STREAM_BUFFER_SIZE
static String	MAX_DFS_STREAM_BUFFER_SIZE_PROP Deprecated. Use MAX_DFS_STREAM_BUFFER_SIZE and its methods instead
static ConfigProperty<String>	MAX_MEMORY_FOR_COMPACTION
static String	MAX_MEMORY_FOR_COMPACTION_PROP Deprecated. Use MAX_MEMORY_FOR_COMPACTION and its methods instead
static ConfigProperty<Long>	MAX_MEMORY_FOR_MERGE
static String	MAX_MEMORY_FOR_MERGE_PROP Deprecated. Use MAX_MEMORY_FOR_MERGE and its methods instead
static ConfigProperty<String>	MAX_MEMORY_FRACTION_FOR_COMPACTION
static String	MAX_MEMORY_FRACTION_FOR_COMPACTION_PROP Deprecated. Use MAX_MEMORY_FRACTION_FOR_COMPACTION and its methods instead
static ConfigProperty<String>	MAX_MEMORY_FRACTION_FOR_MERGE
static String	MAX_MEMORY_FRACTION_FOR_MERGE_PROP Deprecated. Use MAX_MEMORY_FRACTION_FOR_MERGE and its methods instead
static ConfigProperty<String>	SPILLABLE_MAP_BASE_PATH
static String	SPILLABLE_MAP_BASE_PATH_PROP Deprecated. Use SPILLABLE_MAP_BASE_PATH and its methods instead
static ConfigProperty<Double>	WRITESTATUS_FAILURE_FRACTION
static String	WRITESTATUS_FAILURE_FRACTION_PROP Deprecated. Use WRITESTATUS_FAILURE_FRACTION and its methods instead

Fields inherited from class org.apache.hudi.common.config.HoodieConfig

CONFIG_VALUES_DELIMITER, MAX_READ_RETRIES, props, READ_RETRY_DELAY_MSEC

Method Summary

Modifier and Type	Method and Description
static HoodieMemoryConfig.Builder	newBuilder()

Methods inherited from class org.apache.hudi.common.config.HoodieConfig

contains, contains, getBoolean, getBooleanOrDefault, getBooleanOrDefault, getBooleanOrDefault, getDouble, getDoubleOrDefault, getFloat, getFloatOrDefault, getInt, getIntOrDefault, getLong, getLongOrDefault, getProps, getProps, getSplitStrings, getSplitStrings, getString, getString, getStringOrDefault, getStringOrDefault, getStringOrThrow, setAll, setDefault, setDefaultOnCondition, setDefaults, setDefaultValue, setDefaultValue, setValue, setValue

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MAX_MEMORY_FRACTION_FOR_MERGE

public static final ConfigProperty<String> MAX_MEMORY_FRACTION_FOR_MERGE

MAX_MEMORY_FRACTION_FOR_COMPACTION

public static final ConfigProperty<String> MAX_MEMORY_FRACTION_FOR_COMPACTION

DEFAULT_MR_COMPACTION_MEMORY_FRACTION

public static final String DEFAULT_MR_COMPACTION_MEMORY_FRACTION

See Also:

Constant Field Values

DEFAULT_MAX_MEMORY_FOR_SPILLABLE_MAP_IN_BYTES

public static final long DEFAULT_MAX_MEMORY_FOR_SPILLABLE_MAP_IN_BYTES

See Also:

Constant Field Values

DEFAULT_MIN_MEMORY_FOR_SPILLABLE_MAP_IN_BYTES

public static final long DEFAULT_MIN_MEMORY_FOR_SPILLABLE_MAP_IN_BYTES

See Also:

Constant Field Values

MAX_MEMORY_FOR_MERGE

public static final ConfigProperty<Long> MAX_MEMORY_FOR_MERGE

MAX_MEMORY_FOR_COMPACTION

public static final ConfigProperty<String> MAX_MEMORY_FOR_COMPACTION

MAX_DFS_STREAM_BUFFER_SIZE

public static final ConfigProperty<Integer> MAX_DFS_STREAM_BUFFER_SIZE

DEFAULT_MR_MAX_DFS_STREAM_BUFFER_SIZE

public static final int DEFAULT_MR_MAX_DFS_STREAM_BUFFER_SIZE

See Also:

Constant Field Values

SPILLABLE_MAP_BASE_PATH

public static final ConfigProperty<String> SPILLABLE_MAP_BASE_PATH

WRITESTATUS_FAILURE_FRACTION

public static final ConfigProperty<Double> WRITESTATUS_FAILURE_FRACTION

MAX_MEMORY_FRACTION_FOR_MERGE_PROP

@Deprecated
public static final String MAX_MEMORY_FRACTION_FOR_MERGE_PROP

Deprecated. Use MAX_MEMORY_FRACTION_FOR_MERGE and its methods instead

DEFAULT_MAX_MEMORY_FRACTION_FOR_MERGE

@Deprecated
public static final String DEFAULT_MAX_MEMORY_FRACTION_FOR_MERGE

Deprecated. Use MAX_MEMORY_FRACTION_FOR_MERGE and its methods instead

MAX_MEMORY_FRACTION_FOR_COMPACTION_PROP

@Deprecated
public static final String MAX_MEMORY_FRACTION_FOR_COMPACTION_PROP

Deprecated. Use MAX_MEMORY_FRACTION_FOR_COMPACTION and its methods instead

DEFAULT_MAX_MEMORY_FRACTION_FOR_COMPACTION

@Deprecated
public static final String DEFAULT_MAX_MEMORY_FRACTION_FOR_COMPACTION

Deprecated. Use MAX_MEMORY_FRACTION_FOR_COMPACTION and its methods instead

MAX_MEMORY_FOR_MERGE_PROP

@Deprecated
public static final String MAX_MEMORY_FOR_MERGE_PROP

Deprecated. Use MAX_MEMORY_FOR_MERGE and its methods instead

MAX_MEMORY_FOR_COMPACTION_PROP

@Deprecated
public static final String MAX_MEMORY_FOR_COMPACTION_PROP

Deprecated. Use MAX_MEMORY_FOR_COMPACTION and its methods instead

MAX_DFS_STREAM_BUFFER_SIZE_PROP

@Deprecated
public static final String MAX_DFS_STREAM_BUFFER_SIZE_PROP

Deprecated. Use MAX_DFS_STREAM_BUFFER_SIZE and its methods instead

DEFAULT_MAX_DFS_STREAM_BUFFER_SIZE

@Deprecated
public static final int DEFAULT_MAX_DFS_STREAM_BUFFER_SIZE

Deprecated. Use MAX_DFS_STREAM_BUFFER_SIZE and its methods instead

SPILLABLE_MAP_BASE_PATH_PROP

@Deprecated
public static final String SPILLABLE_MAP_BASE_PATH_PROP

Deprecated. Use SPILLABLE_MAP_BASE_PATH and its methods instead

DEFAULT_SPILLABLE_MAP_BASE_PATH

@Deprecated
public static final String DEFAULT_SPILLABLE_MAP_BASE_PATH

Deprecated. Use getDefaultSpillableMapBasePath() instead

WRITESTATUS_FAILURE_FRACTION_PROP

@Deprecated
public static final String WRITESTATUS_FAILURE_FRACTION_PROP

Deprecated. Use WRITESTATUS_FAILURE_FRACTION and its methods instead

DEFAULT_WRITESTATUS_FAILURE_FRACTION

@Deprecated
public static final double DEFAULT_WRITESTATUS_FAILURE_FRACTION

Deprecated. Use WRITESTATUS_FAILURE_FRACTION and its methods instead

Method Detail

newBuilder

public static HoodieMemoryConfig.Builder newBuilder()