org.apache.hadoop.tools.dynamometer

Class DynoInfraUtils

java.lang.Object

org.apache.hadoop.tools.dynamometer.DynoInfraUtils

@InterfaceAudience.Private
 @InterfaceStability.Unstable
public final class DynoInfraUtils
extends Object

A collection of utilities used by the Dynamometer infrastructure application.

Field Summary

Fields

Modifier and Type	Field and Description
static String	APACHE_DOWNLOAD_MIRROR_DEFAULT
static String	APACHE_DOWNLOAD_MIRROR_KEY
static float	DATANODE_LIVE_MIN_FRACTION_DEFAULT
static String	DATANODE_LIVE_MIN_FRACTION_KEY
static String	DYNO_CONF_PREFIX
static String	DYNO_INFRA_PREFIX
static String	FSNAMESYSTEM_JMX_QUERY
static String	FSNAMESYSTEM_STATE_JMX_QUERY
static String	HADOOP_TAR_FILENAME_FORMAT
static String	JMX_BLOCKS_TOTAL
static String	JMX_LIVE_NODE_COUNT
static String	JMX_LIVE_NODES_LIST
static String	JMX_MISSING_BLOCKS
static String	JMX_UNDER_REPLICATED_BLOCKS
static float	MISSING_BLOCKS_MAX_FRACTION_DEFAULT
static String	MISSING_BLOCKS_MAX_FRACTION_KEY
static String	NAMENODE_INFO_JMX_QUERY
static String	NAMENODE_STARTUP_PROGRESS_JMX_QUERY
static float	UNDERREPLICATED_BLOCKS_MAX_FRACTION_DEFAULT
static String	UNDERREPLICATED_BLOCKS_MAX_FRACTION_KEY

Method Summary

Modifier and Type	Method and Description
static File	fetchHadoopTarball(File destinationDir, String version, org.apache.hadoop.conf.Configuration conf, org.slf4j.Logger log) If a file matching "hadoop-%s.tar.gz" and version is found in destinationDir, return its path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DYNO_CONF_PREFIX

public static final String DYNO_CONF_PREFIX

See Also:

Constant Field Values

DYNO_INFRA_PREFIX

public static final String DYNO_INFRA_PREFIX

See Also:

Constant Field Values

APACHE_DOWNLOAD_MIRROR_KEY

public static final String APACHE_DOWNLOAD_MIRROR_KEY

See Also:

Constant Field Values

APACHE_DOWNLOAD_MIRROR_DEFAULT

public static final String APACHE_DOWNLOAD_MIRROR_DEFAULT

See Also:

Constant Field Values

HADOOP_TAR_FILENAME_FORMAT

public static final String HADOOP_TAR_FILENAME_FORMAT

See Also:

Constant Field Values

DATANODE_LIVE_MIN_FRACTION_KEY

public static final String DATANODE_LIVE_MIN_FRACTION_KEY

See Also:

Constant Field Values

DATANODE_LIVE_MIN_FRACTION_DEFAULT

public static final float DATANODE_LIVE_MIN_FRACTION_DEFAULT

See Also:

Constant Field Values

MISSING_BLOCKS_MAX_FRACTION_KEY

public static final String MISSING_BLOCKS_MAX_FRACTION_KEY

See Also:

Constant Field Values

MISSING_BLOCKS_MAX_FRACTION_DEFAULT

public static final float MISSING_BLOCKS_MAX_FRACTION_DEFAULT

See Also:

Constant Field Values

UNDERREPLICATED_BLOCKS_MAX_FRACTION_KEY

public static final String UNDERREPLICATED_BLOCKS_MAX_FRACTION_KEY

See Also:

Constant Field Values

UNDERREPLICATED_BLOCKS_MAX_FRACTION_DEFAULT

public static final float UNDERREPLICATED_BLOCKS_MAX_FRACTION_DEFAULT

See Also:

Constant Field Values

NAMENODE_STARTUP_PROGRESS_JMX_QUERY

public static final String NAMENODE_STARTUP_PROGRESS_JMX_QUERY

See Also:

Constant Field Values

FSNAMESYSTEM_JMX_QUERY

public static final String FSNAMESYSTEM_JMX_QUERY

See Also:

Constant Field Values

FSNAMESYSTEM_STATE_JMX_QUERY

public static final String FSNAMESYSTEM_STATE_JMX_QUERY

See Also:

Constant Field Values

NAMENODE_INFO_JMX_QUERY

public static final String NAMENODE_INFO_JMX_QUERY

See Also:

Constant Field Values

JMX_MISSING_BLOCKS

public static final String JMX_MISSING_BLOCKS

See Also:

Constant Field Values

JMX_UNDER_REPLICATED_BLOCKS

public static final String JMX_UNDER_REPLICATED_BLOCKS

See Also:

Constant Field Values

JMX_BLOCKS_TOTAL

public static final String JMX_BLOCKS_TOTAL

See Also:

Constant Field Values

JMX_LIVE_NODE_COUNT

public static final String JMX_LIVE_NODE_COUNT

See Also:

Constant Field Values

JMX_LIVE_NODES_LIST

public static final String JMX_LIVE_NODES_LIST

See Also:

Constant Field Values

Method Detail

fetchHadoopTarball

public static File fetchHadoopTarball(File destinationDir,
                                      String version,
                                      org.apache.hadoop.conf.Configuration conf,
                                      org.slf4j.Logger log)
                               throws IOException

If a file matching "hadoop-%s.tar.gz" and version is found in destinationDir, return its path. Otherwise, first download the tarball from an Apache mirror. If the "dyno.apache-mirror" configuration or system property (checked in that order) is set, use that as the mirror; else use "http://mirrors.ocf.berkeley.edu/apache/".

Parameters:

destinationDir - destination directory to save a tarball

version - The version of Hadoop to download, like "2.7.4" or "3.0.0-beta1"

conf - configuration

log - logger instance

Returns:

The path to the tarball.

Throws:

IOException - on failure