org.apache.tajo.storage

Class TablespaceManager

java.lang.Object

org.apache.tajo.storage.TablespaceManager

All Implemented Interfaces:

StorageService

public class TablespaceManager
extends Object
implements StorageService

It handles available table spaces and cache TableSpace instances. Default tablespace must be a filesystem-based one. HDFS and S3 can be a default tablespace if a Tajo cluster is in fully distributed mode. Local file system can be a default tablespace if a Tajo cluster runs on a single machine.

Field Summary

Fields

Modifier and Type	Field and Description
protected static Map<Class<?>,Constructor<?>>	CONSTRUCTORS
static String	DEFAULT_CONFIG_FILE
static String	DEFAULT_TABLESPACE_NAME default tablespace name
static String	KEY_SPACES
static String	KEY_STORAGE_DEFAULT_FORMAT
static String	KEY_STORAGE_HANDLER
static String	KEY_STORAGES
static String	SITE_CONFIG_FILE
protected static Map<String,URI>	SPACES_URIS_MAP
protected static Map<String,Class<? extends Tablespace>>	TABLE_SPACE_HANDLERS
protected static TreeMap<URI,Tablespace>	TABLE_SPACES
static Class[]	TABLESPACE_PARAM
static String	TABLESPACE_SPEC_CONFIGS_KEY

Method Summary

Methods

Modifier and Type	Method and Description
static void	AddTableSpace(String spaceName, URI uri, boolean isDefault, net.minidev.json.JSONObject configs, boolean override)
static com.google.common.base.Optional<Tablespace>	addTableSpaceForTest(Tablespace space)
static <T extends Tablespace> T	get(String uri) Get tablespace for the given URI.
static <T extends Tablespace> T	get(URI uri) Get tablespace for the given URI.
static Iterable<Tablespace>	getAllTablespaces()
static com.google.common.base.Optional<? extends Tablespace>	getAnyByScheme(String scheme)
static <T extends Tablespace> T	getByName(String name)
static <T extends Tablespace> T	getDefault() It returns the default tablespace.
static TablespaceManager	getInstance()
static <T extends Tablespace> T	getLocalFs()
static Collection<MetadataProvider>	getMetadataProviders()
Iterable<String>	getSupportSchemes()
URI	getTableURI(String spaceName, String databaseName, String tableName)
long	getTableVolumn(TableDesc table, com.google.common.base.Optional<EvalNode> filter)
static long	guessFragmentVolume(TajoConf conf, Fragment fragment) Return length of the fragment.
static com.google.common.base.Optional<Tablespace>	removeTablespaceForTest(String name)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_CONFIG_FILE

public static final String DEFAULT_CONFIG_FILE

See Also:

Constant Field Values

SITE_CONFIG_FILE

public static final String SITE_CONFIG_FILE

See Also:

Constant Field Values

DEFAULT_TABLESPACE_NAME

public static final String DEFAULT_TABLESPACE_NAME

default tablespace name

See Also:

Constant Field Values

SPACES_URIS_MAP

protected static final Map<String,URI> SPACES_URIS_MAP

TABLE_SPACES

protected static final TreeMap<URI,Tablespace> TABLE_SPACES

CONSTRUCTORS

protected static final Map<Class<?>,Constructor<?>> CONSTRUCTORS

TABLE_SPACE_HANDLERS

protected static final Map<String,Class<? extends Tablespace>> TABLE_SPACE_HANDLERS

TABLESPACE_PARAM

public static final Class[] TABLESPACE_PARAM

TABLESPACE_SPEC_CONFIGS_KEY

public static final String TABLESPACE_SPEC_CONFIGS_KEY

See Also:

Constant Field Values

KEY_STORAGES

public static final String KEY_STORAGES

See Also:

Constant Field Values

KEY_STORAGE_HANDLER

public static final String KEY_STORAGE_HANDLER

See Also:

Constant Field Values

KEY_STORAGE_DEFAULT_FORMAT

public static final String KEY_STORAGE_DEFAULT_FORMAT

See Also:

Constant Field Values

KEY_SPACES

public static final String KEY_SPACES

See Also:

Constant Field Values

Method Detail

getInstance

public static TablespaceManager getInstance()

AddTableSpace

public static void AddTableSpace(String spaceName,
                 URI uri,
                 boolean isDefault,
                 net.minidev.json.JSONObject configs,
                 boolean override)

guessFragmentVolume

public static long guessFragmentVolume(TajoConf conf,
                       Fragment fragment)

Return length of the fragment. In the UNKNOWN_LENGTH case get FRAGMENT_ALTERNATIVE_UNKNOWN_LENGTH from the configuration.

Parameters:

conf - Tajo system property

fragment - Fragment

Returns:

addTableSpaceForTest

public static com.google.common.base.Optional<Tablespace> addTableSpaceForTest(Tablespace space)

removeTablespaceForTest

public static com.google.common.base.Optional<Tablespace> removeTablespaceForTest(String name)

getSupportSchemes

public Iterable<String> getSupportSchemes()

get

public static <T extends Tablespace> T get(@Nullable
                           String uri)

Get tablespace for the given URI. If uri is null, the default tablespace will be returned

Type Parameters:

T - Tablespace class type

Parameters:

uri - Table or Table Fragment URI.

Returns:

Tablespace. If uri is null, the default tablespace will be returned.

get

public static <T extends Tablespace> T get(@Nullable
                           URI uri)

Get tablespace for the given URI. If uri is null, the default tablespace will be returned

Type Parameters:

T - Tablespace class type

Parameters:

uri - Table or Table Fragment URI.

Returns:

Tablespace. If uri is null, the default tablespace will be returned.

getDefault

public static <T extends Tablespace> T getDefault()

It returns the default tablespace. This method ensures that it always return the tablespace.

Returns:

getLocalFs

public static <T extends Tablespace> T getLocalFs()

getByName

public static <T extends Tablespace> T getByName(String name)

getAnyByScheme

public static com.google.common.base.Optional<? extends Tablespace> getAnyByScheme(String scheme)

getTableURI

public URI getTableURI(@Nullable
              String spaceName,
              String databaseName,
              String tableName)

Specified by:

getTableURI in interface StorageService

getTableVolumn

public long getTableVolumn(TableDesc table,
                  com.google.common.base.Optional<EvalNode> filter)
                    throws UnsupportedException

Specified by:

getTableVolumn in interface StorageService

Throws:

UnsupportedException

getAllTablespaces

public static Iterable<Tablespace> getAllTablespaces()

getMetadataProviders

public static Collection<MetadataProvider> getMetadataProviders()