org.apache.drill.exec.store.dfs

Class WorkspaceSchemaFactory.WorkspaceSchema

java.lang.Object

org.apache.drill.exec.store.AbstractSchema

org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory.WorkspaceSchema

All Implemented Interfaces:

AutoCloseable, org.apache.calcite.schema.Schema, ExpandingConcurrentMap.MapValueFactory<org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory.TableInstance,DrillTable>, SchemaPartitionExplorer

Enclosing class:

WorkspaceSchemaFactory

public class WorkspaceSchemaFactory.WorkspaceSchema
extends AbstractSchema
implements ExpandingConcurrentMap.MapValueFactory<org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory.TableInstance,DrillTable>

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.calcite.schema.Schema

org.apache.calcite.schema.Schema.TableType

Field Summary

Fields inherited from class org.apache.drill.exec.store.AbstractSchema

name, schemaPath

Constructor Summary

Constructors

Constructor and Description
WorkspaceSchemaFactory.WorkspaceSchema(List<String> parentSchemaPath, String wsName, SchemaConfig schemaConfig, DrillFileSystem fs)

Method Summary

Methods

Modifier and Type	Method and Description
DrillTable	create(org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory.TableInstance key)
CreateTableEntry	createNewTable(String tableName, List<String> partitionColumns, StorageStrategy storageStrategy) Creates table entry using table name, list of partition columns and storage strategy used to create table folder and files
boolean	createView(View view) Create a new view given definition.
void	destroy(DrillTable value)
void	dropTable(String table) We check if the table contains homogeneous file formats that Drill can read.
void	dropView(String viewName) Drop the view with given name.
String	getDefaultLocation()
DrillFileSystem	getFS()
Set<String>	getFunctionNames()
List<org.apache.calcite.schema.Function>	getFunctions(String name)
Iterable<String>	getSubPartitions(String table, List<String> partitionColumns, List<String> partitionValues) Get a list of sub-partitions of a particular table and the partitions specified by partition columns and values.
org.apache.calcite.schema.Table	getTable(String tableName)
Set<String>	getTableNames()
List<org.apache.commons.lang3.tuple.Pair<String,org.apache.calcite.schema.Schema.TableType>>	getTableNamesAndTypes(boolean bulkLoad, int bulkSize)
String	getTypeName()
boolean	isMutable()

Methods inherited from class org.apache.drill.exec.store.AbstractSchema

close, contentsHaveChangedSince, createNewTable, getDefaultSchema, getExpression, getFullSchemaName, getName, getSchemaPath, getSubSchema, getSubSchemaNames, getTablesByNames, getTablesByNamesByBulkLoad, showInInformationSchema

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WorkspaceSchemaFactory.WorkspaceSchema

public WorkspaceSchemaFactory.WorkspaceSchema(List<String> parentSchemaPath,
                                      String wsName,
                                      SchemaConfig schemaConfig,
                                      DrillFileSystem fs)
                                       throws IOException

Throws:

IOException

Method Detail

createView

public boolean createView(View view)
                   throws IOException

Description copied from class: AbstractSchema

Create a new view given definition.

Overrides:

createView in class AbstractSchema

Parameters:

view - View info including name, definition etc.

Returns:

Returns true if an existing view is replaced with the given view. False otherwise.

Throws:

IOException

getSubPartitions

public Iterable<String> getSubPartitions(String table,
                                List<String> partitionColumns,
                                List<String> partitionValues)
                                  throws PartitionNotFoundException

Description copied from interface: SchemaPartitionExplorer

Get a list of sub-partitions of a particular table and the partitions specified by partition columns and values. Individual storage plugins will assign specific meaning to the parameters and return values. For more info see docs in PartitionExplorer.

Specified by:

getSubPartitions in interface SchemaPartitionExplorer

Overrides:

getSubPartitions in class AbstractSchema

partitionColumns - a list of partitions to match

partitionValues - list of values of each partition (corresponding to the partition column list)

Returns:

list of sub-partitions, will be empty if a there is no further level of sub-partitioning below, i.e. hit a leaf partition

Throws:

PartitionNotFoundException - when the partition does not exist in the given workspace

dropView

public void dropView(String viewName)
              throws IOException

Description copied from class: AbstractSchema

Drop the view with given name.

Overrides:

dropView in class AbstractSchema

Throws:

IOException

getTableNames

public Set<String> getTableNames()

Specified by:

getTableNames in interface org.apache.calcite.schema.Schema

Overrides:

getTableNames in class AbstractSchema

getFunctionNames

public Set<String> getFunctionNames()

Specified by:

getFunctionNames in interface org.apache.calcite.schema.Schema

Overrides:

getFunctionNames in class AbstractSchema

getFunctions

public List<org.apache.calcite.schema.Function> getFunctions(String name)

Specified by:

getFunctions in interface org.apache.calcite.schema.Schema

Overrides:

getFunctions in class AbstractSchema

getTable

public org.apache.calcite.schema.Table getTable(String tableName)

Specified by:

getTable in interface org.apache.calcite.schema.Schema

Overrides:

getTable in class AbstractSchema

isMutable

public boolean isMutable()

Specified by:

isMutable in interface org.apache.calcite.schema.Schema

Overrides:

isMutable in class AbstractSchema

getFS

public DrillFileSystem getFS()

getDefaultLocation

public String getDefaultLocation()

createNewTable

public CreateTableEntry createNewTable(String tableName,
                              List<String> partitionColumns,
                              StorageStrategy storageStrategy)

Description copied from class: AbstractSchema

Creates table entry using table name, list of partition columns and storage strategy used to create table folder and files

Overrides:

createNewTable in class AbstractSchema

Parameters:

tableName - : new table name.

partitionColumns - : list of partition columns. Empty list if there is no partition columns.

storageStrategy - : storage strategy used to create table folder and files

Returns:

create table entry

getTypeName

public String getTypeName()

Specified by:

getTypeName in class AbstractSchema

create

public DrillTable create(org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory.TableInstance key)

Specified by:

create in interface ExpandingConcurrentMap.MapValueFactory<org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory.TableInstance,DrillTable>

destroy

public void destroy(DrillTable value)

Specified by:

destroy in interface ExpandingConcurrentMap.MapValueFactory<org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory.TableInstance,DrillTable>

dropTable

public void dropTable(String table)

We check if the table contains homogeneous file formats that Drill can read. Once the checks are performed we rename the file to start with an "_". After the rename we issue a recursive delete of the directory.

Overrides:

dropTable in class AbstractSchema

Parameters:

table - - Path of table to be dropped

getTableNamesAndTypes

public List<org.apache.commons.lang3.tuple.Pair<String,org.apache.calcite.schema.Schema.TableType>> getTableNamesAndTypes(boolean bulkLoad,
                                                                                                                 int bulkSize)

Overrides:

getTableNamesAndTypes in class AbstractSchema