org.apache.hadoop.hive.metastore

Class HiveMetaStoreChecker

java.lang.Object

org.apache.hadoop.hive.metastore.HiveMetaStoreChecker

public class HiveMetaStoreChecker
extends Object

Verify that the information in the metastore matches what is on the filesystem. Return a CheckResult object containing lists of missing and any unexpected tables and partitions.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.hadoop.fs.PathFilter	HIDDEN_FILES_PATH_FILTER
static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
HiveMetaStoreChecker(IMetaStoreClient msc, org.apache.hadoop.conf.Configuration conf)
HiveMetaStoreChecker(IMetaStoreClient msc, org.apache.hadoop.conf.Configuration conf, long partitionExpirySeconds)

Method Summary

Modifier and Type	Method and Description
CheckResult	checkMetastore(String catName, String dbName, String tableName, byte[] filterExp, Table table) Check the metastore for inconsistencies, data missing in either the metastore or on the dfs.
IMetaStoreClient	getMsc()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final org.slf4j.Logger LOG

HIDDEN_FILES_PATH_FILTER

public static final org.apache.hadoop.fs.PathFilter HIDDEN_FILES_PATH_FILTER

Constructor Detail

HiveMetaStoreChecker

public HiveMetaStoreChecker(IMetaStoreClient msc,
                            org.apache.hadoop.conf.Configuration conf)

HiveMetaStoreChecker

public HiveMetaStoreChecker(IMetaStoreClient msc,
                            org.apache.hadoop.conf.Configuration conf,
                            long partitionExpirySeconds)

Method Detail

getMsc

public IMetaStoreClient getMsc()

checkMetastore

public CheckResult checkMetastore(String catName,
                                  String dbName,
                                  String tableName,
                                  byte[] filterExp,
                                  Table table)
                           throws MetastoreException,
                                  IOException

Check the metastore for inconsistencies, data missing in either the metastore or on the dfs.

Parameters:

catName - name of the catalog, if not specified default catalog will be used.

dbName - name of the database, if not specified the default will be used.

tableName - Table we want to run the check for. If null we'll check all the tables in the database.

filterExp - Filter expression which is used to prune th partition from the metastore and FileSystem.

table -

Returns:

Results of the check

Throws:

MetastoreException - Failed to get required information from the metastore.

IOException - Most likely filesystem related