org.apache.hadoop.hbase.spark

Class SparkSQLPushDownFilter

java.lang.Object

org.apache.hadoop.hbase.filter.Filter

org.apache.hadoop.hbase.filter.FilterBase

org.apache.hadoop.hbase.spark.SparkSQLPushDownFilter

@InterfaceAudience.Private
public class SparkSQLPushDownFilter
extends FilterBase

This filter will push down all qualifier logic given to us by SparkSQL so that we have make the filters at the region server level and avoid sending the data back to the client to be filtered.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.filter.Filter

Filter.ReturnCode

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.apache.commons.logging.Log	log

Fields inherited from class org.apache.hadoop.hbase.filter.Filter

reversed

Constructor Summary

Constructors

Constructor and Description
SparkSQLPushDownFilter(DynamicLogicExpression dynamicLogicExpression, byte[][] valueFromQueryArray, HashMap<ByteArrayComparable,HashMap<ByteArrayComparable,String>> currentCellToColumnIndexMap, String encoderClassName)
SparkSQLPushDownFilter(DynamicLogicExpression dynamicLogicExpression, byte[][] valueFromQueryArray, scala.collection.mutable.MutableList<Field> fields, String encoderClassName)

Method Summary

Modifier and Type	Method and Description
Filter.ReturnCode	filterKeyValue(Cell c)
boolean	filterRow()
static SparkSQLPushDownFilter	parseFrom(byte[] pbBytes)
byte[]	toByteArray()

Methods inherited from class org.apache.hadoop.hbase.filter.FilterBase

createFilterFromArguments, filterAllRemaining, filterRowCells, filterRowKey, filterRowKey, getNextCellHint, hasFilterRow, isFamilyEssential, reset, toString, transformCell

Methods inherited from class org.apache.hadoop.hbase.filter.Filter

isReversed, setReversed

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

log

protected static final org.apache.commons.logging.Log log

Constructor Detail

SparkSQLPushDownFilter

public SparkSQLPushDownFilter(DynamicLogicExpression dynamicLogicExpression,
                              byte[][] valueFromQueryArray,
                              HashMap<ByteArrayComparable,HashMap<ByteArrayComparable,String>> currentCellToColumnIndexMap,
                              String encoderClassName)

SparkSQLPushDownFilter

public SparkSQLPushDownFilter(DynamicLogicExpression dynamicLogicExpression,
                              byte[][] valueFromQueryArray,
                              scala.collection.mutable.MutableList<Field> fields,
                              String encoderClassName)

Method Detail

filterKeyValue

public Filter.ReturnCode filterKeyValue(Cell c)
                                 throws IOException

Specified by:

filterKeyValue in class Filter

Throws:

IOException

filterRow

public boolean filterRow()
                  throws IOException

Overrides:

filterRow in class FilterBase

Throws:

IOException

parseFrom

public static SparkSQLPushDownFilter parseFrom(byte[] pbBytes)
                                        throws DeserializationException

Parameters:

pbBytes - A pb serialized instance

Returns:

An instance of SparkSQLPushDownFilter

Throws:

DeserializationException

toByteArray

public byte[] toByteArray()

Overrides:

toByteArray in class FilterBase

Returns:

The filter serialized using pb