org.apache.kylin.storage.hbase.lookup

Class KVSortReducerWithDupKeyCheck

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.hbase.KeyValue,org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.hbase.KeyValue>

org.apache.hadoop.hbase.mapreduce.KeyValueSortReducer

org.apache.kylin.storage.hbase.lookup.KVSortReducerWithDupKeyCheck

public class KVSortReducerWithDupKeyCheck
extends org.apache.hadoop.hbase.mapreduce.KeyValueSortReducer

Most code from KeyValueSortReducer, add logic to check whether the row key has duplicated if there is duplicated key, throws IllegalStateException

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Constructor Summary

Constructors

Constructor and Description
KVSortReducerWithDupKeyCheck()

Method Summary

Methods

Modifier and Type	Method and Description
protected void	reduce(org.apache.hadoop.hbase.io.ImmutableBytesWritable row, Iterable<org.apache.hadoop.hbase.KeyValue> kvs, org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KVSortReducerWithDupKeyCheck

public KVSortReducerWithDupKeyCheck()

Method Detail

reduce

protected void reduce(org.apache.hadoop.hbase.io.ImmutableBytesWritable row,
          Iterable<org.apache.hadoop.hbase.KeyValue> kvs,
          org.apache.hadoop.mapreduce.Reducer.Context context)
               throws IOException,
                      InterruptedException

Overrides:

reduce in class org.apache.hadoop.hbase.mapreduce.KeyValueSortReducer

Throws:

IOException

InterruptedException