org.apache.kylin.storage.hbase.steps

Class HBaseMROutput2Transition

java.lang.Object

org.apache.kylin.storage.hbase.steps.HBaseMROutput2Transition

All Implemented Interfaces:

IMROutput2

public class HBaseMROutput2Transition
extends Object
implements IMROutput2

This "Transition" impl generates cuboid files and then convert to HFile. The additional step slows down build process, but the gains is merge can read from HDFS instead of over HBase region server. See KYLIN-1007. This is transitional because finally we want to merge from HTable snapshot. However multiple snapshots as MR input is only supported by HBase 1.x. Before most users upgrade to latest HBase, they can only use this transitional cuboid file solution.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HBaseMROutput2Transition.HBaseMergeMROutputFormat
static class	HBaseMROutput2Transition.HBaseMROutputFormat

Nested classes/interfaces inherited from interface org.apache.kylin.engine.mr.IMROutput2

IMROutput2.IMRBatchCubingOutputSide2, IMROutput2.IMRBatchMergeOutputSide2, IMROutput2.IMRBatchOptimizeOutputSide2, IMROutput2.IMRMergeOutputFormat, IMROutput2.IMROutputFormat

Constructor Summary

Constructors

Constructor and Description
HBaseMROutput2Transition()

Method Summary

Methods

Modifier and Type	Method and Description
IMROutput2.IMRBatchCubingOutputSide2	getBatchCubingOutputSide(org.apache.kylin.cube.CubeSegment seg)
IMROutput2.IMRBatchMergeOutputSide2	getBatchMergeOutputSide(org.apache.kylin.cube.CubeSegment seg)
IMROutput2.IMRBatchOptimizeOutputSide2	getBatchOptimizeOutputSide(org.apache.kylin.cube.CubeSegment seg)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HBaseMROutput2Transition

public HBaseMROutput2Transition()

Method Detail

getBatchCubingOutputSide

public IMROutput2.IMRBatchCubingOutputSide2 getBatchCubingOutputSide(org.apache.kylin.cube.CubeSegment seg)

Specified by:

getBatchCubingOutputSide in interface IMROutput2

getBatchMergeOutputSide

public IMROutput2.IMRBatchMergeOutputSide2 getBatchMergeOutputSide(org.apache.kylin.cube.CubeSegment seg)

Specified by:

getBatchMergeOutputSide in interface IMROutput2

getBatchOptimizeOutputSide

public IMROutput2.IMRBatchOptimizeOutputSide2 getBatchOptimizeOutputSide(org.apache.kylin.cube.CubeSegment seg)

Specified by:

getBatchOptimizeOutputSide in interface IMROutput2