org.apache.hudi.index.hbase

Class DefaultHBaseQPSResourceAllocator

java.lang.Object

org.apache.hudi.index.hbase.DefaultHBaseQPSResourceAllocator

All Implemented Interfaces:

Serializable, HBaseIndexQPSResourceAllocator

public class DefaultHBaseQPSResourceAllocator
extends Object
implements HBaseIndexQPSResourceAllocator

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
DefaultHBaseQPSResourceAllocator(HoodieWriteConfig hoodieWriteConfig)

Method Summary

Modifier and Type	Method and Description
float	acquireQPSResources(float desiredQPSFraction, long numPuts) This method acquires the requested QPS Fraction against HBase cluster for index operation.
float	calculateQPSFractionForPutsTime(long numPuts, int numRegionServers) This method returns the QPS Fraction value that needs to be acquired such that the respective HBase index operation can be completed in desiredPutsTime.
void	releaseQPSResources() This method releases the acquired QPS Fraction.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultHBaseQPSResourceAllocator

public DefaultHBaseQPSResourceAllocator(HoodieWriteConfig hoodieWriteConfig)

Method Detail

calculateQPSFractionForPutsTime

public float calculateQPSFractionForPutsTime(long numPuts,
                                             int numRegionServers)

Description copied from interface: HBaseIndexQPSResourceAllocator

This method returns the QPS Fraction value that needs to be acquired such that the respective HBase index operation can be completed in desiredPutsTime.

Specified by:

calculateQPSFractionForPutsTime in interface HBaseIndexQPSResourceAllocator

Parameters:

numPuts - Number of inserts to be written to HBase index

numRegionServers - Total expected time for the HBase inserts operation

Returns:

QPS fraction that needs to be acquired.

acquireQPSResources

public float acquireQPSResources(float desiredQPSFraction,
                                 long numPuts)

Description copied from interface: HBaseIndexQPSResourceAllocator

This method acquires the requested QPS Fraction against HBase cluster for index operation.

Specified by:

acquireQPSResources in interface HBaseIndexQPSResourceAllocator

Parameters:

desiredQPSFraction - QPS fraction that needs to be requested and acquired

numPuts - Number of inserts to be written to HBase index

Returns:

value of the acquired QPS Fraction.

releaseQPSResources

public void releaseQPSResources()

Description copied from interface: HBaseIndexQPSResourceAllocator

This method releases the acquired QPS Fraction.

Specified by:

releaseQPSResources in interface HBaseIndexQPSResourceAllocator