org.apache.flink.table.runtime.hashtable

Class LongHybridHashTable

java.lang.Object

org.apache.flink.table.runtime.hashtable.BaseHybridHashTable

org.apache.flink.table.runtime.hashtable.LongHybridHashTable

All Implemented Interfaces:

org.apache.flink.core.memory.MemorySegmentSource, MemorySegmentPool

public abstract class LongHybridHashTable
extends BaseHybridHashTable

Special optimized hashTable with key long.

See LongHashPartition. TODO add min max long filter and bloomFilter to spilled partition.

Field Summary

Fields inherited from class org.apache.flink.table.runtime.hashtable.BaseHybridHashTable

allocatedFloatingNum, availableMemory, buildRowCount, buildSpillRetBufferNumbers, buildSpillReturnBuffers, closed, compressionBlockSize, compressionCodecFactory, compressionEnable, currentEnumerator, currentRecursionDepth, currentSpilledBuildSide, currentSpilledProbeSide, initPartitionFanOut, ioManager, LOG, MAX_NUM_PARTITIONS, MAX_RECURSION_DEPTH, numSpillFiles, reservedNumBuffers, segmentSize, segmentSizeBits, segmentSizeMask, spillInBytes, tryDistinctBuildRow

Constructor Summary

Constructors

Constructor and Description

LongHybridHashTable(org.apache.flink.configuration.Configuration conf, Object owner, BinaryRowSerializer buildSideSerializer, BinaryRowSerializer probeSideSerializer, org.apache.flink.runtime.memory.MemoryManager memManager, long reservedMemorySize, long preferredMemorySize, long perRequestMemorySize, org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager, int avgRecordLen, long buildRowCount)

Method Summary

Modifier and Type	Method and Description
protected void	clearPartitions()
void	close() Closes the hash table.
int	compressionBlockSize()
BlockCompressionFactory	compressionCodecFactory()
boolean	compressionEnable()
void	endBuild()
void	free()
abstract long	getBuildLongKey(BaseRow row) For code gen get build side long key.
LongHashPartition.MatchIterator	getBuildSideIterator()
BaseRow	getCurrentProbeRow()
abstract long	getProbeLongKey(BaseRow row) For code gen get probe side long key.
boolean	nextMatching()
abstract BinaryRow	probeToBinary(BaseRow row) For code gen probe side to BinaryRow.
void	putBuildRow(BinaryRow row)
int	spillPartition()
boolean	tryProbe(BaseRow record)

Methods inherited from class org.apache.flink.table.runtime.hashtable.BaseHybridHashTable

createInputView, ensureNumBuffersReturned, free, freeCurrent, getFreedMemory, getNextBuffer, getNextBuffers, getNotNullNextBuffer, getNumSpillFiles, getSpillInBytes, getUsedMemoryInBytes, hash, maxInitBufferOfBucketArea, maxNumPartition, nextSegment, pageSize, readAllBuffers, remainBuffers, returnAll

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LongHybridHashTable

public LongHybridHashTable(org.apache.flink.configuration.Configuration conf,
                           Object owner,
                           BinaryRowSerializer buildSideSerializer,
                           BinaryRowSerializer probeSideSerializer,
                           org.apache.flink.runtime.memory.MemoryManager memManager,
                           long reservedMemorySize,
                           long preferredMemorySize,
                           long perRequestMemorySize,
                           org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager,
                           int avgRecordLen,
                           long buildRowCount)

Method Detail

putBuildRow

public void putBuildRow(BinaryRow row)
                 throws IOException

Throws:

IOException

endBuild

public void endBuild()
              throws IOException

Throws:

IOException

tryProbe

public boolean tryProbe(BaseRow record)
                 throws IOException

Throws:

IOException

nextMatching

public boolean nextMatching()
                     throws IOException

Throws:

IOException

getCurrentProbeRow

public BaseRow getCurrentProbeRow()

getBuildSideIterator

public LongHashPartition.MatchIterator getBuildSideIterator()

close

public void close()

Description copied from class: BaseHybridHashTable

Closes the hash table. This effectively releases all internal structures and closes all open files and removes them. The call to this method is valid both as a cleanup after the complete inputs were properly processed, and as an cancellation call, which cleans up all resources that are currently held by the hash join.

Overrides:

close in class BaseHybridHashTable

free

public void free()

Overrides:

free in class BaseHybridHashTable

getBuildLongKey

public abstract long getBuildLongKey(BaseRow row)

For code gen get build side long key.

getProbeLongKey

public abstract long getProbeLongKey(BaseRow row)

For code gen get probe side long key.

probeToBinary

public abstract BinaryRow probeToBinary(BaseRow row)

For code gen probe side to BinaryRow.

spillPartition

public int spillPartition()
                   throws IOException

Specified by:

spillPartition in class BaseHybridHashTable

Throws:

IOException

clearPartitions

protected void clearPartitions()

Specified by:

clearPartitions in class BaseHybridHashTable

compressionEnable

public boolean compressionEnable()

compressionCodecFactory

public BlockCompressionFactory compressionCodecFactory()

compressionBlockSize

public int compressionBlockSize()