org.apache.flink.table.runtime.operators.sort

类 BufferedKVExternalSorter

java.lang.Object

org.apache.flink.table.runtime.operators.sort.BufferedKVExternalSorter

public class BufferedKVExternalSorter
extends Object

Sorter for buffered input in the form of Key-Value Style. First, sort and spill buffered inputs (without data copy, just write index and normalized key). Second, merge disk outputs and return iterator.

For Hash Aggregation：We store the data in MemorySegmentHashTable in KeyValue format. When memory is not enough, we spill all the data in memory onto disk and degenerate it into Sort Aggregation. So we need a BufferedKVExternalSorter to write the data that already in memory to disk, and then carry out SortMerge.

构造器概要

构造器

构造器和说明
BufferedKVExternalSorter(org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager, BinaryRowDataSerializer keySerializer, BinaryRowDataSerializer valueSerializer, NormalizedKeyComputer nKeyComputer, RecordComparator comparator, int pageSize, org.apache.flink.configuration.Configuration conf)

方法概要

限定符和类型	方法和说明
void	close()
org.apache.flink.util.MutableObjectIterator<org.apache.flink.api.java.tuple.Tuple2<org.apache.flink.table.data.binary.BinaryRowData,org.apache.flink.table.data.binary.BinaryRowData>>	getKVIterator()
void	sortAndSpill(ArrayList<org.apache.flink.core.memory.MemorySegment> recordBufferSegments, long numElements, MemorySegmentPool pool)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

BufferedKVExternalSorter

public BufferedKVExternalSorter(org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager,
                                BinaryRowDataSerializer keySerializer,
                                BinaryRowDataSerializer valueSerializer,
                                NormalizedKeyComputer nKeyComputer,
                                RecordComparator comparator,
                                int pageSize,
                                org.apache.flink.configuration.Configuration conf)
                         throws IOException

抛出:

IOException

方法详细资料

getKVIterator

public org.apache.flink.util.MutableObjectIterator<org.apache.flink.api.java.tuple.Tuple2<org.apache.flink.table.data.binary.BinaryRowData,org.apache.flink.table.data.binary.BinaryRowData>> getKVIterator()
                                                                                                                                                                                                     throws IOException

抛出:

IOException

sortAndSpill

public void sortAndSpill(ArrayList<org.apache.flink.core.memory.MemorySegment> recordBufferSegments,
                         long numElements,
                         MemorySegmentPool pool)
                  throws IOException

抛出:

IOException

close

public void close()