org.apache.flink.runtime.io.network.partition

类 PartitionSortedBuffer

java.lang.Object

org.apache.flink.runtime.io.network.partition.PartitionSortedBuffer

所有已实现的接口:

SortBuffer

@NotThreadSafe
public class PartitionSortedBuffer
extends Object
implements SortBuffer

A SortBuffer implementation which sorts all appended records only by subpartition index. Records of the same subpartition keep the appended order.

It maintains a list of MemorySegments as a joint buffer. Data will be appended to the joint buffer sequentially. When writing a record, an index entry will be appended first. An index entry consists of 4 fields: 4 bytes for record length, 4 bytes for Buffer.DataType and 8 bytes for address pointing to the next index entry of the same channel which will be used to index the next record to read when coping data from this SortBuffer. For simplicity, no index entry can span multiple segments. The corresponding record data is seated right after its index entry and different from the index entry, records have variable length thus may span multiple segments.

构造器概要

构造器

构造器和说明
PartitionSortedBuffer(BufferPool bufferPool, int numSubpartitions, int bufferSize, int numGuaranteedBuffers, int[] customReadOrder)

方法概要

限定符和类型	方法和说明
boolean	append(ByteBuffer source, int targetChannel, Buffer.DataType dataType) Appends data of the specified channel to this SortBuffer and returns true if all bytes of the source buffer is copied to this SortBuffer successfully, otherwise if returns false, nothing will be copied.
BufferWithChannel	copyIntoSegment(org.apache.flink.core.memory.MemorySegment target) Copies data in this SortBuffer to the target MemorySegment in channel index order and returns BufferWithChannel which contains the copied data and the corresponding channel index.
void	finish() Finishes this SortBuffer which means no record can be appended any more.
boolean	hasRemaining() Returns true if there is still data can be consumed in this SortBuffer.
boolean	isFinished() Whether this SortBuffer is finished or not.
boolean	isReleased() Whether this SortBuffer is released or not.
long	numBytes() Returns the number of bytes written to this SortBuffer.
long	numRecords() Returns the number of records written to this SortBuffer.
void	release() Releases this SortBuffer which releases all resources.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

PartitionSortedBuffer

public PartitionSortedBuffer(BufferPool bufferPool,
                             int numSubpartitions,
                             int bufferSize,
                             int numGuaranteedBuffers,
                             @Nullable
                             int[] customReadOrder)

方法详细资料

append

public boolean append(ByteBuffer source,
                      int targetChannel,
                      Buffer.DataType dataType)
               throws IOException

从接口复制的说明: SortBuffer

Appends data of the specified channel to this SortBuffer and returns true if all bytes of the source buffer is copied to this SortBuffer successfully, otherwise if returns false, nothing will be copied.

指定者:

append 在接口中 SortBuffer

抛出:

IOException

copyIntoSegment

public BufferWithChannel copyIntoSegment(org.apache.flink.core.memory.MemorySegment target)

从接口复制的说明: SortBuffer

Copies data in this SortBuffer to the target MemorySegment in channel index order and returns BufferWithChannel which contains the copied data and the corresponding channel index.

指定者:

copyIntoSegment 在接口中 SortBuffer

numRecords

public long numRecords()

从接口复制的说明: SortBuffer

Returns the number of records written to this SortBuffer.

指定者:

numRecords 在接口中 SortBuffer

numBytes

public long numBytes()

从接口复制的说明: SortBuffer

Returns the number of bytes written to this SortBuffer.

指定者:

numBytes 在接口中 SortBuffer

hasRemaining

public boolean hasRemaining()

从接口复制的说明: SortBuffer

Returns true if there is still data can be consumed in this SortBuffer.

指定者:

hasRemaining 在接口中 SortBuffer

finish

public void finish()

从接口复制的说明: SortBuffer

Finishes this SortBuffer which means no record can be appended any more.

指定者:

finish 在接口中 SortBuffer

isFinished

public boolean isFinished()

从接口复制的说明: SortBuffer

Whether this SortBuffer is finished or not.

指定者:

isFinished 在接口中 SortBuffer

release

public void release()

从接口复制的说明: SortBuffer

Releases this SortBuffer which releases all resources.

指定者:

release 在接口中 SortBuffer

isReleased

public boolean isReleased()

从接口复制的说明: SortBuffer

Whether this SortBuffer is released or not.

指定者:

isReleased 在接口中 SortBuffer