org.apache.flink.runtime.io.network.partition

类 PartitionedFileWriter

java.lang.Object

org.apache.flink.runtime.io.network.partition.PartitionedFileWriter

所有已实现的接口:

AutoCloseable

@NotThreadSafe
public class PartitionedFileWriter
extends Object
implements AutoCloseable

File writer which can write buffers and generate PartitionedFile. Data is written region by region. Before writing a new region, the method startNewRegion(boolean) must be called. After writing all data, the method finish() must be called to close all opened files and return the target PartitionedFile.

构造器概要

构造器

构造器和说明
PartitionedFileWriter(int numSubpartitions, int maxIndexBufferSize, String basePath)

方法概要

限定符和类型	方法和说明
void	close()
PartitionedFile	finish() Finishes writing the PartitionedFile which closes the file channel and returns the corresponding PartitionedFile.
void	releaseQuietly() Used to close and delete the failed PartitionedFile when any exception occurs.
void	startNewRegion(boolean isBroadcastRegion) Persists the region index of the current data region and starts a new region to write.
void	writeBuffers(List<BufferWithChannel> bufferWithChannels) Writes a list of Buffers to this PartitionedFile.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

PartitionedFileWriter

public PartitionedFileWriter(int numSubpartitions,
                             int maxIndexBufferSize,
                             String basePath)
                      throws IOException

抛出:

IOException

方法详细资料

startNewRegion

public void startNewRegion(boolean isBroadcastRegion)
                    throws IOException

Persists the region index of the current data region and starts a new region to write.

Note: The caller is responsible for releasing the failed PartitionedFile if any exception occurs.

参数:

isBroadcastRegion - Whether it's a broadcast region. See isBroadcastRegion.

抛出:

IOException

writeBuffers

public void writeBuffers(List<BufferWithChannel> bufferWithChannels)
                  throws IOException

Writes a list of Buffers to this PartitionedFile. It guarantees that after the return of this method, the target buffers can be released. In a data region, all data of the same subpartition must be written together.

Note: The caller is responsible for recycling the target buffers and releasing the failed PartitionedFile if any exception occurs.

抛出:

IOException

finish

public PartitionedFile finish()
                       throws IOException

Finishes writing the PartitionedFile which closes the file channel and returns the corresponding PartitionedFile.

Note: The caller is responsible for releasing the failed PartitionedFile if any exception occurs.

抛出:

IOException

releaseQuietly

public void releaseQuietly()

Used to close and delete the failed PartitionedFile when any exception occurs.

close

public void close()
           throws IOException

指定者:

close 在接口中 AutoCloseable

抛出:

IOException