org.apache.flink.formats.hadoop.bulk.committer

类 HadoopRenameFileCommitter

java.lang.Object

org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter

所有已实现的接口:

HadoopFileCommitter

public class HadoopRenameFileCommitter
extends Object
implements HadoopFileCommitter

The Hadoop file committer that directly rename the in-progress file to the target file. For FileSystem like S3, renaming may lead to additional copies.

构造器概要

构造器

构造器和说明
HadoopRenameFileCommitter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path targetFilePath)
HadoopRenameFileCommitter(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path targetFilePath, org.apache.hadoop.fs.Path inProgressPath)

方法概要

限定符和类型	方法和说明
void	commit() Commits the in-progress file to the target path.
void	commitAfterRecovery() Re-commits the in-progress file to the target path after fail-over.
org.apache.hadoop.fs.Path	getTargetFilePath() Gets the target path to commit to.
org.apache.hadoop.fs.Path	getTempFilePath() Gets the path of the intermediate file to commit.
void	preCommit() Prepares the intermediates file for committing.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

HadoopRenameFileCommitter

public HadoopRenameFileCommitter(org.apache.hadoop.conf.Configuration configuration,
                                 org.apache.hadoop.fs.Path targetFilePath)
                          throws IOException

抛出:

IOException

HadoopRenameFileCommitter

public HadoopRenameFileCommitter(org.apache.hadoop.conf.Configuration configuration,
                                 org.apache.hadoop.fs.Path targetFilePath,
                                 org.apache.hadoop.fs.Path inProgressPath)
                          throws IOException

抛出:

IOException

方法详细资料

getTargetFilePath

public org.apache.hadoop.fs.Path getTargetFilePath()

从接口复制的说明: HadoopFileCommitter

Gets the target path to commit to.

指定者:

getTargetFilePath 在接口中 HadoopFileCommitter

返回:

The target path to commit to.

getTempFilePath

public org.apache.hadoop.fs.Path getTempFilePath()

从接口复制的说明: HadoopFileCommitter

Gets the path of the intermediate file to commit.

指定者:

getTempFilePath 在接口中 HadoopFileCommitter

返回:

The path of the intermediate file to commit.

preCommit

public void preCommit()

从接口复制的说明: HadoopFileCommitter

Prepares the intermediates file for committing.

指定者:

preCommit 在接口中 HadoopFileCommitter

commit

public void commit()
            throws IOException

从接口复制的说明: HadoopFileCommitter

Commits the in-progress file to the target path.

指定者:

commit 在接口中 HadoopFileCommitter

抛出:

IOException

commitAfterRecovery

public void commitAfterRecovery()
                         throws IOException

从接口复制的说明: HadoopFileCommitter

Re-commits the in-progress file to the target path after fail-over.

指定者:

commitAfterRecovery 在接口中 HadoopFileCommitter

抛出:

IOException