org.apache.flink.formats.hadoop.bulk

接口 HadoopFileCommitterFactory

所有超级接口:

Serializable

所有已知实现类:

DefaultHadoopFileCommitterFactory

@Internal
public interface HadoopFileCommitterFactory
extends Serializable

The factory to create the HadoopFileCommitter.

方法概要

限定符和类型	方法和说明
HadoopFileCommitter	create(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path targetFilePath) Creates a new Hadoop file committer for writing.
HadoopFileCommitter	recoverForCommit(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path targetFilePath, org.apache.hadoop.fs.Path inProgressPath) Creates a Hadoop file committer for commit the pending file.

方法详细资料

create

HadoopFileCommitter create(org.apache.hadoop.conf.Configuration configuration,
                           org.apache.hadoop.fs.Path targetFilePath)
                    throws IOException

Creates a new Hadoop file committer for writing.

参数:

configuration - The hadoop configuration.

targetFilePath - The target path to commit to.

返回:

The corresponding Hadoop file committer.

抛出:

IOException

recoverForCommit

HadoopFileCommitter recoverForCommit(org.apache.hadoop.conf.Configuration configuration,
                                     org.apache.hadoop.fs.Path targetFilePath,
                                     org.apache.hadoop.fs.Path inProgressPath)
                              throws IOException

Creates a Hadoop file committer for commit the pending file.

参数:

configuration - The hadoop configuration.

targetFilePath - The target path to commit to.

inProgressPath - The path of the remaining pending file.

返回:

The corresponding Hadoop file committer.

抛出:

IOException