org.apache.flink.formats.hadoop.bulk

类 HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter<IN,BucketID>

java.lang.Object

org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter<IN,BucketID>

所有已实现的接口:

org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID>

封闭类:

HadoopPathBasedPartFileWriter<IN,BucketID>

public static class HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter<IN,BucketID>
extends Object
implements org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID>

Factory to create HadoopPathBasedPartFileWriter. This writer does not support snapshotting the in-progress files. For pending files, it stores the target path and the staging file path into the state.

嵌套类概要

从接口继承的嵌套类/接口 org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter

org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter.PendingFile

构造器概要

构造器

构造器和说明
HadoopPathBasedBucketWriter(org.apache.hadoop.conf.Configuration configuration, HadoopPathBasedBulkWriter.Factory<IN> bulkWriterFactory, HadoopFileCommitterFactory fileCommitterFactory)

方法概要

限定符和类型	方法和说明
boolean	cleanupInProgressFileRecoverable(org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.InProgressFileRecoverable inProgressFileRecoverable)
org.apache.flink.streaming.api.functions.sink.filesystem.WriterProperties	getProperties()
HadoopPathBasedPartFileWriter<IN,BucketID>	openNewInProgressFile(BucketID bucketID, org.apache.flink.core.fs.Path flinkPath, long creationTime)
org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter.PendingFile	recoverPendingFile(org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.PendingFileRecoverable pendingFileRecoverable)
org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter<IN,BucketID>	resumeInProgressFileFrom(BucketID bucketID, org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.InProgressFileRecoverable inProgressFileSnapshot, long creationTime)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter

openNewCompactingFile

构造器详细资料

HadoopPathBasedBucketWriter

public HadoopPathBasedBucketWriter(org.apache.hadoop.conf.Configuration configuration,
                                   HadoopPathBasedBulkWriter.Factory<IN> bulkWriterFactory,
                                   HadoopFileCommitterFactory fileCommitterFactory)

方法详细资料

openNewInProgressFile

public HadoopPathBasedPartFileWriter<IN,BucketID> openNewInProgressFile(BucketID bucketID,
                                                                        org.apache.flink.core.fs.Path flinkPath,
                                                                        long creationTime)
                                                                 throws IOException

指定者:

openNewInProgressFile 在接口中 org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID>

抛出:

IOException

recoverPendingFile

public org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter.PendingFile recoverPendingFile(org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.PendingFileRecoverable pendingFileRecoverable)
                                                                                                     throws IOException

指定者:

recoverPendingFile 在接口中 org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID>

抛出:

IOException

getProperties

public org.apache.flink.streaming.api.functions.sink.filesystem.WriterProperties getProperties()

指定者:

getProperties 在接口中 org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID>

resumeInProgressFileFrom

public org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter<IN,BucketID> resumeInProgressFileFrom(BucketID bucketID,
                                                                                                                           org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.InProgressFileRecoverable inProgressFileSnapshot,
                                                                                                                           long creationTime)

指定者:

resumeInProgressFileFrom 在接口中 org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID>

cleanupInProgressFileRecoverable

public boolean cleanupInProgressFileRecoverable(org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.InProgressFileRecoverable inProgressFileRecoverable)

指定者:

cleanupInProgressFileRecoverable 在接口中 org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID>