org.apache.flink.streaming.api.functions.sink.filesystem

类 HadoopPathBasedBulkFormatBuilder<IN,BucketID,T extends HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>>

java.lang.Object

org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<IN,BucketID,T>

org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>

所有已实现的接口:

Serializable

public class HadoopPathBasedBulkFormatBuilder<IN,BucketID,T extends HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>>
extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<IN,BucketID,T>

Buckets builder to create buckets that use HadoopPathBasedPartFileWriter.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder

DEFAULT_BUCKET_CHECK_INTERVAL

构造器概要

构造器

构造器和说明
HadoopPathBasedBulkFormatBuilder(org.apache.hadoop.fs.Path basePath, HadoopPathBasedBulkWriter.Factory<IN> writerFactory, org.apache.hadoop.conf.Configuration configuration, org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner)
HadoopPathBasedBulkFormatBuilder(org.apache.hadoop.fs.Path basePath, HadoopPathBasedBulkWriter.Factory<IN> writerFactory, HadoopFileCommitterFactory fileCommitterFactory, org.apache.hadoop.conf.Configuration configuration, org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner, org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy<IN,BucketID> policy, org.apache.flink.streaming.api.functions.sink.filesystem.BucketFactory<IN,BucketID> bucketFactory, org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig)

方法概要

限定符和类型	方法和说明
org.apache.flink.streaming.api.functions.sink.filesystem.Buckets<IN,BucketID>	createBuckets(int subtaskIndex)
org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID>	createBucketWriter()
T	withBucketAssigner(org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner)
T	withBucketFactory(org.apache.flink.streaming.api.functions.sink.filesystem.BucketFactory<IN,BucketID> factory)
T	withConfiguration(org.apache.hadoop.conf.Configuration configuration)
T	withOutputFileConfig(org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig)
T	withRollingPolicy(org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy<IN,BucketID> rollingPolicy)

从类继承的方法 org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder

self

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

HadoopPathBasedBulkFormatBuilder

public HadoopPathBasedBulkFormatBuilder(org.apache.hadoop.fs.Path basePath,
                                        HadoopPathBasedBulkWriter.Factory<IN> writerFactory,
                                        org.apache.hadoop.conf.Configuration configuration,
                                        org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner)

HadoopPathBasedBulkFormatBuilder

public HadoopPathBasedBulkFormatBuilder(org.apache.hadoop.fs.Path basePath,
                                        HadoopPathBasedBulkWriter.Factory<IN> writerFactory,
                                        HadoopFileCommitterFactory fileCommitterFactory,
                                        org.apache.hadoop.conf.Configuration configuration,
                                        org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner,
                                        org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy<IN,BucketID> policy,
                                        org.apache.flink.streaming.api.functions.sink.filesystem.BucketFactory<IN,BucketID> bucketFactory,
                                        org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig)

方法详细资料

withBucketAssigner

public T withBucketAssigner(org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner)

withRollingPolicy

public T withRollingPolicy(org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy<IN,BucketID> rollingPolicy)

withBucketFactory

public T withBucketFactory(org.apache.flink.streaming.api.functions.sink.filesystem.BucketFactory<IN,BucketID> factory)

withOutputFileConfig

public T withOutputFileConfig(org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig)

withConfiguration

public T withConfiguration(org.apache.hadoop.conf.Configuration configuration)

createBucketWriter

public org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID> createBucketWriter()

指定者:

createBucketWriter 在类中 org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<IN,BucketID,T extends HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>>

createBuckets

public org.apache.flink.streaming.api.functions.sink.filesystem.Buckets<IN,BucketID> createBuckets(int subtaskIndex)
                                                                                            throws IOException

指定者:

createBuckets 在类中 org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<IN,BucketID,T extends HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>>

抛出:

IOException