org.apache.flink.streaming.connectors.fs.bucketing

接口 Bucketer<T>

所有超级接口:

Serializable

所有已知实现类:

BasePathBucketer, DateTimeBucketer

public interface Bucketer<T>
extends Serializable

A bucketer is used with a BucketingSink to put emitted elements into rolling files.

The BucketingSink can be writing to many buckets at a time, and it is responsible for managing a set of active buckets. Whenever a new element arrives it will ask the Bucketer for the bucket path the element should fall in. The Bucketer can, for example, determine buckets based on system time.

方法概要

限定符和类型	方法和说明
org.apache.hadoop.fs.Path	getBucketPath(Clock clock, org.apache.hadoop.fs.Path basePath, T element) Returns the Path of a bucket file.

方法详细资料

getBucketPath

org.apache.hadoop.fs.Path getBucketPath(Clock clock,
                                        org.apache.hadoop.fs.Path basePath,
                                        T element)

Returns the Path of a bucket file.

参数:

basePath - The base path containing all the buckets.

element - The current element being processed.

返回:

The complete Path of the bucket which the provided element should fall in. This should include the basePath and also the subtaskIndex to avoid clashes with parallel sinks.