org.apache.flink.streaming.api.functions.sink.filesystem

接口 BucketAssigner<IN,BucketID>

类型参数:

IN - The type of input elements.

BucketID - The type of the object returned by the getBucketId(Object, BucketAssigner.Context). This has to have a correct #hashCode() and #equals(Object) method. In addition, the Path to the created bucket will be the result of the #toString() of this method, appended to the basePath specified in the StreamingFileSink.

所有超级接口:

Serializable

所有已知实现类:

BasePathBucketAssigner, DateTimeBucketAssigner

@PublicEvolving
public interface BucketAssigner<IN,BucketID>
extends Serializable

A BucketAssigner is used with a StreamingFileSink to determine the Bucket each incoming element should be put into.

The StreamingFileSink can be writing to many buckets at a time, and it is responsible for managing a set of active buckets. Whenever a new element arrives it will ask the BucketAssigner for the bucket the element should fall in. The BucketAssigner can, for example, determine buckets based on system time.

嵌套类概要

嵌套类

限定符和类型	接口和说明
static interface	BucketAssigner.Context Context that the BucketAssigner can use for getting additional data about an input record.

方法概要

限定符和类型	方法和说明
BucketID	getBucketId(IN element, BucketAssigner.Context context) Returns the identifier of the bucket the provided element should be put into.
org.apache.flink.core.io.SimpleVersionedSerializer<BucketID>	getSerializer()

方法详细资料

getBucketId

BucketID getBucketId(IN element,
                     BucketAssigner.Context context)

Returns the identifier of the bucket the provided element should be put into.

参数:

element - The current element being processed.

context - The context used by the sink.

返回:

A string representing the identifier of the bucket the element should be put into. The actual path to the bucket will result from the concatenation of the returned string and the base path provided during the initialization of the sink.

getSerializer

org.apache.flink.core.io.SimpleVersionedSerializer<BucketID> getSerializer()

返回:

A SimpleVersionedSerializer capable of serializing/deserializing the elements of type BucketID. That is the type of the objects returned by the getBucketId(Object, BucketAssigner.Context).