org.apache.hudi.sink.clustering

Class ClusteringCommitSink

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.hudi.sink.CleanFunction<ClusteringCommitEvent>

org.apache.hudi.sink.clustering.ClusteringCommitSink

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.checkpoint.CheckpointedFunction, org.apache.flink.streaming.api.functions.sink.SinkFunction<ClusteringCommitEvent>

public class ClusteringCommitSink
extends CleanFunction<ClusteringCommitEvent>

Function to check and commit the clustering action.

Each time after receiving a clustering commit event ClusteringCommitEvent, it loads and checks the clustering plan HoodieClusteringPlan, if all the clustering operations ClusteringOperation of the plan are finished, tries to commit the clustering action.

It also inherits the CleanFunction cleaning ability. This is needed because the SQL API does not allow multiple sinks in one table sink provider.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.sink.SinkFunction

org.apache.flink.streaming.api.functions.sink.SinkFunction.Context

Field Summary

Fields inherited from class org.apache.hudi.sink.CleanFunction

isCleaning, writeClient

Constructor Summary

Constructors

Constructor and Description
ClusteringCommitSink(org.apache.flink.configuration.Configuration conf)

Method Summary

Modifier and Type	Method and Description
void	invoke(ClusteringCommitEvent event, org.apache.flink.streaming.api.functions.sink.SinkFunction.Context context)
void	open(org.apache.flink.configuration.Configuration parameters)

Methods inherited from class org.apache.hudi.sink.CleanFunction

close, initializeState, notifyCheckpointComplete, snapshotState

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.functions.sink.SinkFunction

finish, invoke, writeWatermark

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Constructor Detail

ClusteringCommitSink

public ClusteringCommitSink(org.apache.flink.configuration.Configuration conf)

Method Detail

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class CleanFunction<ClusteringCommitEvent>

Throws:

Exception

invoke

public void invoke(ClusteringCommitEvent event,
                   org.apache.flink.streaming.api.functions.sink.SinkFunction.Context context)
            throws Exception

Throws:

Exception