org.apache.hudi.sink.compact

Class CompactionCommitSink

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.hudi.sink.CleanFunction<CompactionCommitEvent>

org.apache.hudi.sink.compact.CompactionCommitSink

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.checkpoint.CheckpointedFunction, org.apache.flink.streaming.api.functions.sink.SinkFunction<CompactionCommitEvent>

public class CompactionCommitSink
extends CleanFunction<CompactionCommitEvent>

Function to check and commit the compaction action.

Each time after receiving a compaction commit event CompactionCommitEvent, it loads and checks the compaction plan HoodieCompactionPlan, if all the compaction operations CompactionOperation of the plan are finished, tries to commit the compaction action.

It also inherits the CleanFunction cleaning ability. This is needed because the SQL API does not allow multiple sinks in one table sink provider.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.sink.SinkFunction

org.apache.flink.streaming.api.functions.sink.SinkFunction.Context

Field Summary

Fields inherited from class org.apache.hudi.sink.CleanFunction

writeClient

Constructor Summary

Constructors

Constructor and Description
CompactionCommitSink(org.apache.flink.configuration.Configuration conf)

Method Summary

Modifier and Type	Method and Description
void	invoke(CompactionCommitEvent event, org.apache.flink.streaming.api.functions.sink.SinkFunction.Context context)
void	open(org.apache.flink.configuration.Configuration parameters)

Methods inherited from class org.apache.hudi.sink.CleanFunction

close, initializeState, notifyCheckpointComplete, snapshotState

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.functions.sink.SinkFunction

finish, invoke, writeWatermark

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Constructor Detail

CompactionCommitSink

public CompactionCommitSink(org.apache.flink.configuration.Configuration conf)

Method Detail

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class CleanFunction<CompactionCommitEvent>

Throws:

Exception

invoke

public void invoke(CompactionCommitEvent event,
                   org.apache.flink.streaming.api.functions.sink.SinkFunction.Context context)
            throws Exception

Throws:

Exception