org.apache.hudi.sink.bulk

Class BulkInsertWriteOperator<I>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator<OUT,org.apache.flink.streaming.api.functions.ProcessFunction<IN,OUT>>

org.apache.flink.streaming.api.operators.ProcessOperator<I,Object>

org.apache.hudi.sink.common.AbstractWriteOperator<I>

org.apache.hudi.sink.bulk.BulkInsertWriteOperator<I>

Type Parameters:

I - The input type

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.runtime.operators.coordination.OperatorEventHandler, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<I>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<I,Object>, org.apache.flink.streaming.api.operators.OutputTypeConfigurable<Object>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<Object>, org.apache.flink.streaming.api.operators.StreamOperator<Object>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

public class BulkInsertWriteOperator<I>
extends AbstractWriteOperator<I>
implements org.apache.flink.streaming.api.operators.BoundedOneInput

Operator for bulk insert mode sink.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

userFunction

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService

Constructor Summary

Constructors

Constructor and Description
BulkInsertWriteOperator(org.apache.flink.configuration.Configuration conf, org.apache.flink.table.types.logical.RowType rowType)

Method Summary

Modifier and Type	Method and Description
static <I> WriteOperatorFactory<I>	getFactory(org.apache.flink.configuration.Configuration conf, org.apache.flink.table.types.logical.RowType rowType)
void	handleOperatorEvent(org.apache.flink.runtime.operators.coordination.OperatorEvent event)

Methods inherited from class org.apache.hudi.sink.common.AbstractWriteOperator

endInput, setOperatorEventGateway

Methods inherited from class org.apache.flink.streaming.api.operators.ProcessOperator

open, processElement, processWatermark

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

close, finish, getUserFunction, getUserFunctionParameters, initializeState, notifyCheckpointAborted, notifyCheckpointComplete, setOutputType, setup, snapshotState

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, isUsingCustomRawKeyedState, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, snapshotState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.operators.BoundedOneInput

endInput

Methods inherited from interface org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

Methods inherited from interface org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processWatermarkStatus

Constructor Detail

BulkInsertWriteOperator

public BulkInsertWriteOperator(org.apache.flink.configuration.Configuration conf,
                               org.apache.flink.table.types.logical.RowType rowType)

Method Detail

handleOperatorEvent

public void handleOperatorEvent(org.apache.flink.runtime.operators.coordination.OperatorEvent event)

Specified by:

handleOperatorEvent in interface org.apache.flink.runtime.operators.coordination.OperatorEventHandler

Overrides:

handleOperatorEvent in class AbstractWriteOperator<I>

getFactory

public static <I> WriteOperatorFactory<I> getFactory(org.apache.flink.configuration.Configuration conf,
                                                     org.apache.flink.table.types.logical.RowType rowType)