org.apache.flink.table.filesystem.stream

类 StreamingFileWriter

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<StreamingFileCommitter.CommitMessage>

org.apache.flink.table.filesystem.stream.StreamingFileWriter

所有已实现的接口:

Serializable, org.apache.flink.runtime.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,StreamingFileCommitter.CommitMessage>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<StreamingFileCommitter.CommitMessage>, org.apache.flink.streaming.api.operators.StreamOperator<StreamingFileCommitter.CommitMessage>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.util.Disposable

public class StreamingFileWriter
extends org.apache.flink.streaming.api.operators.AbstractStreamOperator<StreamingFileCommitter.CommitMessage>
implements org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,StreamingFileCommitter.CommitMessage>, org.apache.flink.streaming.api.operators.BoundedOneInput

Operator for file system sink. It is a operator version of StreamingFileSink. It sends partition commit message to downstream for committing.

See StreamingFileCommitter.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
StreamingFileWriter(long bucketCheckInterval, org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<org.apache.flink.table.data.RowData,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<org.apache.flink.table.data.RowData,String,?>> bucketsBuilder)

方法概要

限定符和类型	方法和说明
void	dispose()
void	endInput()
void	initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
void	notifyCheckpointComplete(long checkpointId) Commit up to this checkpoint id, also send inactive partitions to downstream for committing.
void	processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.table.data.RowData> element)
void	processWatermark(org.apache.flink.streaming.api.watermark.Watermark mark)
void	snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

close, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, notifyCheckpointAborted, numEventTimeTimers, numProcessingTimeTimers, open, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

processLatencyMarker

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.runtime.state.CheckpointListener

notifyCheckpointAborted

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

构造器详细资料

StreamingFileWriter

public StreamingFileWriter(long bucketCheckInterval,
                           org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<org.apache.flink.table.data.RowData,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<org.apache.flink.table.data.RowData,String,?>> bucketsBuilder)

方法详细资料

initializeState

public void initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
                     throws Exception

指定者:

initializeState 在接口中 org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

覆盖:

initializeState 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<StreamingFileCommitter.CommitMessage>

抛出:

Exception

snapshotState

public void snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)
                   throws Exception

指定者:

snapshotState 在接口中 org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

覆盖:

snapshotState 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<StreamingFileCommitter.CommitMessage>

抛出:

Exception

processWatermark

public void processWatermark(org.apache.flink.streaming.api.watermark.Watermark mark)
                      throws Exception

指定者:

processWatermark 在接口中 org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,StreamingFileCommitter.CommitMessage>

覆盖:

processWatermark 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<StreamingFileCommitter.CommitMessage>

抛出:

Exception

processElement

public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.table.data.RowData> element)
                    throws Exception

指定者:

processElement 在接口中 org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,StreamingFileCommitter.CommitMessage>

抛出:

Exception

notifyCheckpointComplete

public void notifyCheckpointComplete(long checkpointId)
                              throws Exception

Commit up to this checkpoint id, also send inactive partitions to downstream for committing.

指定者:

notifyCheckpointComplete 在接口中 org.apache.flink.runtime.state.CheckpointListener

覆盖:

notifyCheckpointComplete 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<StreamingFileCommitter.CommitMessage>

抛出:

Exception

endInput

public void endInput()
              throws Exception

指定者:

endInput 在接口中 org.apache.flink.streaming.api.operators.BoundedOneInput

抛出:

Exception

dispose

public void dispose()
             throws Exception

指定者:

dispose 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<StreamingFileCommitter.CommitMessage>

指定者:

dispose 在接口中 org.apache.flink.util.Disposable

覆盖:

dispose 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<StreamingFileCommitter.CommitMessage>

抛出:

Exception