org.apache.flink.changelog.fs

Class StateChangeFsUploader

java.lang.Object

org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

org.apache.flink.changelog.fs.StateChangeFsUploader

All Implemented Interfaces:

AutoCloseable, StateChangeUploader

public class StateChangeFsUploader
extends AbstractStateChangeFsUploader

A synchronous StateChangeUploadScheduler implementation that uploads the changes using FileSystem.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.changelog.fs.StateChangeUploader

StateChangeUploader.UploadTasksResult

Field Summary

Fields

Modifier and Type	Field and Description
static String	PATH_SUB_DIR

Fields inherited from class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

bufferSize, compression, metrics

Constructor Summary

Constructors

Constructor and Description
StateChangeFsUploader(org.apache.flink.api.common.JobID jobID, org.apache.flink.core.fs.Path basePath, org.apache.flink.core.fs.FileSystem fileSystem, boolean compression, int bufferSize, ChangelogStorageMetricGroup metrics, TaskChangelogRegistry changelogRegistry)
StateChangeFsUploader(org.apache.flink.api.common.JobID jobID, org.apache.flink.core.fs.Path basePath, org.apache.flink.core.fs.FileSystem fileSystem, boolean compression, int bufferSize, ChangelogStorageMetricGroup metrics, TaskChangelogRegistry changelogRegistry, java.util.function.BiFunction<org.apache.flink.core.fs.Path,Long,org.apache.flink.runtime.state.StreamStateHandle> handleFactory)

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.flink.core.fs.Path	getBasePath()
org.apache.flink.changelog.fs.OutputStreamWithPos	prepareStream()

Methods inherited from class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

generateFileName, upload

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PATH_SUB_DIR

@VisibleForTesting
public static final String PATH_SUB_DIR

See Also:

Constant Field Values

Constructor Detail

StateChangeFsUploader

@VisibleForTesting
public StateChangeFsUploader(org.apache.flink.api.common.JobID jobID,
                                                org.apache.flink.core.fs.Path basePath,
                                                org.apache.flink.core.fs.FileSystem fileSystem,
                                                boolean compression,
                                                int bufferSize,
                                                ChangelogStorageMetricGroup metrics,
                                                TaskChangelogRegistry changelogRegistry)

StateChangeFsUploader

public StateChangeFsUploader(org.apache.flink.api.common.JobID jobID,
                             org.apache.flink.core.fs.Path basePath,
                             org.apache.flink.core.fs.FileSystem fileSystem,
                             boolean compression,
                             int bufferSize,
                             ChangelogStorageMetricGroup metrics,
                             TaskChangelogRegistry changelogRegistry,
                             java.util.function.BiFunction<org.apache.flink.core.fs.Path,Long,org.apache.flink.runtime.state.StreamStateHandle> handleFactory)

Method Detail

getBasePath

@VisibleForTesting
public org.apache.flink.core.fs.Path getBasePath()

prepareStream

public org.apache.flink.changelog.fs.OutputStreamWithPos prepareStream()
                                                                throws IOException

Throws:

IOException

close

public void close()