org.apache.flink.changelog.fs

Class FsStateChangelogStorage

java.lang.Object

org.apache.flink.changelog.fs.FsStateChangelogStorageForRecovery

org.apache.flink.changelog.fs.FsStateChangelogStorage

All Implemented Interfaces:

AutoCloseable, org.apache.flink.runtime.state.changelog.StateChangelogStorage<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>, org.apache.flink.runtime.state.changelog.StateChangelogStorageView<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>

@Experimental
 @ThreadSafe
public class FsStateChangelogStorage
extends FsStateChangelogStorageForRecovery
implements org.apache.flink.runtime.state.changelog.StateChangelogStorage<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>

Filesystem-based implementation of StateChangelogStorage.

Constructor Summary

Constructors

Constructor and Description
FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID, org.apache.flink.configuration.Configuration config, org.apache.flink.runtime.metrics.groups.TaskManagerJobMetricGroup metricGroup, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID, org.apache.flink.configuration.Configuration config, org.apache.flink.runtime.metrics.groups.TaskManagerJobMetricGroup metricGroup, TaskChangelogRegistry changelogRegistry, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID, org.apache.flink.core.fs.Path basePath, boolean compression, int bufferSize, ChangelogStorageMetricGroup metricGroup, TaskChangelogRegistry changelogRegistry, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
FsStateChangelogStorage(StateChangeUploadScheduler uploader, long preEmptivePersistThresholdInBytes, TaskChangelogRegistry changelogRegistry, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.flink.changelog.fs.FsStateChangelogWriter	createWriter(String operatorID, org.apache.flink.runtime.state.KeyGroupRange keyGroupRange, org.apache.flink.api.common.operators.MailboxExecutor mailboxExecutor)
org.apache.flink.runtime.io.AvailabilityProvider	getAvailabilityProvider()

Methods inherited from class org.apache.flink.changelog.fs.FsStateChangelogStorageForRecovery

createReader

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.runtime.state.changelog.StateChangelogStorageView

createReader

Constructor Detail

FsStateChangelogStorage

public FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID,
                               org.apache.flink.configuration.Configuration config,
                               org.apache.flink.runtime.metrics.groups.TaskManagerJobMetricGroup metricGroup,
                               org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
                        throws IOException

Throws:

IOException

FsStateChangelogStorage

public FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID,
                               org.apache.flink.configuration.Configuration config,
                               org.apache.flink.runtime.metrics.groups.TaskManagerJobMetricGroup metricGroup,
                               TaskChangelogRegistry changelogRegistry,
                               org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
                        throws IOException

Throws:

IOException

FsStateChangelogStorage

@VisibleForTesting
public FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID,
                                                  org.apache.flink.core.fs.Path basePath,
                                                  boolean compression,
                                                  int bufferSize,
                                                  ChangelogStorageMetricGroup metricGroup,
                                                  TaskChangelogRegistry changelogRegistry,
                                                  org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
                                           throws IOException

Throws:

IOException

FsStateChangelogStorage

@VisibleForTesting
public FsStateChangelogStorage(StateChangeUploadScheduler uploader,
                                                  long preEmptivePersistThresholdInBytes,
                                                  TaskChangelogRegistry changelogRegistry,
                                                  org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)

Method Detail

createWriter

public org.apache.flink.changelog.fs.FsStateChangelogWriter createWriter(String operatorID,
                                                                         org.apache.flink.runtime.state.KeyGroupRange keyGroupRange,
                                                                         org.apache.flink.api.common.operators.MailboxExecutor mailboxExecutor)

Specified by:

createWriter in interface org.apache.flink.runtime.state.changelog.StateChangelogStorage<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.apache.flink.runtime.state.changelog.StateChangelogStorageView<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>

Overrides:

close in class FsStateChangelogStorageForRecovery

Throws:

Exception

getAvailabilityProvider

public org.apache.flink.runtime.io.AvailabilityProvider getAvailabilityProvider()

Specified by:

getAvailabilityProvider in interface org.apache.flink.runtime.state.changelog.StateChangelogStorage<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>