org.apache.flink.fs.gs.writer

Class GSRecoverableWriter

java.lang.Object

org.apache.flink.fs.gs.writer.GSRecoverableWriter

All Implemented Interfaces:

org.apache.flink.core.fs.RecoverableWriter

public class GSRecoverableWriter
extends Object
implements org.apache.flink.core.fs.RecoverableWriter

The recoverable writer implementation for Google storage.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.core.fs.RecoverableWriter

org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable, org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable

Constructor Summary

Constructors

Constructor and Description
GSRecoverableWriter(GSBlobStorage storage, GSFileSystemOptions options) Construct a GS recoverable writer.

Method Summary

Modifier and Type	Method and Description
boolean	cleanupRecoverableState(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable resumable)
org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable>	getCommitRecoverableSerializer()
org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable>	getResumeRecoverableSerializer()
org.apache.flink.core.fs.RecoverableFsDataOutputStream	open(org.apache.flink.core.fs.Path path)
org.apache.flink.core.fs.RecoverableFsDataOutputStream	recover(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable resumable)
org.apache.flink.core.fs.RecoverableFsDataOutputStream.Committer	recoverForCommit(org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable resumable)
boolean	requiresCleanupOfRecoverableState()
boolean	supportsResume()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GSRecoverableWriter

public GSRecoverableWriter(GSBlobStorage storage,
                           GSFileSystemOptions options)

Construct a GS recoverable writer.

Parameters:

storage - The underlying blob storage instance

options - The GS file system options

Method Detail

requiresCleanupOfRecoverableState

public boolean requiresCleanupOfRecoverableState()

Specified by:

requiresCleanupOfRecoverableState in interface org.apache.flink.core.fs.RecoverableWriter

supportsResume

public boolean supportsResume()

Specified by:

supportsResume in interface org.apache.flink.core.fs.RecoverableWriter

open

public org.apache.flink.core.fs.RecoverableFsDataOutputStream open(org.apache.flink.core.fs.Path path)
                                                            throws IOException

Specified by:

open in interface org.apache.flink.core.fs.RecoverableWriter

Throws:

IOException

recover

public org.apache.flink.core.fs.RecoverableFsDataOutputStream recover(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable resumable)

Specified by:

recover in interface org.apache.flink.core.fs.RecoverableWriter

cleanupRecoverableState

public boolean cleanupRecoverableState(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable resumable)

Specified by:

cleanupRecoverableState in interface org.apache.flink.core.fs.RecoverableWriter

recoverForCommit

public org.apache.flink.core.fs.RecoverableFsDataOutputStream.Committer recoverForCommit(org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable resumable)

Specified by:

recoverForCommit in interface org.apache.flink.core.fs.RecoverableWriter

getCommitRecoverableSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable> getCommitRecoverableSerializer()

Specified by:

getCommitRecoverableSerializer in interface org.apache.flink.core.fs.RecoverableWriter

getResumeRecoverableSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable> getResumeRecoverableSerializer()

Specified by:

getResumeRecoverableSerializer in interface org.apache.flink.core.fs.RecoverableWriter