org.apache.flink.contrib.streaming.state

Class RocksDBStateUploader

java.lang.Object

org.apache.flink.contrib.streaming.state.RocksDBStateUploader

All Implemented Interfaces:

Closeable, AutoCloseable

public class RocksDBStateUploader
extends Object
implements Closeable

Help class for uploading RocksDB state files.

Constructor Summary

Constructors

Constructor and Description
RocksDBStateUploader(int numberOfSnapshottingThreads)
RocksDBStateUploader(RocksDBStateDataTransferHelper transfer)

Method Summary

Modifier and Type	Method and Description
void	close()
List<org.apache.flink.runtime.state.IncrementalKeyedStateHandle.HandleAndLocalPath>	uploadFilesToCheckpointFs(List<Path> files, org.apache.flink.runtime.state.CheckpointStreamFactory checkpointStreamFactory, org.apache.flink.runtime.state.CheckpointedStateScope stateScope, org.apache.flink.core.fs.CloseableRegistry closeableRegistry, org.apache.flink.core.fs.CloseableRegistry tmpResourcesRegistry) Upload all the files to checkpoint fileSystem using specified number of threads.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RocksDBStateUploader

@VisibleForTesting
public RocksDBStateUploader(int numberOfSnapshottingThreads)

RocksDBStateUploader

public RocksDBStateUploader(RocksDBStateDataTransferHelper transfer)

Method Detail

uploadFilesToCheckpointFs

public List<org.apache.flink.runtime.state.IncrementalKeyedStateHandle.HandleAndLocalPath> uploadFilesToCheckpointFs(@Nonnull
                                                                                                                     List<Path> files,
                                                                                                                     org.apache.flink.runtime.state.CheckpointStreamFactory checkpointStreamFactory,
                                                                                                                     org.apache.flink.runtime.state.CheckpointedStateScope stateScope,
                                                                                                                     org.apache.flink.core.fs.CloseableRegistry closeableRegistry,
                                                                                                                     org.apache.flink.core.fs.CloseableRegistry tmpResourcesRegistry)
                                                                                                              throws Exception

Upload all the files to checkpoint fileSystem using specified number of threads.

Parameters:

files - The files will be uploaded to checkpoint filesystem.

checkpointStreamFactory - The checkpoint streamFactory used to create outputstream.

stateScope -

Throws:

Exception - Thrown if can not upload all the files.

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException