org.apache.flink.contrib.streaming.state.restore

Class AbstractRocksDBRestoreOperation<K>

java.lang.Object

org.apache.flink.contrib.streaming.state.restore.AbstractRocksDBRestoreOperation<K>

Type Parameters:

K - The data type that the serializer serializes.

All Implemented Interfaces:

AutoCloseable, RocksDBRestoreOperation, org.apache.flink.runtime.state.RestoreOperation<RocksDBRestoreResult>

Direct Known Subclasses:

RocksDBFullRestoreOperation, RocksDBIncrementalRestoreOperation, RocksDBNoneRestoreOperation

public abstract class AbstractRocksDBRestoreOperation<K>
extends Object
implements RocksDBRestoreOperation, AutoCloseable

Base implementation of RocksDB restore operation.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.flink.core.fs.CloseableRegistry	cancelStreamRegistry
protected List<org.rocksdb.ColumnFamilyDescriptor>	columnFamilyDescriptors
protected List<org.rocksdb.ColumnFamilyHandle>	columnFamilyHandles
protected java.util.function.Function<String,org.rocksdb.ColumnFamilyOptions>	columnFamilyOptionsFactory
protected org.rocksdb.RocksDB	db
protected org.rocksdb.DBOptions	dbOptions
protected String	dbPath
protected org.rocksdb.ColumnFamilyHandle	defaultColumnFamilyHandle
protected File	instanceBasePath
protected File	instanceRocksDBPath
protected boolean	isKeySerializerCompatibilityChecked
protected int	keyGroupPrefixBytes
protected org.apache.flink.runtime.state.KeyGroupRange	keyGroupRange
protected org.apache.flink.runtime.state.StateSerializerProvider<K>	keySerializerProvider
protected Map<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo>	kvStateInformation
protected org.apache.flink.metrics.MetricGroup	metricGroup
protected RocksDBNativeMetricMonitor	nativeMetricMonitor
protected RocksDBNativeMetricOptions	nativeMetricOptions
protected int	numberOfTransferringThreads
protected Collection<org.apache.flink.runtime.state.KeyedStateHandle>	restoreStateHandles
protected RocksDbTtlCompactFiltersManager	ttlCompactFiltersManager
protected ClassLoader	userCodeClassLoader

Constructor Summary

Constructors

Modifier

Constructor and Description

protected

AbstractRocksDBRestoreOperation(org.apache.flink.runtime.state.KeyGroupRange keyGroupRange, int keyGroupPrefixBytes, int numberOfTransferringThreads, org.apache.flink.core.fs.CloseableRegistry cancelStreamRegistry, ClassLoader userCodeClassLoader, Map<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation, org.apache.flink.runtime.state.StateSerializerProvider<K> keySerializerProvider, File instanceBasePath, File instanceRocksDBPath, org.rocksdb.DBOptions dbOptions, java.util.function.Function<String,org.rocksdb.ColumnFamilyOptions> columnFamilyOptionsFactory, RocksDBNativeMetricOptions nativeMetricOptions, org.apache.flink.metrics.MetricGroup metricGroup, Collection<org.apache.flink.runtime.state.KeyedStateHandle> stateHandles, RocksDbTtlCompactFiltersManager ttlCompactFiltersManager)

Method Summary

Modifier and Type	Method and Description
void	close() Necessary clean up iff restore operation failed.
org.rocksdb.RocksDB	getDb()
abstract RocksDBRestoreResult	restore() Restores state that was previously snapshot-ed from the provided state handles.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

keyGroupRange

protected final org.apache.flink.runtime.state.KeyGroupRange keyGroupRange

keyGroupPrefixBytes

protected final int keyGroupPrefixBytes

numberOfTransferringThreads

protected final int numberOfTransferringThreads

cancelStreamRegistry

protected final org.apache.flink.core.fs.CloseableRegistry cancelStreamRegistry

userCodeClassLoader

protected final ClassLoader userCodeClassLoader

columnFamilyOptionsFactory

protected final java.util.function.Function<String,org.rocksdb.ColumnFamilyOptions> columnFamilyOptionsFactory

dbOptions

protected final org.rocksdb.DBOptions dbOptions

kvStateInformation

protected final Map<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation

instanceBasePath

protected final File instanceBasePath

instanceRocksDBPath

protected final File instanceRocksDBPath

dbPath

protected final String dbPath

columnFamilyHandles

protected List<org.rocksdb.ColumnFamilyHandle> columnFamilyHandles

columnFamilyDescriptors

protected List<org.rocksdb.ColumnFamilyDescriptor> columnFamilyDescriptors

keySerializerProvider

protected final org.apache.flink.runtime.state.StateSerializerProvider<K> keySerializerProvider

nativeMetricOptions

protected final RocksDBNativeMetricOptions nativeMetricOptions

metricGroup

protected final org.apache.flink.metrics.MetricGroup metricGroup

restoreStateHandles

protected final Collection<org.apache.flink.runtime.state.KeyedStateHandle> restoreStateHandles

ttlCompactFiltersManager

protected final RocksDbTtlCompactFiltersManager ttlCompactFiltersManager

db

protected org.rocksdb.RocksDB db

defaultColumnFamilyHandle

protected org.rocksdb.ColumnFamilyHandle defaultColumnFamilyHandle

nativeMetricMonitor

protected RocksDBNativeMetricMonitor nativeMetricMonitor

isKeySerializerCompatibilityChecked

protected boolean isKeySerializerCompatibilityChecked

Constructor Detail

AbstractRocksDBRestoreOperation

protected AbstractRocksDBRestoreOperation(org.apache.flink.runtime.state.KeyGroupRange keyGroupRange,
                                          int keyGroupPrefixBytes,
                                          int numberOfTransferringThreads,
                                          org.apache.flink.core.fs.CloseableRegistry cancelStreamRegistry,
                                          ClassLoader userCodeClassLoader,
                                          Map<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation,
                                          org.apache.flink.runtime.state.StateSerializerProvider<K> keySerializerProvider,
                                          File instanceBasePath,
                                          File instanceRocksDBPath,
                                          org.rocksdb.DBOptions dbOptions,
                                          java.util.function.Function<String,org.rocksdb.ColumnFamilyOptions> columnFamilyOptionsFactory,
                                          RocksDBNativeMetricOptions nativeMetricOptions,
                                          org.apache.flink.metrics.MetricGroup metricGroup,
                                          @Nonnull
                                          Collection<org.apache.flink.runtime.state.KeyedStateHandle> stateHandles,
                                          @Nonnull
                                          RocksDbTtlCompactFiltersManager ttlCompactFiltersManager)

Method Detail

getDb

public org.rocksdb.RocksDB getDb()

close

public void close()

Necessary clean up iff restore operation failed.

Specified by:

close in interface AutoCloseable

restore

public abstract RocksDBRestoreResult restore()
                                      throws Exception

Description copied from interface: RocksDBRestoreOperation

Restores state that was previously snapshot-ed from the provided state handles.

Specified by:

restore in interface RocksDBRestoreOperation

Specified by:

restore in interface org.apache.flink.runtime.state.RestoreOperation<RocksDBRestoreResult>

Throws:

Exception