org.apache.flink.contrib.streaming.state.snapshot

Class RocksFullSnapshotStrategy<K>

java.lang.Object

org.apache.flink.contrib.streaming.state.snapshot.RocksDBSnapshotStrategyBase<K,org.apache.flink.runtime.state.FullSnapshotResources<K>>

org.apache.flink.contrib.streaming.state.snapshot.RocksFullSnapshotStrategy<K>

Type Parameters:

K - type of the backend keys.

All Implemented Interfaces:

org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.runtime.state.SnapshotStrategy<org.apache.flink.runtime.state.KeyedStateHandle,org.apache.flink.runtime.state.FullSnapshotResources<K>>

public class RocksFullSnapshotStrategy<K>
extends RocksDBSnapshotStrategyBase<K,org.apache.flink.runtime.state.FullSnapshotResources<K>>

Snapshot strategy to create full snapshots of RocksDBKeyedStateBackend. Iterates and writes all states from a RocksDB snapshot of the column families.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.runtime.state.SnapshotStrategy

org.apache.flink.runtime.state.SnapshotStrategy.SnapshotResultSupplier<S extends org.apache.flink.runtime.state.StateObject>

Field Summary

Fields inherited from class org.apache.flink.contrib.streaming.state.snapshot.RocksDBSnapshotStrategyBase

db, keyGroupPrefixBytes, keyGroupRange, keySerializer, kvStateInformation, localRecoveryConfig, rocksDBResourceGuard

Constructor Summary

Constructors

Constructor and Description

RocksFullSnapshotStrategy(org.rocksdb.RocksDB db, org.apache.flink.util.ResourceGuard rocksDBResourceGuard, org.apache.flink.api.common.typeutils.TypeSerializer<K> keySerializer, LinkedHashMap<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation, LinkedHashMap<String,org.apache.flink.runtime.state.heap.HeapPriorityQueueSnapshotRestoreWrapper<?>> registeredPQStates, org.apache.flink.runtime.state.KeyGroupRange keyGroupRange, int keyGroupPrefixBytes, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig, org.apache.flink.runtime.state.StreamCompressionDecorator keyGroupCompressionDecorator)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.runtime.state.SnapshotStrategy.SnapshotResultSupplier<org.apache.flink.runtime.state.KeyedStateHandle>	asyncSnapshot(org.apache.flink.runtime.state.FullSnapshotResources<K> fullRocksDBSnapshotResources, long checkpointId, long timestamp, org.apache.flink.runtime.state.CheckpointStreamFactory checkpointStreamFactory, org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions)
void	notifyCheckpointAborted(long checkpointId)
void	notifyCheckpointComplete(long checkpointId)
org.apache.flink.runtime.state.FullSnapshotResources<K>	syncPrepareResources(long checkpointId)

Methods inherited from class org.apache.flink.contrib.streaming.state.snapshot.RocksDBSnapshotStrategyBase

getDescription

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RocksFullSnapshotStrategy

public RocksFullSnapshotStrategy(@Nonnull
                                 org.rocksdb.RocksDB db,
                                 @Nonnull
                                 org.apache.flink.util.ResourceGuard rocksDBResourceGuard,
                                 @Nonnull
                                 org.apache.flink.api.common.typeutils.TypeSerializer<K> keySerializer,
                                 @Nonnull
                                 LinkedHashMap<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation,
                                 @Nonnull
                                 LinkedHashMap<String,org.apache.flink.runtime.state.heap.HeapPriorityQueueSnapshotRestoreWrapper<?>> registeredPQStates,
                                 @Nonnull
                                 org.apache.flink.runtime.state.KeyGroupRange keyGroupRange,
                                 @Nonnegative
                                 int keyGroupPrefixBytes,
                                 @Nonnull
                                 org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig,
                                 @Nonnull
                                 org.apache.flink.runtime.state.StreamCompressionDecorator keyGroupCompressionDecorator)

Method Detail

syncPrepareResources

public org.apache.flink.runtime.state.FullSnapshotResources<K> syncPrepareResources(long checkpointId)
                                                                             throws Exception

Throws:

Exception

asyncSnapshot

public org.apache.flink.runtime.state.SnapshotStrategy.SnapshotResultSupplier<org.apache.flink.runtime.state.KeyedStateHandle> asyncSnapshot(org.apache.flink.runtime.state.FullSnapshotResources<K> fullRocksDBSnapshotResources,
                                                                                                                                             long checkpointId,
                                                                                                                                             long timestamp,
                                                                                                                                             @Nonnull
                                                                                                                                             org.apache.flink.runtime.state.CheckpointStreamFactory checkpointStreamFactory,
                                                                                                                                             @Nonnull
                                                                                                                                             org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions)

notifyCheckpointComplete

public void notifyCheckpointComplete(long checkpointId)

notifyCheckpointAborted

public void notifyCheckpointAborted(long checkpointId)