org.apache.flink.contrib.streaming.state

Class RocksDBKeyedStateBackend<K>

java.lang.Object

org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend<K>

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.flink.runtime.state.CheckpointListener, org.apache.flink.runtime.state.heap.InternalKeyContext<K>, org.apache.flink.runtime.state.KeyedStateBackend<K>, org.apache.flink.runtime.state.Snapshotable<org.apache.flink.runtime.state.SnapshotResult<org.apache.flink.runtime.state.KeyedStateHandle>,Collection<org.apache.flink.runtime.state.KeyedStateHandle>>, org.apache.flink.util.Disposable

public class RocksDBKeyedStateBackend<K>
extends org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

An AbstractKeyedStateBackend that stores its state in RocksDB and serializes state to streams provided by a CheckpointStreamFactory upon checkpointing. This state backend can store very large state that exceeds memory and spills to disk. Except for the snapshotting, this class should be accessed as if it is not threadsafe.

This class follows the rules for closing/releasing native RocksDB resources as described in + this document.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.rocksdb.RocksDB	db Our RocksDB database, this is used by the actual subclasses of AbstractRocksDBState to store state.
static String	MERGE_OPERATOR_NAME The name of the merge operator in RocksDB.

Fields inherited from class org.apache.flink.runtime.state.AbstractKeyedStateBackend

cancelStreamRegistry, currentKey, keyGroupCompressionDecorator, keyGroupRange, keySerializer, keyValueStatesByName, kvStateRegistry, numberOfKeyGroups, userCodeClassLoader

Constructor Summary

Constructors

Constructor and Description

RocksDBKeyedStateBackend(String operatorIdentifier, ClassLoader userCodeClassLoader, File instanceBasePath, org.rocksdb.DBOptions dbOptions, org.rocksdb.ColumnFamilyOptions columnFamilyOptions, org.apache.flink.runtime.query.TaskKvStateRegistry kvStateRegistry, org.apache.flink.api.common.typeutils.TypeSerializer<K> keySerializer, int numberOfKeyGroups, org.apache.flink.runtime.state.KeyGroupRange keyGroupRange, org.apache.flink.api.common.ExecutionConfig executionConfig, boolean enableIncrementalCheckpointing, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)

Method Summary

Modifier and Type	Method and Description
protected <N,T,ACC,R> org.apache.flink.runtime.state.internal.InternalAggregatingState<K,N,T,ACC,R>	createAggregatingState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer, org.apache.flink.api.common.state.AggregatingStateDescriptor<T,ACC,R> stateDesc)
protected <N,T,ACC> org.apache.flink.runtime.state.internal.InternalFoldingState<K,N,T,ACC>	createFoldingState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer, org.apache.flink.api.common.state.FoldingStateDescriptor<T,ACC> stateDesc)
protected <N,T> org.apache.flink.runtime.state.internal.InternalListState<K,N,T>	createListState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer, org.apache.flink.api.common.state.ListStateDescriptor<T> stateDesc)
protected <N,UK,UV> org.apache.flink.runtime.state.internal.InternalMapState<K,N,UK,UV>	createMapState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer, org.apache.flink.api.common.state.MapStateDescriptor<UK,UV> stateDesc)
protected <N,T> org.apache.flink.runtime.state.internal.InternalReducingState<K,N,T>	createReducingState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer, org.apache.flink.api.common.state.ReducingStateDescriptor<T> stateDesc)
protected <N,T> org.apache.flink.runtime.state.internal.InternalValueState<K,N,T>	createValueState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer, org.apache.flink.api.common.state.ValueStateDescriptor<T> stateDesc)
void	dispose() Should only be called by one thread, and only after all accesses to the DB happened.
File	getInstanceBasePath() Only visible for testing, DO NOT USE.
int	getKeyGroupPrefixBytes()
<N> java.util.stream.Stream<K>	getKeys(String state, N namespace)
static RocksIteratorWrapper	getRocksIterator(org.rocksdb.RocksDB db)
static RocksIteratorWrapper	getRocksIterator(org.rocksdb.RocksDB db, org.rocksdb.ColumnFamilyHandle columnFamilyHandle)
static RocksIteratorWrapper	getRocksIterator(org.rocksdb.RocksDB db, org.rocksdb.ColumnFamilyHandle columnFamilyHandle, org.rocksdb.ReadOptions readOptions)
org.rocksdb.WriteOptions	getWriteOptions()
void	notifyCheckpointComplete(long completedCheckpointId)
int	numStateEntries()
void	restore(Collection<org.apache.flink.runtime.state.KeyedStateHandle> restoreState)
RunnableFuture<org.apache.flink.runtime.state.SnapshotResult<org.apache.flink.runtime.state.KeyedStateHandle>>	snapshot(long checkpointId, long timestamp, org.apache.flink.runtime.state.CheckpointStreamFactory streamFactory, org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions) Triggers an asynchronous snapshot of the keyed state backend from RocksDB.
boolean	supportsAsynchronousSnapshots()

Methods inherited from class org.apache.flink.runtime.state.AbstractKeyedStateBackend

applyToAllKeys, close, getCurrentKey, getCurrentKeyGroupIndex, getKeyGroupCompressionDecorator, getKeyGroupRange, getKeySerializer, getNumberOfKeyGroups, getOrCreateKeyedState, getPartitionedState, setCurrentKey

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MERGE_OPERATOR_NAME

public static final String MERGE_OPERATOR_NAME

The name of the merge operator in RocksDB. Do not change except you know exactly what you do.

See Also:

Constant Field Values

db

protected org.rocksdb.RocksDB db

Our RocksDB database, this is used by the actual subclasses of AbstractRocksDBState to store state. The different k/v states that we have don't each have their own RocksDB instance. They all write to this instance but to their own column family.

Constructor Detail

RocksDBKeyedStateBackend

public RocksDBKeyedStateBackend(String operatorIdentifier,
                                ClassLoader userCodeClassLoader,
                                File instanceBasePath,
                                org.rocksdb.DBOptions dbOptions,
                                org.rocksdb.ColumnFamilyOptions columnFamilyOptions,
                                org.apache.flink.runtime.query.TaskKvStateRegistry kvStateRegistry,
                                org.apache.flink.api.common.typeutils.TypeSerializer<K> keySerializer,
                                int numberOfKeyGroups,
                                org.apache.flink.runtime.state.KeyGroupRange keyGroupRange,
                                org.apache.flink.api.common.ExecutionConfig executionConfig,
                                boolean enableIncrementalCheckpointing,
                                org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
                         throws IOException

Throws:

IOException

Method Detail

getKeys

public <N> java.util.stream.Stream<K> getKeys(String state,
                                              N namespace)

dispose

public void dispose()

Should only be called by one thread, and only after all accesses to the DB happened.

Specified by:

dispose in interface org.apache.flink.runtime.state.KeyedStateBackend<K>

Specified by:

dispose in interface org.apache.flink.util.Disposable

Overrides:

dispose in class org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

getKeyGroupPrefixBytes

public int getKeyGroupPrefixBytes()

getWriteOptions

public org.rocksdb.WriteOptions getWriteOptions()

snapshot

public RunnableFuture<org.apache.flink.runtime.state.SnapshotResult<org.apache.flink.runtime.state.KeyedStateHandle>> snapshot(long checkpointId,
                                                                                                                               long timestamp,
                                                                                                                               org.apache.flink.runtime.state.CheckpointStreamFactory streamFactory,
                                                                                                                               org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions)
                                                                                                                        throws Exception

Triggers an asynchronous snapshot of the keyed state backend from RocksDB. This snapshot can be canceled and is also stopped when the backend is closed through dispose(). For each backend, this method must always be called by the same thread.

Parameters:

checkpointId - The Id of the checkpoint.

timestamp - The timestamp of the checkpoint.

streamFactory - The factory that we can use for writing our state to streams.

checkpointOptions - Options for how to perform this checkpoint.

Returns:

Future to the state handle of the snapshot data.

Throws:

Exception - indicating a problem in the synchronous part of the checkpoint.

restore

public void restore(Collection<org.apache.flink.runtime.state.KeyedStateHandle> restoreState)
             throws Exception

Throws:

Exception

notifyCheckpointComplete

public void notifyCheckpointComplete(long completedCheckpointId)

createValueState

protected <N,T> org.apache.flink.runtime.state.internal.InternalValueState<K,N,T> createValueState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer,
                                                                                                   org.apache.flink.api.common.state.ValueStateDescriptor<T> stateDesc)
                                                                                            throws Exception

Specified by:

createValueState in class org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

Throws:

Exception

createListState

protected <N,T> org.apache.flink.runtime.state.internal.InternalListState<K,N,T> createListState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer,
                                                                                                 org.apache.flink.api.common.state.ListStateDescriptor<T> stateDesc)
                                                                                          throws Exception

Specified by:

createListState in class org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

Throws:

Exception

createReducingState

protected <N,T> org.apache.flink.runtime.state.internal.InternalReducingState<K,N,T> createReducingState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer,
                                                                                                         org.apache.flink.api.common.state.ReducingStateDescriptor<T> stateDesc)
                                                                                                  throws Exception

Specified by:

createReducingState in class org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

Throws:

Exception

createAggregatingState

protected <N,T,ACC,R> org.apache.flink.runtime.state.internal.InternalAggregatingState<K,N,T,ACC,R> createAggregatingState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer,
                                                                                                                           org.apache.flink.api.common.state.AggregatingStateDescriptor<T,ACC,R> stateDesc)
                                                                                                                    throws Exception

Specified by:

createAggregatingState in class org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

Throws:

Exception

createFoldingState

protected <N,T,ACC> org.apache.flink.runtime.state.internal.InternalFoldingState<K,N,T,ACC> createFoldingState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer,
                                                                                                               org.apache.flink.api.common.state.FoldingStateDescriptor<T,ACC> stateDesc)
                                                                                                        throws Exception

Specified by:

createFoldingState in class org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

Throws:

Exception

createMapState

protected <N,UK,UV> org.apache.flink.runtime.state.internal.InternalMapState<K,N,UK,UV> createMapState(org.apache.flink.api.common.typeutils.TypeSerializer<N> namespaceSerializer,
                                                                                                       org.apache.flink.api.common.state.MapStateDescriptor<UK,UV> stateDesc)
                                                                                                throws Exception

Specified by:

createMapState in class org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

Throws:

Exception

getInstanceBasePath

public File getInstanceBasePath()

Only visible for testing, DO NOT USE.

supportsAsynchronousSnapshots

public boolean supportsAsynchronousSnapshots()

Overrides:

supportsAsynchronousSnapshots in class org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

numStateEntries

@VisibleForTesting
public int numStateEntries()

Specified by:

numStateEntries in class org.apache.flink.runtime.state.AbstractKeyedStateBackend<K>

getRocksIterator

public static RocksIteratorWrapper getRocksIterator(org.rocksdb.RocksDB db)

getRocksIterator

public static RocksIteratorWrapper getRocksIterator(org.rocksdb.RocksDB db,
                                                    org.rocksdb.ColumnFamilyHandle columnFamilyHandle)

getRocksIterator

public static RocksIteratorWrapper getRocksIterator(org.rocksdb.RocksDB db,
                                                    org.rocksdb.ColumnFamilyHandle columnFamilyHandle,
                                                    org.rocksdb.ReadOptions readOptions)