Package

net.heartsavior.spark.sql

state

Permalink

package state

Visibility
  1. Public
  2. All

Type Members

  1. class StateInformationInCheckpoint extends AnyRef

    Permalink

    This class enables retrieving state.StateInformationInCheckpoint.StateInformation via reading checkpoint.

  2. class StateSchemaExtractor extends Logging

    Permalink

    This class enables extracting state schema and its format version via analyzing the streaming query.

    This class enables extracting state schema and its format version via analyzing the streaming query. The query should have its state operators but it should exclude sink(s).

    Note that it only returns which can be extracted by this class, so number of state in given query may not be same as returned number of schema information.

  3. class StateStoreDataSourceProvider extends DataSourceRegister with SchemaRelationProvider with CreatableRelationProvider

    Permalink

    Data Source Provider for state store to enable read to/write from state.

  4. class StateStorePartition extends Partition

    Permalink
  5. class StateStoreReaderRDD extends RDD[Row]

    Permalink

    An RDD that reads (key, value) pairs of state and provides rows having columns (key, value).

  6. class StateStoreRelation extends BaseRelation with TableScan with Logging

    Permalink
  7. class StateStoreWriter extends AnyRef

    Permalink

Value Members

  1. object StateInformationInCheckpoint

    Permalink
  2. object StateSchemaExtractor

    Permalink
  3. object StateStoreDataSourceProvider

    Permalink
  4. object StateStoreReaderOperatorParamExtractor

    Permalink

    This class combines StateInformation and StateSchemaInfo to provide actual parameters needed for state store read.

  5. object StateStoreWriter

    Permalink
  6. package migration

    Permalink

Ungrouped