| Interface | Description |
|---|---|
| HoodieRecordCompatibilityInterface | |
| HoodieRecordMerger |
HoodieMerge defines how to merge two records.
|
| HoodieRecordPayload<T extends HoodieRecordPayload> |
Every Hoodie table has an implementation of the
HoodieRecordPayload This abstracts out callbacks which depend on record specific logic. |
| OperationModeAwareness |
In some cases, the Hudi engine needs to know what operation mode the current merging belongs to.
|
| Class | Description |
|---|---|
| AWSDmsAvroPayload |
Provides support for seamlessly applying changes captured via Amazon Database Migration Service onto S3.
|
| BaseAvroPayload |
Base class for all AVRO record based payloads, that can be ordered based on a field.
|
| BaseFile |
Represents common metadata about base-file.
|
| BootstrapBaseFileMapping |
POJO storing (partitionPath, hoodieFileId) -> external base file path.
|
| BootstrapFileMapping |
Value stored in the bootstrap index.
|
| CleanFileInfo |
File info for clean action.
|
| ClusteringGroupInfo |
Encapsulates all the needed information about a clustering group.
|
| ClusteringOperation |
Encapsulates all the needed information about a clustering file slice.
|
| CompactionOperation |
Encapsulates all the needed information about a compaction and make a decision whether this compaction is effective
or not.
|
| ConsistentHashingNode |
Used in consistent hashing index, representing nodes in the consistent hash ring.
|
| DefaultHoodieRecordPayload |
Default payload.
|
| DeleteRecord |
Delete record is a combination of HoodieKey and ordering value.
|
| EmptyHoodieRecordPayload |
Empty payload used for deletions.
|
| EventTimeAvroPayload |
The only difference with
DefaultHoodieRecordPayload is that is does not
track the event time metadata for efficiency. |
| FileSlice |
Within a file group, a slice is a combination of data file written at a commit time and list of log files, containing
changes to the data file from that commit time.
|
| FirstValueAvroPayload |
Payload clazz that is used for Hudi Table.
|
| HoodieArchivedLogFile |
The hoodie archived log file.
|
| HoodieAvroIndexedRecord |
This only use by reader returning.
|
| HoodieAvroPayload |
This is a payload to wrap a existing Hoodie Avro Record.
|
| HoodieAvroRecord<T extends HoodieRecordPayload> |
Implementation of
HoodieRecord using Avro payload. |
| HoodieAvroRecordMerger |
Record merger for Hoodie avro record.
|
| HoodieBaseFile |
Hoodie base file - Represents metadata about Hudi file in DFS.
|
| HoodieColumnRangeMetadata<T extends Comparable> |
Hoodie metadata for the column range of data stored in columnar format (like Parquet)
NOTE:
Comparable is used as raw-type so that we can handle polymorphism, where
caller apriori is not aware of the type HoodieColumnRangeMetadata is
associated with |
| HoodieCommitMetadata |
All the metadata that gets stored along with a commit.
|
| HoodieConsistentHashingMetadata |
All the metadata that is used for consistent hashing bucket index
|
| HoodieDeltaWriteStat |
Statistics about a single Hoodie delta log operation.
|
| HoodieEmptyRecord<T> | |
| HoodieFileGroup |
A set of data/base files + set of log files, that make up a unit for all operations.
|
| HoodieFileGroupId |
Unique ID to identify a file-group in a data-set.
|
| HoodieIndexDefinition |
Class representing the metadata for a functional or secondary index in Hudi.
|
| HoodieIndexMetadata |
Represents the metadata for all functional and secondary indexes in Hudi.
|
| HoodieKey |
HoodieKey consists of
|
| HoodieLogFile |
Abstracts a single log file.
|
| HoodieLogFile.LogFileComparator |
Comparator to order log-files.
|
| HoodieLSMTimelineManifest |
Manifest entry for a version snapshot of the archived timeline.
|
| HoodieLSMTimelineManifest.LSMFileEntry |
A file entry.
|
| HoodieMetadataRecordMerger |
Record merger that accumulates metadata records.
|
| HoodieMetadataWrapper |
Wrapper for Hudi metadata.
|
| HoodiePartitionMetadata |
The metadata that goes into the meta file in each partition.
|
| HoodiePayloadProps |
Holds payload properties that implementation of
HoodieRecordPayload can leverage. |
| HoodiePreCombineAvroRecordMerger |
Record merger for Hoodie avro record.
|
| HoodieRecord<T> |
A Single Record managed by Hoodie.
|
| HoodieRecordDelegate |
Delegate for
HoodieRecord. |
| HoodieRecordGlobalLocation |
Similar with
HoodieRecordLocation but with partition path. |
| HoodieRecordLocation |
Location of a HoodieRecord within the partition it belongs to.
|
| HoodieReplaceCommitMetadata |
All the metadata that gets stored along with a commit.
|
| HoodieRollingStat |
A model class defines hoodie rolling stat.
|
| HoodieRollingStatMetadata |
This class holds statistics about files belonging to a table.
|
| HoodieWriteStat |
Statistics about a single Hoodie write operation.
|
| HoodieWriteStat.RuntimeStats |
The runtime stats for writing operation.
|
| MetadataValues | |
| OverwriteNonDefaultsWithLatestAvroPayload |
subclass of OverwriteWithLatestAvroPayload.
|
| OverwriteWithLatestAvroPayload |
preCombine - Picks the latest delta record for a key, based on an ordering field;
combineAndGetUpdateValue/getInsertValue - Simply overwrites storage with latest delta record
|
| OverwriteWithLatestMerger |
Avro Merger that always chooses the newer record
|
| PartialUpdateAvroPayload |
Payload clazz that is used for partial update Hudi Table.
|
| RewriteAvroPayload |
Default payload used for rewrite use cases where we don't change schema.
|
| Enum | Description |
|---|---|
| ActionType |
The supported action types.
|
| BootstrapIndexType | |
| ConsistentHashingNode.NodeTag |
Node tag.
|
| HoodieCleaningPolicy |
Hoodie cleaning policies.
|
| HoodieFailedWritesCleaningPolicy |
Policy controlling how to perform cleaning for failed writes.
|
| HoodieFileFormat |
Hoodie file format.
|
| HoodieOperation |
Represents the changes that a row can describe in a changelog.
|
| HoodieRecord.HoodieMetadataField | |
| HoodieRecord.HoodieRecordType | |
| HoodieSyncTableStrategy |
Hoodie table synchronization strategy.
|
| HoodieTableQueryType |
Hudi table could be queried in one of the 3 following ways:
Snapshot: snapshot of the table at the given (latest if not provided) instant is queried
Read Optimized (MOR only): snapshot of the table at the given (latest if not provided)
instant is queried, but w/o reading any of the delta-log files (only reading base-files)
Incremental: only records added w/in the given time-window (defined by beginning and ending instant)
are queried
|
| HoodieTableType |
Type of the Hoodie Table.
|
| HoodieTimelineTimeZone |
Hoodie TimelineZone.
|
| IOType |
Types of lower level I/O operations done on each file slice.
|
| RecordPayloadType |
Payload to use for record.
|
| TableServiceType |
Supported runtime table services.
|
| WriteConcurrencyMode |
Different concurrency modes for write operations.
|
| WriteOperationType |
The supported write operation types, used by commitMetadata.
|
Copyright © 2024 The Apache Software Foundation. All rights reserved.