org.apache.hudi.common.model

Class OverwriteWithLatestMerger

java.lang.Object

org.apache.hudi.common.model.OverwriteWithLatestMerger

All Implemented Interfaces:

Serializable, HoodieRecordMerger

public class OverwriteWithLatestMerger
extends Object
implements HoodieRecordMerger

Avro Merger that always chooses the newer record

See Also:

Serialized Form

Field Summary

Fields inherited from interface org.apache.hudi.common.model.HoodieRecordMerger

DEFAULT_MERGER_STRATEGY_UUID, OVERWRITE_MERGER_STRATEGY_UUID

Constructor Summary

Constructors

Constructor and Description
OverwriteWithLatestMerger()

Method Summary

Modifier and Type	Method and Description
String	getMergingStrategy() The kind of merging strategy this recordMerger belongs to.
HoodieRecord.HoodieRecordType	getRecordType() The record type handled by the current merger.
Option<Pair<HoodieRecord,org.apache.avro.Schema>>	merge(HoodieRecord older, org.apache.avro.Schema oldSchema, HoodieRecord newer, org.apache.avro.Schema newSchema, TypedProperties props) This method converges combineAndGetUpdateValue and precombine from HoodiePayload.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.common.model.HoodieRecordMerger

fullOuterMerge, getMandatoryFieldsForMerging, getRecordMergeMode, partialMerge, shouldFlush

Constructor Detail

OverwriteWithLatestMerger

public OverwriteWithLatestMerger()

Method Detail

merge

public Option<Pair<HoodieRecord,org.apache.avro.Schema>> merge(HoodieRecord older,
                                                               org.apache.avro.Schema oldSchema,
                                                               HoodieRecord newer,
                                                               org.apache.avro.Schema newSchema,
                                                               TypedProperties props)
                                                        throws IOException

Description copied from interface: HoodieRecordMerger

This method converges combineAndGetUpdateValue and precombine from HoodiePayload. It'd be associative operation: f(a, f(b, c)) = f(f(a, b), c) (which we can translate as having 3 versions A, B, C of the single record, both orders of operations applications have to yield the same result) This method takes only full records for merging.

Specified by:

merge in interface HoodieRecordMerger

Throws:

IOException

getRecordType

public HoodieRecord.HoodieRecordType getRecordType()

Description copied from interface: HoodieRecordMerger

The record type handled by the current merger. SPARK, AVRO, FLINK

Specified by:

getRecordType in interface HoodieRecordMerger

getMergingStrategy

public String getMergingStrategy()

Description copied from interface: HoodieRecordMerger

The kind of merging strategy this recordMerger belongs to. An UUID represents merging strategy.

Specified by:

getMergingStrategy in interface HoodieRecordMerger