org.apache.hudi.table.action.commit

Class BaseDeleteHelper<T,I,K,O,R>

java.lang.Object

org.apache.hudi.table.action.commit.ParallelismHelper<I>

org.apache.hudi.table.action.commit.BaseDeleteHelper<T,I,K,O,R>

Type Parameters:

T -

Direct Known Subclasses:

HoodieDeleteHelper

public abstract class BaseDeleteHelper<T,I,K,O,R>
extends ParallelismHelper<I>

Helper class to perform delete keys on hoodie table.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	BaseDeleteHelper(SerializableFunctionUnchecked<I,Integer> partitionNumberExtractor)

Method Summary

Modifier and Type	Method and Description
abstract K	deduplicateKeys(K keys, HoodieTable<T,I,K,O> table, int parallelism) Deduplicate Hoodie records, using the given deduplication function.
abstract HoodieWriteMetadata<O>	execute(String instantTime, K keys, HoodieEngineContext context, HoodieWriteConfig config, HoodieTable<T,I,K,O> table, BaseCommitActionExecutor<T,I,K,O,R> deleteExecutor)

Methods inherited from class org.apache.hudi.table.action.commit.ParallelismHelper

deduceShuffleParallelism

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BaseDeleteHelper

protected BaseDeleteHelper(SerializableFunctionUnchecked<I,Integer> partitionNumberExtractor)

Method Detail

deduplicateKeys

public abstract K deduplicateKeys(K keys,
                                  HoodieTable<T,I,K,O> table,
                                  int parallelism)

Deduplicate Hoodie records, using the given deduplication function.

Parameters:

keys - HoodieKeys to deduplicate

table - target Hoodie table for deduplicating

parallelism - parallelism or partitions to be used while reducing/deduplicating

Returns:

HoodieKey already be deduplicated

execute

public abstract HoodieWriteMetadata<O> execute(String instantTime,
                                               K keys,
                                               HoodieEngineContext context,
                                               HoodieWriteConfig config,
                                               HoodieTable<T,I,K,O> table,
                                               BaseCommitActionExecutor<T,I,K,O,R> deleteExecutor)