org.apache.hudi.table.action.compact

Class HoodieCompactor<T extends HoodieRecordPayload,I,K,O>

java.lang.Object

org.apache.hudi.table.action.compact.HoodieCompactor<T,I,K,O>

All Implemented Interfaces:

Serializable

public abstract class HoodieCompactor<T extends HoodieRecordPayload,I,K,O>
extends Object
implements Serializable

A HoodieCompactor runs compaction on a hoodie table.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HoodieCompactor()

Method Summary

Modifier and Type	Method and Description
List<WriteStatus>	compact(HoodieCompactionHandler compactionHandler, HoodieTableMetaClient metaClient, HoodieWriteConfig config, CompactionOperation operation, String instantTime, TaskContextSupplier taskContextSupplier) Execute a single compaction operation and report back status.
HoodieData<WriteStatus>	compact(HoodieEngineContext context, HoodieCompactionPlan compactionPlan, HoodieTable table, HoodieWriteConfig config, String compactionInstantTime, HoodieCompactionHandler compactionHandler) Execute compaction operations and report back status.
abstract void	maybePersist(HoodieData<WriteStatus> writeStatus, HoodieWriteConfig config) Maybe persist write status.
abstract void	preCompact(HoodieTable table, HoodieTimeline pendingCompactionTimeline, String compactionInstantTime) Handles the compaction timeline based on the compaction instant before actual compaction.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieCompactor

public HoodieCompactor()

Method Detail

preCompact

public abstract void preCompact(HoodieTable table,
                                HoodieTimeline pendingCompactionTimeline,
                                String compactionInstantTime)

Handles the compaction timeline based on the compaction instant before actual compaction.

Parameters:

table - HoodieTable instance to use.

pendingCompactionTimeline - pending compaction timeline.

compactionInstantTime - compaction instant

maybePersist

public abstract void maybePersist(HoodieData<WriteStatus> writeStatus,
                                  HoodieWriteConfig config)

Maybe persist write status.

Parameters:

writeStatus - HoodieData of WriteStatus.

compact

public HoodieData<WriteStatus> compact(HoodieEngineContext context,
                                       HoodieCompactionPlan compactionPlan,
                                       HoodieTable table,
                                       HoodieWriteConfig config,
                                       String compactionInstantTime,
                                       HoodieCompactionHandler compactionHandler)

Execute compaction operations and report back status.

compact

public List<WriteStatus> compact(HoodieCompactionHandler compactionHandler,
                                 HoodieTableMetaClient metaClient,
                                 HoodieWriteConfig config,
                                 CompactionOperation operation,
                                 String instantTime,
                                 TaskContextSupplier taskContextSupplier)
                          throws IOException

Execute a single compaction operation and report back status.

Throws:

IOException