org.apache.hudi.sink.partitioner.profile

Class EmptyWriteProfile

java.lang.Object

org.apache.hudi.sink.partitioner.profile.WriteProfile

org.apache.hudi.sink.partitioner.profile.EmptyWriteProfile

public class EmptyWriteProfile
extends WriteProfile

WriteProfile that always return empty small files.

This write profile is used for INSERT OVERWRITE and INSERT OVERWRITE TABLE operations, the existing small files are ignored because of the 'OVERWRITE' semantics.

Note: assumes the index can always index log files for Flink write.

Field Summary

Fields inherited from class org.apache.hudi.sink.partitioner.profile.WriteProfile

config, fsView, metaClient

Constructor Summary

Constructors

Constructor and Description
EmptyWriteProfile(HoodieWriteConfig config, HoodieFlinkEngineContext context)

Method Summary

Modifier and Type	Method and Description
protected List<SmallFile>	smallFilesProfile(String partitionPath) Returns a list of small files in the given partition path from the latest filesystem view.

Methods inherited from class org.apache.hudi.sink.partitioner.profile.WriteProfile

getAvgSize, getFileSystemView, getMetaClient, getMetadataCache, getRecordsPerBucket, getSmallFiles, getTable, reload

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EmptyWriteProfile

public EmptyWriteProfile(HoodieWriteConfig config,
                         HoodieFlinkEngineContext context)

Method Detail

smallFilesProfile

protected List<SmallFile> smallFilesProfile(String partitionPath)

Description copied from class: WriteProfile

Returns a list of small files in the given partition path from the latest filesystem view.

Overrides:

smallFilesProfile in class WriteProfile