org.apache.hudi.table

Class BucketIndexBulkInsertPartitioner<T>

java.lang.Object

org.apache.hudi.table.BucketIndexBulkInsertPartitioner<T>

All Implemented Interfaces:

Serializable, BulkInsertPartitioner<T>

public abstract class BucketIndexBulkInsertPartitioner<T>
extends Object
implements BulkInsertPartitioner<T>

Abstract of bucket index bulk_insert partitioner

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	consistentLogicalTimestampEnabled
protected List<Boolean>	doAppend
protected List<String>	fileIdPfxList
protected List<String>	indexKeyFields
static org.apache.logging.log4j.Logger	LOG
protected String[]	sortColumnNames
protected HoodieTable	table

Constructor Summary

Constructors

Constructor and Description
BucketIndexBulkInsertPartitioner(HoodieTable table, String sortString, boolean preserveHoodieMetadata)

Method Summary

Modifier and Type	Method and Description
boolean	arePartitionRecordsSorted()
String	getFileIdPfx(int partitionId) Return file group id prefix for the given data partition.
Option<WriteHandleFactory>	getWriteHandleFactory(int idx) Return write handle factory for the given partition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.table.BulkInsertPartitioner

repartitionRecords

Field Detail

LOG

public static final org.apache.logging.log4j.Logger LOG

sortColumnNames

protected final String[] sortColumnNames

consistentLogicalTimestampEnabled

protected final boolean consistentLogicalTimestampEnabled

table

protected final HoodieTable table

indexKeyFields

protected final List<String> indexKeyFields

doAppend

protected final List<Boolean> doAppend

fileIdPfxList

protected final List<String> fileIdPfxList

Constructor Detail

BucketIndexBulkInsertPartitioner

public BucketIndexBulkInsertPartitioner(HoodieTable table,
                                        String sortString,
                                        boolean preserveHoodieMetadata)

Method Detail

getWriteHandleFactory

public Option<WriteHandleFactory> getWriteHandleFactory(int idx)

Description copied from interface: BulkInsertPartitioner

Return write handle factory for the given partition.

Specified by:

getWriteHandleFactory in interface BulkInsertPartitioner<T>

Parameters:

idx - data partition

Returns:

getFileIdPfx

public String getFileIdPfx(int partitionId)

Description copied from interface: BulkInsertPartitioner

Return file group id prefix for the given data partition. By default, return a new file group id prefix, so that incoming records will route to a fresh new file group

Specified by:

getFileIdPfx in interface BulkInsertPartitioner<T>

Parameters:

partitionId - data partition

Returns:

arePartitionRecordsSorted

public boolean arePartitionRecordsSorted()

Specified by:

arePartitionRecordsSorted in interface BulkInsertPartitioner<T>

Returns:

true if the records are sorted by partition-path; false otherwise.