org.apache.hudi.io

Class HoodieSortedMergeHandleWithChangeLog<T,I,K,O>

java.lang.Object

org.apache.hudi.io.HoodieIOHandle<T,I,K,O>

org.apache.hudi.io.HoodieWriteHandle<T,I,K,O>

org.apache.hudi.io.HoodieMergeHandle<T,I,K,O>

org.apache.hudi.io.HoodieMergeHandleWithChangeLog<T,I,K,O>

org.apache.hudi.io.HoodieSortedMergeHandleWithChangeLog<T,I,K,O>

public class HoodieSortedMergeHandleWithChangeLog<T,I,K,O>
extends HoodieMergeHandleWithChangeLog<T,I,K,O>

A sorted merge handle that supports logging change logs.

Field Summary

Fields inherited from class org.apache.hudi.io.HoodieMergeHandleWithChangeLog

cdcLogger

Fields inherited from class org.apache.hudi.io.HoodieMergeHandle

baseFileToMerge, fileWriter, insertRecordsWritten, keyGeneratorOpt, keyToNewRecords, newFilePath, oldFilePath, partitionFields, partitionValues, preserveMetadata, recordsDeleted, recordsWritten, updatedRecordsWritten, writtenRecordKeys

Fields inherited from class org.apache.hudi.io.HoodieWriteHandle

fileId, newRecordLocation, partitionPath, recordMerger, schemaOnReadEnabled, taskContextSupplier, timer, writeSchema, writeSchemaWithMetaFields, writeStatus, writeToken

Fields inherited from class org.apache.hudi.io.HoodieIOHandle

config, hoodieTable, instantTime, storage

Constructor Summary

Constructors

Constructor and Description
HoodieSortedMergeHandleWithChangeLog(HoodieWriteConfig config, String instantTime, HoodieTable<T,I,K,O> hoodieTable, Iterator<HoodieRecord<T>> recordItr, String partitionPath, String fileId, TaskContextSupplier taskContextSupplier, Option<BaseKeyGenerator> keyGeneratorOpt)
HoodieSortedMergeHandleWithChangeLog(HoodieWriteConfig config, String instantTime, HoodieTable<T,I,K,O> hoodieTable, Map<String,HoodieRecord<T>> keyToNewRecords, String partitionPath, String fileId, HoodieBaseFile dataFileToBeMerged, TaskContextSupplier taskContextSupplier, Option<BaseKeyGenerator> keyGeneratorOpt) Called by compactor code path.

Method Summary

Modifier and Type	Method and Description
protected boolean	writeRecord(HoodieRecord<T> newRecord, Option<HoodieRecord> insertRecord, org.apache.avro.Schema schema, Properties props)

Methods inherited from class org.apache.hudi.io.HoodieMergeHandleWithChangeLog

close, writeInsertRecord, writeUpdateRecord

Methods inherited from class org.apache.hudi.io.HoodieMergeHandle

baseFileForMerge, getIOType, getLatestBaseFile, getOldFilePath, getPartitionFields, getPartitionValues, getWriteStatusesAsIterator, init, initializeIncomingRecordsMap, makeOldAndNewFilePaths, performMergeDataValidationCheck, setPartitionFields, setPartitionValues, setWriteStatusPath, write, writeIncomingRecords, writeInsertRecord, writeToFile

Methods inherited from class org.apache.hudi.io.HoodieWriteHandle

canWrite, createLogWriter, createLogWriter, createMarkerFile, doWrite, getAttemptId, getConfig, getFileId, getHoodieTableMetaClient, getLogCreationCallback, getPartitionId, getPartitionPath, getStageId, getStorage, getWriterSchema, getWriterSchemaWithMetaFields, getWriteStatuses, isClosed, makeNewFilePath, makeNewPath, markClosed, toAvroRecord, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieSortedMergeHandleWithChangeLog

public HoodieSortedMergeHandleWithChangeLog(HoodieWriteConfig config,
                                            String instantTime,
                                            HoodieTable<T,I,K,O> hoodieTable,
                                            Iterator<HoodieRecord<T>> recordItr,
                                            String partitionPath,
                                            String fileId,
                                            TaskContextSupplier taskContextSupplier,
                                            Option<BaseKeyGenerator> keyGeneratorOpt)

HoodieSortedMergeHandleWithChangeLog

public HoodieSortedMergeHandleWithChangeLog(HoodieWriteConfig config,
                                            String instantTime,
                                            HoodieTable<T,I,K,O> hoodieTable,
                                            Map<String,HoodieRecord<T>> keyToNewRecords,
                                            String partitionPath,
                                            String fileId,
                                            HoodieBaseFile dataFileToBeMerged,
                                            TaskContextSupplier taskContextSupplier,
                                            Option<BaseKeyGenerator> keyGeneratorOpt)

Called by compactor code path.

Method Detail

writeRecord

protected boolean writeRecord(HoodieRecord<T> newRecord,
                              Option<HoodieRecord> insertRecord,
                              org.apache.avro.Schema schema,
                              Properties props)
                       throws IOException

Overrides:

writeRecord in class HoodieMergeHandle<T,I,K,O>

Throws:

IOException