org.apache.hudi.table.format.cdc

Class CdcInputFormat

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<org.apache.flink.table.data.RowData,MergeOnReadInputSplit>

org.apache.hudi.table.format.mor.MergeOnReadInputFormat

org.apache.hudi.table.format.cdc.CdcInputFormat

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,MergeOnReadInputSplit>, org.apache.flink.core.io.InputSplitSource<MergeOnReadInputSplit>

public class CdcInputFormat
extends MergeOnReadInputFormat

The base InputFormat class to read Hoodie data set as change logs.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CdcInputFormat.Builder Builder for CdcInputFormat.
static class	CdcInputFormat.BytesArrayInputView
static class	CdcInputFormat.BytesArrayOutputView

Nested classes/interfaces inherited from class org.apache.hudi.table.format.mor.MergeOnReadInputFormat

MergeOnReadInputFormat.LogFileOnlyIterator, MergeOnReadInputFormat.MergeIterator

Field Summary

Fields inherited from class org.apache.hudi.table.format.mor.MergeOnReadInputFormat

conf, hadoopConf, tableState

Method Summary

Modifier and Type	Method and Description
static CdcInputFormat.Builder	builder() Returns the builder for MergeOnReadInputFormat.
static MergeOnReadInputSplit	fileSlice2Split(String tablePath, FileSlice fileSlice, long maxCompactionMemoryInBytes)
protected ClosableIterator<org.apache.flink.table.data.RowData>	initIterator(MergeOnReadInputSplit split)

Methods inherited from class org.apache.hudi.table.format.mor.MergeOnReadInputFormat

close, configure, createInputSplits, getBaseFileIterator, getBaseFileIteratorWithMetadata, getFullLogFileIterator, getInputSplitAssigner, getStatistics, isClosed, isEmitDelete, nextRecord, open, reachedEnd

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

initIterator

protected ClosableIterator<org.apache.flink.table.data.RowData> initIterator(MergeOnReadInputSplit split)
                                                                      throws IOException

Overrides:

initIterator in class MergeOnReadInputFormat

Throws:

IOException

builder

public static CdcInputFormat.Builder builder()

Returns the builder for MergeOnReadInputFormat.

fileSlice2Split

public static MergeOnReadInputSplit fileSlice2Split(String tablePath,
                                                    FileSlice fileSlice,
                                                    long maxCompactionMemoryInBytes)