org.apache.hudi.client.bootstrap

Class FullRecordBootstrapDataProvider<I>

java.lang.Object

org.apache.hudi.client.bootstrap.FullRecordBootstrapDataProvider<I>

All Implemented Interfaces:

Serializable

public abstract class FullRecordBootstrapDataProvider<I>
extends Object
implements Serializable

Creates Hoodie Records with complete record data, given a list of partitions to be bootstrapped.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected HoodieEngineContext	context
protected static org.slf4j.Logger	LOG
protected TypedProperties	props

Constructor Summary

Constructors

Constructor and Description
FullRecordBootstrapDataProvider(TypedProperties props, HoodieEngineContext context)

Method Summary

Modifier and Type	Method and Description
abstract I	generateInputRecords(String tableName, String sourceBasePath, List<Pair<String,List<HoodieFileStatus>>> partitionPaths, HoodieWriteConfig config) Generates a list of input partition and files and returns a collection representing source.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final org.slf4j.Logger LOG

props

protected final TypedProperties props

context

protected final transient HoodieEngineContext context

Constructor Detail

FullRecordBootstrapDataProvider

public FullRecordBootstrapDataProvider(TypedProperties props,
                                       HoodieEngineContext context)

Method Detail

generateInputRecords

public abstract I generateInputRecords(String tableName,
                                       String sourceBasePath,
                                       List<Pair<String,List<HoodieFileStatus>>> partitionPaths,
                                       HoodieWriteConfig config)

Generates a list of input partition and files and returns a collection representing source.

Parameters:

tableName - Hudi Table Name

sourceBasePath - Source Base Path

partitionPaths - Partition Paths

config - config

Returns:

input records