org.apache.hudi.util

Class HoodiePipeline.Builder

java.lang.Object

org.apache.hudi.util.HoodiePipeline.Builder

Enclosing class:

HoodiePipeline

public static class HoodiePipeline.Builder
extends Object

Builder for hudi source/sink pipeline construction.

Method Summary

Modifier and Type	Method and Description
HoodiePipeline.Builder	column(String column) Add a table column definition.
HoodiePipeline.TableDescriptor	getTableDescriptor()
HoodiePipeline.Builder	option(org.apache.flink.configuration.ConfigOption<?> option, Object val) Add a config option.
HoodiePipeline.Builder	option(String key, Object val)
HoodiePipeline.Builder	options(Map<String,String> options)
HoodiePipeline.Builder	partition(String... partitions) Add partition fields.
HoodiePipeline.Builder	pk(String... pks) Add primary keys.
org.apache.flink.streaming.api.datastream.DataStreamSink<?>	sink(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> input, boolean bounded)
org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData>	source(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment execEnv)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

column

public HoodiePipeline.Builder column(String column)

Add a table column definition.

Parameters:

column - the column format should be in the form like 'f0 int'

pk

public HoodiePipeline.Builder pk(String... pks)

Add primary keys.

partition

public HoodiePipeline.Builder partition(String... partitions)

Add partition fields.

option

public HoodiePipeline.Builder option(org.apache.flink.configuration.ConfigOption<?> option,
                                     Object val)

Add a config option.

option

public HoodiePipeline.Builder option(String key,
                                     Object val)

options

public HoodiePipeline.Builder options(Map<String,String> options)

sink

public org.apache.flink.streaming.api.datastream.DataStreamSink<?> sink(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> input,
                                                                        boolean bounded)

getTableDescriptor

public HoodiePipeline.TableDescriptor getTableDescriptor()

source

public org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> source(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment execEnv)